{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T14:45:48Z","timestamp":1781621148308,"version":"3.54.5"},"reference-count":74,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2024,3,8]],"date-time":"2024-03-08T00:00:00Z","timestamp":1709856000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The purpose of the study is to propose a multi-class ensemble classifier using interval modeling dedicated to microarray datasets. An approach of creating the uncertainty intervals for the single prediction values of constituent classifiers and then aggregating the obtained intervals with the use of interval-valued aggregation functions is used. The proposed heterogeneous classification employs Random Forest, Support Vector Machines, and Multilayer Perceptron as component classifiers, utilizing cross-entropy to select the optimal classifier. Moreover, orders for intervals are applied to determine the decision class of an object. The applied interval-valued aggregation functions are tested in terms of optimizing the performance of the considered ensemble classifier. The proposed model\u2019s quality, superior to other well-known and component classifiers, is validated through comparison, demonstrating the efficacy of cross-entropy in ensemble model construction.<\/jats:p>","DOI":"10.3390\/e26030240","type":"journal-article","created":{"date-parts":[[2024,3,8]],"date-time":"2024-03-08T03:52:11Z","timestamp":1709869931000},"page":"240","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Ensemble Classifier Based on Interval Modeling for Microarray Datasets"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5287-1823","authenticated-orcid":false,"given":"Urszula","family":"Bentkowska","sequence":"first","affiliation":[{"name":"Institute of Computer Science, University of Rzesz\u00f3w, 35-310 Rzesz\u00f3w, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5865-1573","authenticated-orcid":false,"given":"Wojciech","family":"Ga\u0142ka","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, University of Rzesz\u00f3w, 35-310 Rzesz\u00f3w, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5348-8703","authenticated-orcid":false,"given":"Marcin","family":"Mrukowicz","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, University of Rzesz\u00f3w, 35-310 Rzesz\u00f3w, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-4514-4608","authenticated-orcid":false,"given":"Aleksander","family":"Wojtowicz","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, University of Rzesz\u00f3w, 35-310 Rzesz\u00f3w, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,3,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zaki, M.J., and Meira, J.W. (2020). Data Mining and Machine Learning: Fundamental Concepts and Algorithms, Cambridge University Press.","DOI":"10.1017\/9781108564175"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/s10462-007-9052-3","article-title":"Machine learning: A review of classification and combining techniques","volume":"26","author":"Kotsiantis","year":"2006","journal-title":"Artif. Intell. Rev."},{"key":"ref_3","first-page":"1","article-title":"Developing Prediction Model of Loan Risk in Banks Using Data Mining","volume":"3","author":"Hamid","year":"2016","journal-title":"Mach. Learn. Appl. Int. J."},{"key":"ref_4","unstructured":"Li, Y., Crandall, D.J., and Huttenlocher, D.P. (October, January 29). Landmark classification in large-scale image collections. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"28808","DOI":"10.1109\/ACCESS.2019.2955754","article-title":"Medical Health Big Data Classification Based on KNN Classification Algorithm","volume":"8","author":"Xing","year":"2019","journal-title":"IEEE Access"},{"key":"ref_6","unstructured":"Kolo, B. (2011). Binary and Multiclass Classification, Weatherford Press."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Buyya, R., Hernandez, S., Kovvur, R., and Sarma, T. (2022). Computational Intelligence and Data Analytics: Proceedings of ICCIDA 2022, Springer Nature. Lecture Notes on Data Engineering and Communications Technologies.","DOI":"10.1007\/978-981-19-3391-2"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jain, P., and Kapoor, A. (2009, January 20\u201325). Active learning for large multi-class problems. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206651"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1674","DOI":"10.1007\/s10618-019-00638-y","article-title":"A probabilistic classifier ensemble weighting scheme based on cross-validated accuracy estimates","volume":"33","author":"Large","year":"2019","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Murty, M.N., and Raghava, R. (2016). Support Vector Machines and Perceptrons: Learning, Optimization, Classification, and Application to Social Networks, Springer.","DOI":"10.1007\/978-3-319-41063-0"},{"key":"ref_13","unstructured":"Vang-Mata, R. (2020). Multilayer Perceptrons: Theory and Applications, Nova Science Publishers. Computer science, technology and applications."},{"key":"ref_14","first-page":"3133","article-title":"Do we need hundreds of classifiers to solve real world classification problems?","volume":"15","author":"Cernadas","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1048","DOI":"10.1109\/TCYB.2022.3181193","article-title":"Multiclass Classification with Fuzzy-Feature Observations: Theory and Algorithms","volume":"54","author":"Ma","year":"2024","journal-title":"IEEE Trans. Cybern."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1761","DOI":"10.1016\/j.patcog.2011.01.017","article-title":"An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes","volume":"44","author":"Galar","year":"2011","journal-title":"Pattern Recognit."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Dyczkowski, K. (2018). Intelligent Medical Decision Support System Based on Imperfect Information: The Case of Ovarian Tumor Diagnosis, Springer International Publishing. Studies in Computational Intelligence.","DOI":"10.1007\/978-3-319-67005-8"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"P\u0119kala, B. (2018). Uncertainty Data in Interval-Valued Fuzzy Set Theory: Properties, Algorithms and Applications, Springer International Publishing. Studies in Fuzziness and Soft Computing.","DOI":"10.1007\/978-3-319-93910-0"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bentkowska, U. (2020). Interval-Valued Methods in Classifications and Decisions, Springer.","DOI":"10.1007\/978-3-030-12927-9"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.fss.2012.07.015","article-title":"Generation of linear orders for intervals by means of aggregation functions","volume":"220","author":"Bustince","year":"2013","journal-title":"Fuzzy Sets Syst."},{"key":"ref_22","first-page":"38","article-title":"A Comparative study of different order relations of intervals","volume":"16","author":"Bhunia","year":"2012","journal-title":"Reliab. Comput."},{"key":"ref_23","unstructured":"Abdullah, M.N., Yap, B.W., Sapri, N.N.F.F., and Wan Yaacob, W.F. (2023). Lecture Notes on Data Engineering and Communications Technologies, Proceedings of the International Conference on Data Science and Emerging Technologies, Virtual, 20\u201321 December 2022, Springer Nature."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e4224","DOI":"10.1002\/cpe.4224","article-title":"Latent-lSVM classification of very high-dimensional and large-scale multi-class datasets","volume":"31","author":"Do","year":"2017","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_25","first-page":"704","article-title":"Multiclass Classification on High Dimension and Low Sample Size Data Using Genetic Programming","volume":"10","author":"Wei","year":"2022","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Elkano, M., Galar, M., Sanz, J., Lucca, G., and Bustince, H. (2017, January 27\u201330). IVOVO: A new interval-valued one-vs-one approach for multi-class classification problems. Proceedings of the 2017 Joint 17th World Congress of International Fuzzy Systems Association and 9th International Conference on Soft Computing and Intelligent Systems (IFSA-SCIS), Otsu, Japan.","DOI":"10.1109\/IFSA-SCIS.2017.8023238"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"21083","DOI":"10.1007\/s11042-017-5480-5","article-title":"Multi-classifier Ensemble Based on Dynamic Weights","volume":"77","author":"Ren","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_28","unstructured":"Susan, S., Kumar, A., and Jain, A. (2020). Inventive Communication and Computational Technologies, Springer."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"962","DOI":"10.2991\/ijcis.11.1.73","article-title":"Sparsity-driven weighted ensemble classifier","volume":"11","author":"Nar","year":"2018","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"ref_30","first-page":"9953509","article-title":"Creating Ensemble Classifiers with Information Entropy Diversity Measure","volume":"2021","author":"Zhou","year":"2021","journal-title":"Secur. Commun. Netw."},{"key":"ref_31","unstructured":"Wang, J., Xu, S., Duan, B., Liu, C., and Liang, J. (2017). An Ensemble Classification Algorithm Based on Information Entropy for Data Streams. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ramakrishna, M.T., Venkatesan, V.K., Izonin, I., Havryliuk, M., and Bhat, C.R. (2023). Homogeneous Adaboost Ensemble Machine Learning Algorithms with Reduced Entropy on Balanced Data. Entropy, 25.","DOI":"10.3390\/e25020245"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lavanya, S.R., and Mallika, R. (2022). An Ensemble Deep Learning Classifier of Entropy Convolutional Neural Network and Divergence Weight Bidirectional LSTM for Efficient Disease Prediction. Int. J. Syst. Assur. Eng. Manag., 21083\u201321107.","DOI":"10.1007\/s13198-022-01837-5"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3039","DOI":"10.1002\/int.22388","article-title":"Entropy-based hybrid sampling ensemble learning for imbalanced data","volume":"36","author":"Li","year":"2021","journal-title":"Int. J. Intell. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/0020-0255(75)90036-5","article-title":"The concept of a linguistic variable and its application to approximate reasoning\u2014I","volume":"8","author":"Zadeh","year":"1975","journal-title":"Inf. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/s10791-005-6620-5","article-title":"A prioritized information fusion method for handling fuzzy decision-making problems","volume":"22","author":"Chen","year":"2005","journal-title":"Appl. Intell."},{"key":"ref_37","unstructured":"Dubois, D., and Prade, H. (2005, January 7\u20139). Internal-valued fuzzy sets, possibility theory and imprecise probability. Proceedings of the 4th Conference of the European Society for Fuzzy Logic and Technology and 11\u00e8mes Rencontres Francophones sur la Logique Floue et ses Applications (Eusflat-LFA 2005), Barcelona, Spain."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1080\/03081070600574353","article-title":"Some geometric aggregation operators based on intuitionistic fuzzy sets","volume":"35","author":"Xu","year":"2006","journal-title":"Int. J. Gen. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Zeng, W., and Yin, Q. (2008, January 18\u201320). Similarity Measure of Interval-Valued Fuzzy Sets and Application to Pattern Recognition. Proceedings of the 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery, Jinan, China.","DOI":"10.1109\/FSKD.2008.605"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/S0019-9958(65)90241-X","article-title":"Fuzzy sets","volume":"8","author":"Zadeh","year":"1965","journal-title":"Inf. Control"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Beliakov, G., Bustince, H., and Calvo, T. (2016). A Practical Guide to Averaging Functions, Springer.","DOI":"10.1007\/978-3-319-24753-3"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1016\/j.asoc.2014.08.060","article-title":"Interval-valued fuzzy decision trees with optimal neighbourhood perimeter","volume":"24","author":"Lertworaprachaya","year":"2014","journal-title":"Appl. Soft Comput."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Janusz, A. (2014). Algorithms for Similarity Relation Learning from High Dimensional Data. [Ph.D. Thesis, Computer Science and Mechanics, Faculty of Mathematics, University of Warsaw].","DOI":"10.1007\/978-3-642-54756-0_7"},{"key":"ref_44","unstructured":"(2024, January 29). RandomForestClassifier. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.ensemble.RandomForestClassifier.html."},{"key":"ref_45","unstructured":"(2024, January 29). SVM. Available online: https:\/\/scikit-learn.org\/stable\/modules\/svm.html."},{"key":"ref_46","unstructured":"(2024, January 29). MLPClassifier. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.neural_network.MLPClassifier.html."},{"key":"ref_47","unstructured":"(2024, January 29). BaggingClassifier. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.ensemble.BaggingClassifier.html."},{"key":"ref_48","unstructured":"(2024, January 29). train_test_split. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.model_selection.train_test_split.html."},{"key":"ref_49","unstructured":"(2024, January 29). MinMaxScaler. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.preprocessing.MinMaxScaler.html."},{"key":"ref_50","unstructured":"Murphy, K.P. (2012). Machine Learning: A Probabilistic Perspective, MIT Press."},{"key":"ref_51","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning (Information Science and Statistics), Springer."},{"key":"ref_52","unstructured":"Krause, A., Brunskill, E., Cho, K., Engelhardt, B., Sabato, S., and Scarlett, J. (2023, January 23\u201329). Cross-Entropy Loss Functions: Theoretical Analysis and Applications. Proceedings of the 40th International Conference on Machine Learning, Honolulu, HI, USA. Proceedings of Machine Learning Research, PMLR."},{"key":"ref_53","unstructured":"(2024, January 29). Log Loss. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.log_loss.html."},{"key":"ref_54","unstructured":"(2024, January 29). Multi-Class Log Loss. Available online: https:\/\/scikit-learn.org\/stable\/modules\/model_evaluation.html#log-loss."},{"key":"ref_55","unstructured":"(2024, January 29). Accuracy. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.accuracy_score.html."},{"key":"ref_56","unstructured":"(2024, January 29). Recall. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.recall_score.html."},{"key":"ref_57","unstructured":"(2024, January 29). Precision. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.precision_score.html."},{"key":"ref_58","unstructured":"(2024, January 29). F1 Score. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.f1_score.html."},{"key":"ref_59","unstructured":"(2024, January 29). ROC AUC. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.roc_auc_score.html."},{"key":"ref_60","unstructured":"(2024, January 29). Balanced Accuracy. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.balanced_accuracy_score.html."},{"key":"ref_61","unstructured":"(2024, January 29). One Vs Rest. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.multiclass.OneVsRestClassifier.html."},{"key":"ref_62","unstructured":"(2024, January 29). One Vs One. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.multiclass.OneVsOneClassifier.html."},{"key":"ref_63","unstructured":"(2024, January 29). Proposed Models. Available online: https:\/\/github.com\/AleksanderW\/EntropyEnsembleIntervalModel."},{"key":"ref_64","unstructured":"(2024, January 29). Proposed Model Algorithm. Available online: https:\/\/is.gd\/tTzldX."},{"key":"ref_65","unstructured":"(2024, January 29). Proposed Entropy Model Algorithm. Available online: https:\/\/is.gd\/iGXRQC."},{"key":"ref_66","unstructured":"(2024, January 29). Proposed Entropy Groups Model Algorithm. Available online: https:\/\/is.gd\/doM8OW."},{"key":"ref_67","unstructured":"(2024, January 29). Kruskal\u2013Wallis H-Test. Available online: https:\/\/docs.scipy.org\/doc\/scipy\/reference\/generated\/scipy.stats.kruskal.html."},{"key":"ref_68","unstructured":"(2024, January 29). Dunn\u2019s Test. Available online: https:\/\/scikit-posthocs.readthedocs.io\/en\/latest\/generated\/scikit_posthocs.posthoc_dunn.html."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/BF01016429","article-title":"Possible generalization of Boltzmann-Gibbs statistics","volume":"52","author":"Tsallis","year":"1988","journal-title":"J. Stat. Phys."},{"key":"ref_70","first-page":"754","article-title":"Entropy per unit time as a metric invariant of automorphism","volume":"124","author":"Kolmogorov","year":"1959","journal-title":"Dokl. Russ. Acad. Sci."},{"key":"ref_71","first-page":"768","article-title":"On the Notion of Entropy of a Dynamical System","volume":"124","author":"Sinai","year":"1959","journal-title":"Dokl. Russ. Acad. Sci."},{"key":"ref_72","unstructured":"R\u00e9nyi, A. (July, January 20). On measures of information and entropy. Proceedings of the Fourth Berkeley Symposium on Mathematics, Statistics and Probability 1960, Berkeley, CA, USA."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1007\/978-3-030-81480-9_2","article-title":"This is it: A Primer on Shannon\u2019s Entropy and Information","volume":"78","author":"Rioul","year":"2021","journal-title":"Inf. Theory Prog. Math. Phys."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Delgado-Bonal, A., and Marshak, A. (2019). Approximate Entropy and Sample Entropy: A Comprehensive Tutorial. Entropy, 21.","DOI":"10.3390\/e21060541"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/3\/240\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:10:51Z","timestamp":1760105451000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/3\/240"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,8]]},"references-count":74,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["e26030240"],"URL":"https:\/\/doi.org\/10.3390\/e26030240","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,8]]}}}