{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:07:28Z","timestamp":1760234848032,"version":"build-2065373602"},"reference-count":104,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T00:00:00Z","timestamp":1625097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In the machine learning literature we can find numerous methods to solve classification problems. We propose two new performance measures to analyze such methods. These measures are defined by using the concept of proportional reduction of classification error with respect to three benchmark classifiers, the random and two intuitive classifiers which are based on how a non-expert person could realize classification simply by applying a frequentist approach. We show that these three simple methods are closely related to different aspects of the entropy of the dataset. Therefore, these measures account somewhat for entropy in the dataset when evaluating the performance of classifiers. This allows us to measure the improvement in the classification results compared to simple methods, and at the same time how entropy affects classification capacity. To illustrate how these new performance measures can be used to analyze classifiers taking into account the entropy of the dataset, we carry out an intensive experiment in which we use the well-known J48 algorithm, and a UCI repository dataset on which we have previously selected a subset of the most relevant attributes. Then we carry out an extensive experiment in which we consider four heuristic classifiers, and 11 datasets.<\/jats:p>","DOI":"10.3390\/e23070850","type":"journal-article","created":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T21:55:52Z","timestamp":1625176552000},"page":"850","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Benchmarking Analysis of the Accuracy of Classification Methods Related to Entropy"],"prefix":"10.3390","volume":"23","author":[{"given":"Yolanda","family":"Orenes","sequence":"first","affiliation":[{"name":"I.U.I. Centro de Investigaci\u00f3n Operativa (CIO), Universidad Miguel Hernandez de Elche, 03202 Elche, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6243-9831","authenticated-orcid":false,"given":"Alejandro","family":"Rabasa","sequence":"additional","affiliation":[{"name":"I.U.I. Centro de Investigaci\u00f3n Operativa (CIO), Universidad Miguel Hernandez de Elche, 03202 Elche, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3796-0692","authenticated-orcid":false,"given":"Jesus Javier","family":"Rodriguez-Sala","sequence":"additional","affiliation":[{"name":"I.U.I. Centro de Investigaci\u00f3n Operativa (CIO), Universidad Miguel Hernandez de Elche, 03202 Elche, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0458-2971","authenticated-orcid":false,"given":"Joaquin","family":"Sanchez-Soriano","sequence":"additional","affiliation":[{"name":"I.U.I. Centro de Investigaci\u00f3n Operativa (CIO), Universidad Miguel Hernandez de Elche, 03202 Elche, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C. (2015). Data Mining: The Textbook, Springer.","DOI":"10.1007\/978-3-319-14142-8"},{"key":"ref_2","unstructured":"Kelleher, J.D., Namee, B.M., and D\u2019Arcy, A. (2015). Machine Learning for Predictive Data Analytics: Algorithms, Worked Examples, and Case Studies, The MIT Press."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kubat, M. (2017). An Introduction to Machine Learning, Springer. [2nd ed.].","DOI":"10.1007\/978-3-319-63913-0"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Skiena, S.S. (2017). The Data Science Design Manual, Springer.","DOI":"10.1007\/978-3-319-55444-0"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_6","unstructured":"Neyman, J. (July, January 20). On measures of entropy and information. Proceedings of the 4th Berkeley Symposium on Mathematics, Statistics and Probability, Berkeley, CA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/BF01016429","article-title":"Possible generalization of Boltzmann\u2014Gibbs statistics, J","volume":"52","author":"Tsallis","year":"1988","journal-title":"Stat. Phys."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Amig\u00f3, J.M., Balogh, S.G., and Hern\u00e1ndez, S. (2018). A Brief Review of Generalized Entropies. Entropy, 20.","DOI":"10.3390\/e20110813"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"168","DOI":"10.2495\/DNE-V11-N3-168-177","article-title":"A Computational Experience For Automatic Feature Selection On Big Data Frameworks","volume":"11","author":"Orenes","year":"2016","journal-title":"Int. J. Des. Nat. Ecodynamics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1109\/TAC.1967.1098684","article-title":"An Optimum Finite Sequential Procedure For Feature Selection Furthermore, Pattern Classification","volume":"AC12","author":"Fu","year":"1967","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1109\/TAC.1967.1098765","article-title":"Divergence Furthermore, Linear Classifiers For Feature Selection","volume":"AC12","author":"Cardillo","year":"1967","journal-title":"IEEE Trans. Autom. Control."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chien, Y.T. (1969, January 17\u201319). Adaptive strategies of selecting feature subsets in pattern recognition. Proceedings of the IEEE Symposium on Adaptive Processes (8th) Decision and Control, University Park, PA, USA.","DOI":"10.1109\/SAP.1969.269915"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1021\/ac60275a025","article-title":"Computerized learning machines applied to chemical problems. Convergence rate and predictive ability of adaptive binary pattern classifiers","volume":"41","author":"Jurs","year":"1969","journal-title":"Anal. Chem."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1021\/ac60295a015","article-title":"Mass spectral Feature Selection and structural correlations using computerized learning machines","volume":"42","author":"Jurs","year":"1970","journal-title":"Anal. Chem."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1109\/TC.1977.1674939","article-title":"Branch and bound algorithm for Feature subset Selection","volume":"26","author":"Narendra","year":"1977","journal-title":"IEEE Trans. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1016\/0167-8655(94)90127-9","article-title":"Floating Search Methods in Feature-Selection","volume":"15","author":"Pudil","year":"1994","journal-title":"Pattern Recognit. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1016\/0167-8655(89)90037-8","article-title":"A note on genetic algorithms for largescale Feature-Selection","volume":"10","author":"Siedlecki","year":"1989","journal-title":"Pattern Recognit. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1002\/cem.1180060506","article-title":"Genetic algorithms as a strategy for Feature-Selection","volume":"6","author":"Leardi","year":"1992","journal-title":"J. Chemom."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/5254.671091","article-title":"Feature subset Selection using a genetic algorithm","volume":"13","author":"Yang","year":"1998","journal-title":"IEEE Intell. Syst. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"John, G., Kohavi, R., and Pfleger, K. (1994, January 10\u201313). Irrelevant features and the subset selection problem. Proceedings of the Fifth International Conference on Machine Learning, New Brunswick, NJ, USA.","DOI":"10.1016\/B978-1-55860-335-6.50023-4"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/S0004-3702(97)00043-X","article-title":"Wrappers for Feature subset Selection","volume":"97","author":"Kohavi","year":"1997","journal-title":"Artif. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1109\/34.990133","article-title":"Unsupervised feature selection using feature similarity","volume":"24","author":"Mitra","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","first-page":"1205","article-title":"Efficient Feature Selection via analysis of relevance and redundancy","volume":"5","author":"Yu","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1109\/TPAMI.2005.159","article-title":"Feature Selection based on mutual information: Criteria of max-dependency, max-relevance, and minredundancy","volume":"27","author":"Peng","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.procs.2017.08.227","article-title":"A New Feature Selection Method for Nominal Classifier based on Formal Concept Analysis","volume":"112","author":"Trabelsia","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/j.procs.2014.08.116","article-title":"Parallel learning and classification for rules based on formal concepts","volume":"35","author":"Meddouri","year":"2014","journal-title":"Procedia Comput. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1939","DOI":"10.1162\/neco.2007.19.7.1939","article-title":"Feature Selection via Coalitional Game Theory","volume":"19","author":"Cohen","year":"2007","journal-title":"Neural Comput."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Afghah, F., Razi, A., Soroushmehr, R., Ghanbari, H., and Najarian, K. (2018). Game Theoretic Approach for Systematic Feature Selection; Application in False Alarm Detection in Intensive Care Units. Entropy, 20.","DOI":"10.3390\/e20030190"},{"key":"ref_29","unstructured":"Duch, W., Wieczorek, T., Biesiada, J., and Blachnik, M. (2004, January 25\u201329). Comparison of feature ranking methods based on information entropy. Proceedings of the 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541), Budapest, Hungary."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"106536","DOI":"10.1016\/j.cie.2020.106536","article-title":"A relative entropy based feature selection framework for asset data in predictive maintenance","volume":"145","author":"Aremu","year":"2020","journal-title":"Comput. Ind. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"106245","DOI":"10.1016\/j.asoc.2020.106245","article-title":"Research on feature selection for rotating machinery based on Supervision Kernel Entropy Component Analysis with Whale Optimization Algorithm","volume":"92","author":"Bai","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.neucom.2018.10.112","article-title":"Non-unique decision differential entropy-based feature selection","volume":"393","author":"Qu","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_33","first-page":"106","article-title":"A New Feature Selection Method based on Intuitionistic Fuzzy Entropy to Categorize Text Documents","volume":"5","author":"Revanasiddappa","year":"2018","journal-title":"Int. J. Interact. Multimed. Artif. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"107517","DOI":"10.1016\/j.patcog.2020.107517","article-title":"Accelerating information entropy-based feature selection using rough set theory with classified nested equivalence classes","volume":"107","author":"Zhao","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1109\/TKDE.2005.66","article-title":"Toward integrating Feature Selection algorithms for classification and clustering","volume":"17","author":"Liu","year":"2005","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of decision tree","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach. Learn."},{"key":"ref_37","unstructured":"Quinlan, J.R. (1992). C4.5: Programs for Machine Learning, Morgan Kaufmann Publishers. [1st ed.]."},{"key":"ref_38","unstructured":"Breiman, L., Friedman, J.H., Olshen, R.A., and Stone, C.J. (1984). Classification and Regression Trees, Wadsworth International Group."},{"key":"ref_39","unstructured":"Ho, T.K. (1995, January 14\u201316). Random Decision Forests. Proceedings of the 3rd International Conference on Document Analysis and Recognition, Montreal, QC, USA."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1109\/34.709601","article-title":"The Random Subspace Method for Constructing Decision Forests\u2019","volume":"20","author":"Ho","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_42","first-page":"21","article-title":"Nearest neighbor pattern classification","volume":"13","author":"Cover","year":"1967","journal-title":"Inst. Electr. Electron. Eng. Trans. Inf. Theory"},{"key":"ref_43","unstructured":"Dasarathy, B.V. (1991). Nearest-Neighbor Classification Techniques, IEEE Computer Society Press."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/BF00153759","article-title":"Instance-based learning algorithms","volume":"6","author":"Aha","year":"1991","journal-title":"Mach. Learn."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_46","first-page":"125","article-title":"Support vector clustering","volume":"2","author":"Horn","year":"2001","journal-title":"J. Mach. Learn. Res."},{"key":"ref_47","unstructured":"McLachlan, G.J. (2004). Discriminant Analysis and Statistical Pattern Recognition, Wiley Interscience."},{"key":"ref_48","unstructured":"Langley, W.I., and Thompson, K. (1994, January 1\u20134). An analysis of Bayesian classifiers. Proceedings of the AAAI-94, Seattle, WA, USA."},{"key":"ref_49","unstructured":"John, G.H., and Langley, P. (1995, January 18\u201320). Estimating Continuous Distributions in Bayesian Classifiers. Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, San Mateo, CA, USA."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.future.2018.03.008","article-title":"Online entropy-based discretization for data streaming classification","volume":"86","author":"Herrera","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1186\/s40708-020-00108-y","article-title":"Multiclass EEG signal classification utilizing R\u00e9nyi min-entropy-based feature selection from wavelet packet transformation","volume":"7","author":"Rahman","year":"2020","journal-title":"Brain Inform."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"2101","DOI":"10.1007\/s11063-019-09995-7","article-title":"An Ensemble Classification Algorithm Based on Information Entropy for Data Streams","volume":"50","author":"Wang","year":"2019","journal-title":"Neural Process. Lett."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Mannor, S., Peleg, D., and Rubinstein, R. (2005, January 11\u201313). The cross entropy method for classification. Proceedings of the 22nd International Conference on Machine Learning (ICML \u201905), Association for Computing Machinery, New York, NY, USA.","DOI":"10.1145\/1102351.1102422"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1109\/3477.931536","article-title":"An efficient fuzzy classifier with feature selection based on fuzzy entropy","volume":"31","author":"Lee","year":"2001","journal-title":"IEEE Trans. Syst. Man Cybern. Part B Cybern."},{"key":"ref_55","unstructured":"Prieditis, A., and Russell, S. (1995). K*: An Instance-based Learner Using an Entropic Distance Measure. Machine Learning Proceedings 1995, Morgan Kaufmann."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Holub, A., Perona, P., and Burl, M.C. (2008, January 23\u201328). Entropy-based active learning for object recognition. Proceedings of the 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Anchorage, AK, USA.","DOI":"10.1109\/CVPRW.2008.4563068"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1109\/TPAMI.2007.70710","article-title":"Semisupervised Learning for a Hybrid Generative\/Discriminative Classifier based on the Maximum Entropy Principle","volume":"30","author":"Fujino","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.knosys.2016.09.032","article-title":"Entropy-based fuzzy support vector machine for imbalanced datasets","volume":"115","author":"Fan","year":"2017","journal-title":"Knowl. Based Syst."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Ramos, D., Franco-Pedroso, J., Lozano-Diez, A., and Gonzalez-Rodriguez, J. (2018). Deconstructing Cross-Entropy for Probabilistic Binary Classifiers. Entropy, 20.","DOI":"10.3390\/e20030208"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"2367","DOI":"10.3390\/e17042367","article-title":"An Entropy-Based Network Anomaly Detection Method","volume":"17","author":"Berezinski","year":"2015","journal-title":"Entropy"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Fukunaga, K. (1990). Introduction to Statistic al Pattern Recognition, Academic Press. [2nd ed.].","DOI":"10.1016\/B978-0-08-047865-4.50007-7"},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Tumer, K., and Ghosh, J. (1996, January 25\u201329). Estimating the Bayes error rate through classifier combining. Proceedings of the 13th International Conference on Pattern Recognition, Vienna, Austria.","DOI":"10.1109\/ICPR.1996.546912"},{"key":"ref_63","unstructured":"Costa, E.P., Lorena, A.C., Carvalho, A.C., and Freitas, A.A. (2007, January 22\u201323). A Review of Performance Evaluation Measures for Hierarchical Classifiers. Proceedings of the AAAI-07 Workshop Evaluation Methods for Machine Learning II, Vancouver, BC, Canada."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.ipm.2009.03.002","article-title":"A systematic analysis of performance measures for classification tasks","volume":"45","author":"Sokolova","year":"2009","journal-title":"Inf. Process. Manag."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.patrec.2008.08.010","article-title":"An experimental comparison of performance measures for classification","volume":"30","author":"Ferri","year":"2009","journal-title":"Pattern Recognit. Lett."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Parker, C. (2011, January 11\u201314). An Analysis of Performance Measures for Binary Classifiers. Proceedings of the 2011 IEEE 11th International Conference on Data Mining, Vancouver, BC, Canada.","DOI":"10.1109\/ICDM.2011.21"},{"key":"ref_67","unstructured":"Labatut, V., and Cherifi, H. (2011). Evaluation of Performance Measures for Classifiers Comparison, Computer Science, Machine Learning. arXiv."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1007\/s40484-016-0081-2","article-title":"Performance measures in evaluating machine learning based bioinformatics predictors for classifications","volume":"4","author":"Jiao","year":"2016","journal-title":"Quant. Biol."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1665","DOI":"10.1016\/j.patrec.2010.05.017","article-title":"Two information-theoretic tools to assess the performance of multi-class classifiers","volume":"31","year":"2010","journal-title":"Pattern Recognit. Lett."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Valverde-Albacete, F.J., and Pel\u00e1ez-Moreno, C. (2014). 100% Classification Accuracy Considered Harmful: The Normalized Information Transfer Factor Explains the Accuracy Paradox. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0084217"},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.eswa.2017.02.010","article-title":"The evaluation of data sources using multivariate entropy tools","volume":"78","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"2075","DOI":"10.1109\/TKDE.2019.2915643","article-title":"A Framework for Supervised Classification Performance Analysis with Information-Theoretic Methods","volume":"32","year":"2020","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A Coefficient of Agreement for Nominal Scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1086\/266577","article-title":"Reliability of Content Analysis: The Case of Nominal Scale Coding","volume":"19","author":"Scott","year":"1955","journal-title":"Public Opin. Q."},{"key":"ref_75","unstructured":"Witten, I.H., and Frank, E. (2005). Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, Elsevier."},{"key":"ref_76","first-page":"732","article-title":"Measures of Association for Cross Classifications","volume":"XLIX","author":"Goodman","year":"1954","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_77","unstructured":"Williams, P.L., and Beer, R.D. (2010). Nonnegative Decomposition of Multivariate Information. arXiv."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1016\/j.renene.2014.10.046","article-title":"Solar energy potential assessment of western Himalayan Indian state of Himachal Pradesh using J48 algorithm of WEKA in ANN based prediction model","volume":"75","author":"Yadav","year":"2015","journal-title":"Renew. Energy"},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Alloghani, M., Aljaaf, A., Hussain, A., Baker, T., Mustafina, J., Al-Jumeily, D., and Khalaf, M. (2019). Implementation of machine learning algorithms to create diabetic patient re-admission profiles. BMC Med. Inform. Decis. Mak., 19.","DOI":"10.1186\/s12911-019-0990-x"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"271","DOI":"10.21873\/anticanres.13949","article-title":"Prediction of Tumor Grade and Nodal Status in Oropharyngeal and Oral Cavity Squamous-cell Carcinoma Using a Radiomic Approach","volume":"40","author":"Romeo","year":"2020","journal-title":"Anticancer. Res."},{"key":"ref_81","unstructured":"Frank, E., Hall, M.A., and Witten, I.H. (2016). \u201cThe WEKA Workbench,\u201d Online Appendix for \u201cData Mining: Practical Machine Learning Tools and Techniques\u201d, Morgan Kaufmann Publishers. [4th ed.]."},{"key":"ref_82","unstructured":"(2020, March 09). Weka. Available online: http:\/\/ocw.uc3m.es\/ingenieria-informatica\/herramientas-de-la-inteligencia-artificial\/contenidos\/transparencias\/TutorialWeka.pdf."},{"key":"ref_83","unstructured":"(2021, June 15). Waikato Environment for Knowledge Analysis (Weka). Available online: http:\/\/www.cs.waikato.ac.nz\/ml\/weka."},{"key":"ref_84","unstructured":"Schoelkopf, B., Burges, C., and Smola, A. (1998). Fast Training of Support Vector Machines using Sequential Minimal Optimization. Advances in Kernel Methods\u2014Support Vector Learning, MIT Press."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1162\/089976601300014493","article-title":"Improvements to Platt\u2019s SMO Algorithm for SVM Classifier Design","volume":"13","author":"Keerthi","year":"2001","journal-title":"Neural Comput."},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Hastie, T., and Tibshirani, R. (1998). Classification by Pairwise Coupling. Advances in Neural Information Processing Systems, MIT Press.","DOI":"10.1214\/aos\/1028144844"},{"key":"ref_87","unstructured":"Dua, D., and Graff, C. (2021, April 23). UCI Machine Learning Repository. University of California, Irvine, School of Information and Computer Sciences. Available online: http:\/\/archive.ics.uci.edu\/ml."},{"key":"ref_88","unstructured":"(2021, April 23). Available online: http:\/\/archive.ics.uci.edu\/ml\/datasets\/Thyroid+disease."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Shinmoto Torres, R.L., Ranasinghe, D.C., Shi, Q., and Sample, A.P. (May, January 30). Sensor enabled wearable RFID technology for mitigating the risk of falls near beds. Proceedings of the 2013 IEEE International Conference on RFID, Johor Bahru, Malaysia.","DOI":"10.1109\/RFID.2013.6548154"},{"key":"ref_90","unstructured":"(2021, April 23). Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Activity+recognition+with+healthy+older+people+using+a+batteryless+wearable+sensor."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.engappai.2018.03.023","article-title":"Reliable writer identification in medieval manuscripts through page layout features: The \u201cAvila\u201d Bible case","volume":"72","author":"Maniaci","year":"2018","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_92","unstructured":"(2021, April 23). Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Avila."},{"key":"ref_93","unstructured":"(2021, April 23). Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/adult."},{"key":"ref_94","unstructured":"(2021, April 23). Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/nursery."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.dss.2014.03.001","article-title":"A Data-Driven Approach to Predict the Success of Bank Telemarketing","volume":"62","author":"Moro","year":"2014","journal-title":"Decis. Support Syst."},{"key":"ref_96","unstructured":"(2021, April 23). Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Bank+Marketing."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1093\/mnras\/stw656","article-title":"Fifty Years of Pulsar Candidate Selection: From simple filters to a new principled real-time classification approach","volume":"459","author":"RLyon","year":"2016","journal-title":"Mon. Not. R. Astron. Soc."},{"key":"ref_98","unstructured":"Lyon, R.J. (2021, April 23). HTRU2. Available online: https:\/\/doi.org\/10.6084\/m9.figshare.3080389.v1."},{"key":"ref_99","unstructured":"(2021, April 23). Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/HTRU2."},{"key":"ref_100","unstructured":"(2021, April 23). Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Connect-4."},{"key":"ref_101","unstructured":"(2021, April 23). Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Tic-Tac-Toe+Endgame."},{"key":"ref_102","unstructured":"(2021, April 23). Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/Credit+Approval."},{"key":"ref_103","unstructured":"(2021, April 23). Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/mushroom."},{"key":"ref_104","first-page":"27","article-title":"Conditional Likelihood Maximisation: A Unifying Framework for Information Theoretic Feature Selection","volume":"13","author":"Brown","year":"2012","journal-title":"J. Mach. Learn. Res."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/7\/850\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:24:56Z","timestamp":1760163896000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/7\/850"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,1]]},"references-count":104,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["e23070850"],"URL":"https:\/\/doi.org\/10.3390\/e23070850","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2021,7,1]]}}}