{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T07:09:39Z","timestamp":1778224179095,"version":"3.51.4"},"reference-count":37,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2016,2,25]],"date-time":"2016-02-25T00:00:00Z","timestamp":1456358400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>We compare four discretization methods, all based on entropy: the original C4.5 approach to discretization, two globalized methods, known as equal interval width and equal frequency per interval, and a relatively new method for discretization called multiple scanning using the C4.5 decision tree generation system. The main objective of our research is to compare the quality of these four methods using two criteria: an error rate evaluated by ten-fold cross-validation and the size of the decision tree generated by C4.5. Our results show that multiple scanning is the best discretization method in terms of the error rate and that decision trees generated from datasets discretized by multiple scanning are simpler than decision trees generated directly by C4.5 or generated from datasets discretized by both globalized discretization methods.<\/jats:p>","DOI":"10.3390\/e18030069","type":"journal-article","created":{"date-parts":[[2016,2,25]],"date-time":"2016-02-25T10:24:25Z","timestamp":1456395865000},"page":"69","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["A Comparison of Four Approaches to Discretization Based on Entropy"],"prefix":"10.3390","volume":"18","author":[{"given":"Jerzy","family":"Grzymala-Busse","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, KS 66045, USA"},{"name":"Department of Expert Systems and Artificial Intelligence, University of Information Technology and Management, Rzeszow 35-225, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Teresa","family":"Mroczek","sequence":"additional","affiliation":[{"name":"Department of Expert Systems and Artificial Intelligence, University of Information Technology and Management, Rzeszow 35-225, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,2,25]]},"reference":[{"key":"ref_1","unstructured":"Grzymala-Busse, J.W., and Mroczek, T. (July, January 30). A comparison of two approaches to discretization: Multiple scanning and C4.5. Proceedings of the 6th International Conference on Pattern Recognition and Machine Learning, Warsaw, Poland."},{"key":"ref_2","unstructured":"Blajdo, P., Grzymala-Busse, J.W., Hippe, Z.S., Knap, M., Mroczek, T., and Piatek, L. (2008, January 17\u201319). A comparison of six approaches to discretization\u2014A rough set perspective. Proceedings of the 3rd International Conference on Rough Sets and Knowledge Technology, Chengdu, China."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2349","DOI":"10.1109\/TKDE.2015.2416727","article-title":"Effective classification using a small training set based on discretization and statistical analysis","volume":"27","author":"Bruni","year":"2015","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_4","unstructured":"Chan, C.C., Batur, C., and Srinivasan, A. (1991, January 13\u201316). Determination of quantization intervals in rule based model for dynamic. Proceedings of the IEEE Conference on Systems, Man, and Cybernetics, Charlottesville, VA, USA."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1016\/S0888-613X(96)00074-6","article-title":"Global discretization of continuous attributes as preprocessing for machine learning","volume":"15","author":"Chmielewski","year":"1996","journal-title":"Int. J. Approx. Reason."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1002\/(SICI)1098-111X(200001)15:1<61::AID-INT4>3.0.CO;2-O","article-title":"Entropy and MDL discretization of continuous variables for Bayesian belief networks","volume":"15","author":"Clarke","year":"2000","journal-title":"Int. J. Intell. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1016\/j.ins.2015.04.022","article-title":"Entropy-based discretization methods for ranking data","volume":"329","author":"Soares","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Dougherty, J., Kohavi, R., and Sahami, M. (1995, January 9\u201312). Supervised and unsupervised discretization of continuous features. Proceedings of the 12th International Conference on Machine Learning, Tahoe City, CA, USA.","DOI":"10.1016\/B978-1-55860-377-6.50032-3"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1023\/A:1007674919412","article-title":"General and efficient multisplitting of numerical attributes","volume":"36","author":"Elomaa","year":"1999","journal-title":"Mach. Learn."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1023\/B:DAMI.0000015868.85039.e6","article-title":"Efficient multisplitting revisited: Optima-preserving elimination of partition candidates","volume":"8","author":"Elomaa","year":"2004","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/BF00994007","article-title":"On the handling of continuous-valued attributes in decision tree generation","volume":"8","author":"Fayyad","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_12","unstructured":"Fayyad, U.M., and Irani, K.B. (September, January 28). Multi-interval discretization of continuous-valued attributes for classification learning. Proceedings of the 13th International Joint Conference on Artificial Intelligence, San Mateo, CA, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1109\/TKDE.2012.35","article-title":"A survey of discretization techniques: Taxonomy and empirical analysis in supervised learning","volume":"25","author":"Garcia","year":"2013","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_14","unstructured":"Kl\u00f6esgen, W., and Zytkow, J.M. (2002). Handbook of Data Mining and Knowledge Discovery, Oxford University Press."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Grzymala-Busse, J.W. (2009, January 14\u201317). A multiple scanning strategy for entropy based discretization. Proceedings of the 18th International Symposium on Methodologies for Intelligent Systems, Prague, Czech Republic.","DOI":"10.1007\/978-3-642-04125-9_6"},{"key":"ref_16","unstructured":"Grzymala-Busse, J.W. (2010). Transactions on Rough Sets XI, Springer."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1002\/1098-111X(200101)16:1<29::AID-INT4>3.0.CO;2-0","article-title":"Three discretization methods for rule induction","volume":"16","author":"Stefanowski","year":"2001","journal-title":"Int. J. Intell. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.knosys.2014.10.014","article-title":"A novel approach for discretization of continuous attributes in rough set theory","volume":"73","author":"Jiang","year":"2015","journal-title":"Knowl. Based Syst."},{"key":"ref_19","unstructured":"Kohavi, R., and Sahami, M. (1996, January 2\u20134). Error-based and entropy-based discretization of continuous features. Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, Portland, Oregon."},{"key":"ref_20","unstructured":"Kerber, R. (1992, January 12\u201316). ChiMerge: Discretization of numeric attributes. Proceedings of the 10th National Conference on Artificial intelligence, San Jose, CA, USA."},{"key":"ref_21","first-page":"47","article-title":"Discretization techniques: A recent survey","volume":"32","author":"Kotsiantis","year":"2006","journal-title":"GESTS Int. Trans. Comput. Sci. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1109\/TKDE.2004.1269594","article-title":"CAIM discretization algorithm","volume":"16","author":"Kurgan","year":"2004","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1023\/A:1016304305535","article-title":"Discretization: An enabling technique","volume":"6","author":"Liu","year":"2002","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_24","unstructured":"Nguyen, H.S., and Nguyen, S.H. (1998). Rough Sets in Knowledge Discovery 1: Methodology and Applications, Physica-Verlag."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.ins.2014.02.113","article-title":"An effective discretization method for disposing high-dimensional data","volume":"270","author":"Sang","year":"2014","journal-title":"Inf. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Stefanowski, J. (1998, January 22\u201326). Handling continuous attributes in discovery of strong decision rules. Proceedings of the 1st Conference on Rough Sets and Current Trends in Computing, Warsaw, Poland.","DOI":"10.1007\/3-540-69115-4_54"},{"key":"ref_27","unstructured":"Stefanowski, J. (2001). Algorithms of Decision Rule Induction in Data Mining, Poznan University of Technology Press."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1016\/j.eswa.2015.10.005","article-title":"Discretixation of continuous attributes through low frequency numerical values and attribute interdependency","volume":"45","author":"Rahman","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1262","DOI":"10.1109\/TCYB.2014.2348012","article-title":"Segment based decision tree induction with continuous valued attributes","volume":"45","author":"Wang","year":"2015","journal-title":"IEEE Trans. Cybern."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1109\/TPAMI.1987.4767986","article-title":"Synthesizing statistical knowledge from incomplete mixed-mode data","volume":"9","author":"Wong","year":"1987","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1007\/s10994-008-5083-5","article-title":"Discretization for naive-Bayes learning: Managing discretization bias and variance","volume":"74","author":"Yang","year":"2009","journal-title":"Mach. Learn."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1486","DOI":"10.3390\/e15051486","article-title":"Discretization based on entropy and multiple scanning","volume":"15","year":"2013","journal-title":"Entropy"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"27","DOI":"10.3233\/FI-1997-3113","article-title":"A new version of the rule induction system LERS","volume":"31","year":"1997","journal-title":"Fundam. Inform."},{"key":"ref_34","unstructured":"Grzymala-Busse, J.W. (2002, January 1\u20135). MLEM2: A new algorithm for rule induction from imperfect data. Proceedings of the 9th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, Annecy, France."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1007\/BF01001956","article-title":"Rough sets","volume":"11","author":"Pawlak","year":"1982","journal-title":"Int. J. Comput. Inf. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Pawlak, Z. (1991). Rough Sets. Theoretical Aspects of Reasoning about Data, Kluwer Academic Publishers.","DOI":"10.1007\/978-94-011-3534-4"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1111\/j.1540-6261.1968.tb00843.x","article-title":"Financial ratios, discriminant analysis and the prediction of corporate bankruptcy","volume":"23","author":"Altman","year":"1968","journal-title":"J. Financ."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/18\/3\/69\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:19:38Z","timestamp":1760210378000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/18\/3\/69"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,2,25]]},"references-count":37,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2016,3]]}},"alternative-id":["e18030069"],"URL":"https:\/\/doi.org\/10.3390\/e18030069","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,2,25]]}}}