{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T14:14:38Z","timestamp":1780668878071,"version":"3.54.1"},"reference-count":25,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2004,6,1]],"date-time":"2004-06-01T00:00:00Z","timestamp":1086048000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGKDD Explor. Newsl."],"published-print":{"date-parts":[[2004,6]]},"abstract":"<jats:p>There are several aspects that might influence the performance achieved by existing learning systems. It has been reported that one of these aspects is related to class imbalance in which examples in training data belonging to one class heavily outnumber the examples in the other class. In this situation, which is found in real world data describing an infrequent but important event, the learning system may have difficulties to learn the concept related to the minority class. In this work we perform a broad experimental evaluation involving ten methods, three of them proposed by the authors, to deal with the class imbalance problem in thirteen UCI data sets. Our experiments provide evidence that class imbalance does not systematically hinder the performance of learning systems. In fact, the problem seems to be related to learning with too few minority class examples in the presence of other complicating factors, such as class overlapping. Two of our proposed methods deal with these conditions directly, allying a known over-sampling method with data cleaning methods in order to produce better-defined class clusters. Our comparative experiments show that, in general, over-sampling methods provide more accurate results than under-sampling methods considering the area under the ROC curve (AUC). This result seems to contradict results previously published in the literature. Two of our proposed methods, Smote + Tomek and Smote + ENN, presented very good results for data sets with a small number of positive examples. Moreover, Random over-sampling, a very simple over-sampling method, is very competitive to more complex over-sampling methods. Since the over-sampling methods provided very good performance results, we also measured the syntactic complexity of the decision trees induced from over-sampled data. Our results show that these trees are usually more complex then the ones induced from original data. Random over-sampling usually produced the smallest increase in the mean number of induced rules and Smote + ENN the smallest increase in the mean number of conditions per rule, when compared among the investigated over-sampling methods.<\/jats:p>","DOI":"10.1145\/1007730.1007735","type":"journal-article","created":{"date-parts":[[2007,1,17]],"date-time":"2007-01-17T18:32:02Z","timestamp":1169058722000},"page":"20-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3410,"title":["A study of the behavior of several methods for balancing machine learning training data"],"prefix":"10.1145","volume":"6","author":[{"given":"Gustavo E. A. P. A.","family":"Batista","sequence":"first","affiliation":[{"name":"Instituto de Ci\u00eancias Matem\u00e1ticas e de Computa\u00e7\u00e3o, S\u00e3o Carlos - SP, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ronaldo C.","family":"Prati","sequence":"additional","affiliation":[{"name":"Instituto de Ci\u00eancias Matem\u00e1ticas e de Computa\u00e7\u00e3o, S\u00e3o Carlos - SP, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria Carolina","family":"Monard","sequence":"additional","affiliation":[{"name":"Instituto de Ci\u00eancias Matem\u00e1ticas e de Computa\u00e7\u00e3o, S\u00e3o Carlos - SP, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2004,6]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"35","volume-title":"WOB","author":"Batista G. E. A. P. A.","year":"2003"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007515423169"},{"key":"e_1_2_1_3_1","unstructured":"Blake C. and Merz C. UCI Repository of Machine Learning Databases 1998. http:\/\/www.ics.uci.edu\/~mlearn\/MLRepository.html.  Blake C. and Merz C. UCI Repository of Machine Learning Databases 1998. http:\/\/www.ics.uci.edu\/~mlearn\/MLRepository.html."},{"key":"e_1_2_1_4_1","volume-title":"Workshop on Learning from Imbalanced Data Sets II","author":"Chawla N. V.","year":"2003"},{"key":"e_1_2_1_5_1","first-page":"321","volume":"16","author":"Chawla N. V.","year":"2002","journal-title":"SMOTE: Synthetic Minority Over-sampling Technique. JAIR"},{"key":"e_1_2_1_6_1","first-page":"426","volume-title":"VLDB","author":"Ciaccia P.","year":"1997"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/312129.312220"},{"key":"e_1_2_1_8_1","volume-title":"Workshop on Learning from Imbalanced Data Sets II","author":"Drummond C.","year":"2003"},{"key":"e_1_2_1_9_1","first-page":"139","author":"Ferri C.","year":"2002","journal-title":"J. Learning Decision Trees Using the Area Under the ROC Curve. In ICML ("},{"key":"e_1_2_1_10_1","volume-title":"John Wiley and Sons","author":"Hand D. J.","year":"1997"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1968.1054155"},{"key":"e_1_2_1_12_1","volume-title":"Workshop on Learning from Imbalanced Data Sets II","author":"Japkowicz N.","year":"2003"},{"key":"e_1_2_1_13_1","first-page":"5","volume":"6","author":"Japkowicz N.","year":"2002","journal-title":"The Class Imbalance Problem: A Systematic Study. IDA Journal"},{"key":"e_1_2_1_14_1","first-page":"179","volume-title":"Addressing the Course of Imbalanced Training Sets: One-sided Selection. In ICML","author":"Kubat M.","year":"1997"},{"key":"e_1_2_1_16_1","first-page":"73","volume-title":"Data Mining for Direct Mining: Problems and Solutions. In KDD","author":"Ling C. X.","year":"1998"},{"key":"e_1_2_1_17_1","unstructured":"Mitchell T. M. Machine Learning. McGraw-Hill 1997.   Mitchell T. M. Machine Learning. McGraw-Hill 1997."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24694-7_32"},{"key":"e_1_2_1_19_1","first-page":"43","volume-title":"KDD","author":"Provost F. J.","year":"1997"},{"key":"e_1_2_1_20_1","unstructured":"Quinlan J. R. C4.5 Programs for Machine Learning. Morgan Kaufmann CA 1988.   Quinlan J. R. C4.5 Programs for Machine Learning. Morgan Kaufmann CA 1988."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/7902.7906"},{"key":"e_1_2_1_22_1","first-page":"769","author":"Tomek","year":"1976","journal-title":"Two Modifications of CNN. IEEE Transactions on Systems Man and Communications SMC-6 ("},{"key":"e_1_2_1_23_1","first-page":"315","volume":"19","author":"Weiss G. M.","year":"2003","journal-title":"The Effect of Class Distribution on Tree Induction. JAIR"},{"key":"e_1_2_1_24_1","first-page":"3","volume":"2","author":"Wilson D. L.","year":"1972","journal-title":"Communications"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007626913721"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/502512.502540"}],"container-title":["ACM SIGKDD Explorations Newsletter"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1007730.1007735","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1007730.1007735","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:43:39Z","timestamp":1750286619000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1007730.1007735"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,6]]},"references-count":25,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2004,6]]}},"alternative-id":["10.1145\/1007730.1007735"],"URL":"https:\/\/doi.org\/10.1145\/1007730.1007735","relation":{},"ISSN":["1931-0145","1931-0153"],"issn-type":[{"value":"1931-0145","type":"print"},{"value":"1931-0153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2004,6]]},"assertion":[{"value":"2004-06-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}