{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T14:28:06Z","timestamp":1785421686903,"version":"3.56.0"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2004,6,1]],"date-time":"2004-06-01T00:00:00Z","timestamp":1086048000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGKDD Explor. Newsl."],"published-print":{"date-parts":[[2004,6]]},"abstract":"<jats:p>Rare objects are often of great interest and great value. Until recently, however, rarity has not received much attention in the context of data mining. Now, as increasingly complex real-world problems are addressed, rarity, and the related problem of imbalanced data, are taking center stage. This article discusses the role that rare classes and rare cases play in data mining. The problems that can result from these two forms of rarity are described in detail, as are methods for addressing these problems. These descriptions utilize examples from existing research. So that this article provides a good survey of the literature on rarity in data mining. This article also demonstrates that rare classes and rare cases are very similar phenomena---both forms of rarity are shown to cause similar problems during data mining and benefit from the same remediation methods.<\/jats:p>","DOI":"10.1145\/1007730.1007734","type":"journal-article","created":{"date-parts":[[2007,1,17]],"date-time":"2007-01-17T18:32:02Z","timestamp":1169058722000},"page":"7-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1069,"title":["Mining with rarity"],"prefix":"10.1145","volume":"6","author":[{"given":"Gary M.","family":"Weiss","sequence":"first","affiliation":[{"name":"AT&amp;T Laboratories, Piscataway, NJ"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2004,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/170035.170072"},{"key":"e_1_2_1_2_1","first-page":"4","article-title":"learning multiple descriptions to improve classification accuracy","author":"Ali K.","year":"1995","journal-title":"International Journal of Artificial Intelligence Tools"},{"key":"e_1_2_1_3_1","first-page":"109","volume-title":"Proceedings of the Seventh Belgian-Dutch Conference on Machine Learning","author":"van den Bosch A.","year":"1997"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(96)00142-2"},{"key":"e_1_2_1_5_1","volume-title":"Boca Raton","author":"Breiman L.","year":"1984"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/645526.657121"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1568-4946(02)00031-5"},{"key":"e_1_2_1_8_1","first-page":"260","volume-title":"Proceedings of the Fourth International Conference on Recent Advances in Soft Computing","author":"Carvalho D. R.","year":"2002"},{"key":"e_1_2_1_9_1","first-page":"164","volume-title":"Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining","author":"Chan P. K.","year":"2001"},{"key":"e_1_2_1_10_1","volume-title":"Workshop on Learning from Imbalanced Datasets II, International Conference on Machine Learning","author":"Chawla N. V.","year":"2003"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622407.1622416"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39804-2_12"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/3091622.3091637"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/645529.658143"},{"key":"e_1_2_1_15_1","volume-title":"Workshop on Learning from Imbalanced Data Sets II, International Conference on Machine Learning","author":"Drummond C.","year":"2003"},{"key":"e_1_2_1_16_1","first-page":"239","volume-title":"Proceedings of the Seventeenth International Conference on Machine Learning","author":"Elkan C.","year":"2001"},{"key":"e_1_2_1_17_1","first-page":"34","volume-title":"Proceedings of the 2001 Intelligent Data Analysis Conference","author":"Estabrooks A.","year":"2001"},{"key":"e_1_2_1_18_1","first-page":"99","volume-title":"Proceedings of the Sixteenth International Conference on Machine Learning","author":"Fan W.","year":"1999"},{"key":"e_1_2_1_19_1","first-page":"698","volume-title":"Oxford University Press","author":"Freitas A. A.","year":"2002"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/1892875.1892982"},{"key":"e_1_2_1_21_1","volume-title":"Optimization and Machine Learning. Addison-Wesley","author":"Goldberg D. E.","year":"1989"},{"key":"e_1_2_1_23_1","first-page":"813","volume-title":"Proceedings of the Eleventh International Joint Conference on Artificial Intelligence","author":"Holte R. C.","year":"1989"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/647462.726288"},{"key":"e_1_2_1_25_1","first-page":"321","volume-title":"International Conference on Artificial Intelligence and Soft Computing","author":"Japkowicz N.","year":"2002"},{"key":"e_1_2_1_26_1","volume-title":"International Conference on Machine Learning Workshop on Learning from Imbalanced Data Sets II","author":"Japkowicz N.","year":"2003"},{"key":"e_1_2_1_27_1","first-page":"518","volume-title":"Proceedings of the Fourteenth Joint Conference on Artificial Intelligence","author":"Japkowicz N.","year":"1995"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.3233\/IDA-2002-6504"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/375663.375673"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775092"},{"key":"e_1_2_1_31_1","first-page":"257","volume-title":"First IEEE International Conference on Data Mining","author":"Joshi M. V.","year":"2001"},{"key":"e_1_2_1_32_1","volume-title":"Workshop on Commercial Success of Data Mining, Fourth International Conference on Knowledge Discovery and Date Mining","author":"Kohavi R.","year":"1998"},{"key":"e_1_2_1_33_1","volume-title":"Springer","author":"Kubat M.","year":"1997"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007452223027"},{"key":"e_1_2_1_35_1","first-page":"179","volume-title":"Proceedings of the Fourteenth International Conference on Machine Learning","author":"Kubat M.","year":"1997"},{"key":"e_1_2_1_36_1","first-page":"73","volume-title":"Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining","author":"Ling C.","year":"1998"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/312129.312274"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/3091574.3091601"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1024099825458"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007601015854"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022646118217"},{"key":"e_1_2_1_42_1","unstructured":"J. R. Quinian. C4.5: Programs for Machine Learning. Morgan Kaufmann. San Mateo CA 1993.]]   J. R. Quinian. C4.5: Programs for Machine Learning. Morgan Kaufmann. San Mateo CA 1993.]]"},{"key":"e_1_2_1_43_1","volume-title":"Workshop on Learning from Imbalanced Data Sets II. International Conference on Machine Learning","author":"Raskutti B.","year":"2003"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1080\/08839519408945435"},{"key":"e_1_2_1_45_1","unstructured":"C. J. van Rijsbergen. Information Retrieval Butterworths London 1979.]]   C. J. van Rijsbergen. Information Retrieval Butterworths London 1979.]]"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/646307.688073"},{"key":"e_1_2_1_47_1","first-page":"91","volume-title":"Proceeding of the Tenth Canadian Conference on Artificial Intelligence","author":"Ting K. M.","year":"1994"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/3091622.3091689"},{"key":"e_1_2_1_49_1","first-page":"718","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference","author":"Weiss G. M.","year":"1999"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/3000292.3000360"},{"key":"e_1_2_1_51_1","first-page":"665","volume-title":"Proceedings of the Seventeenth National Conference on Artificial Intelligence","author":"Weiss G. M.","year":"2000"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622434.1622445"},{"key":"e_1_2_1_53_1","volume-title":"IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Yan R.","year":"2003"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/502512.502540"}],"container-title":["ACM SIGKDD Explorations Newsletter"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1007730.1007734","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1007730.1007734","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:43:39Z","timestamp":1750286619000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1007730.1007734"}},"subtitle":["a unifying framework"],"short-title":[],"issued":{"date-parts":[[2004,6]]},"references-count":53,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2004,6]]}},"alternative-id":["10.1145\/1007730.1007734"],"URL":"https:\/\/doi.org\/10.1145\/1007730.1007734","relation":{},"ISSN":["1931-0145","1931-0153"],"issn-type":[{"value":"1931-0145","type":"print"},{"value":"1931-0153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2004,6]]},"assertion":[{"value":"2004-06-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}