{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:35:27Z","timestamp":1777696527088,"version":"3.51.4"},"reference-count":40,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2023,11,1]],"date-time":"2023-11-01T00:00:00Z","timestamp":1698796800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Intelligent Data Analysis: An International Journal"],"published-print":{"date-parts":[[2023,11]]},"abstract":"<jats:p>Imbalanced data classification has received much attention in machine learning, and many oversampling methods exist to solve this problem. However, these methods may suffer from insufficient noise filtering, overlap between synthetic and original samples, etc., resulting in degradation of classification performance. To this end, we propose a hybrid sampling with two-step noise filtering (HSNF) method in this paper, which consists of three modules. In the first module, HSNF denoises twice according to different noise discrimination mechanisms. Note that denoising mechanism is essentially based on the Euclidean distance between samples. Then in the second module, the minority class samples are divided into two categories, boundary samples and safe samples, respectively, and a portion of the boundary majority class samples are removed. In the third module, different oversampling methods are used to synthesize instances for boundary minority class samples and safe minority class samples. Experimental results on synthetic data and benchmark datasets demonstrate the effectiveness of HSNF in comparison with several popular methods. The code of HSNF will be released.<\/jats:p>","DOI":"10.3233\/ida-227111","type":"journal-article","created":{"date-parts":[[2023,10,27]],"date-time":"2023-10-27T11:20:20Z","timestamp":1698405620000},"page":"1573-1593","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["HSNF: Hybrid sampling with two-step noise filtering for imbalanced data classification"],"prefix":"10.1177","volume":"27","author":[{"given":"Lilong","family":"Duan","sequence":"first","affiliation":[{"name":"Anhui University of Technology","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Xue","sequence":"additional","affiliation":[{"name":"Anhui University of Technology","place":["China"]},{"name":"Anhui Engineering Research Center for Intelligent Applications and Security of Industrial Internet, Maanshan, Anhui, China"},{"name":"Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, Anhui, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaolei","family":"Gu","sequence":"additional","affiliation":[{"name":"Department of Radiology, Maanshan People\u2019s Hospital, Maanshan, Anhui, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiao","family":"Luo","sequence":"additional","affiliation":[{"name":"Department of Radiology, Maanshan People\u2019s Hospital, Maanshan, Anhui, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongsheng","family":"He","sequence":"additional","affiliation":[{"name":"Department of Radiology, Maanshan People\u2019s Hospital, Maanshan, Anhui, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2023,11]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2017.05.008"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.10.042"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2789428"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2946653"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.3233\/KES-2008-125-605"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/LSENS.2018.2879990"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007452223027"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12559-014-9301-0"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSS.2014.2377811"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2008.239"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/1007730.1007734"},{"key":"e_1_3_2_13_2","unstructured":"GhoshK. BellingerC. CorizzoR. BrancoP. KrawczykB. and JapkowiczN. The class imbalance problem in deep learning Machine Learning 2022 1\u201357."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2013.01.018"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/1007730.1007735"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2007.04.009"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2013.2246188"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2016.2579658"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.3233\/IDA-215874"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.3233\/IDA-184354"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/1007730.1007737"},{"issue":"3","key":"e_1_3_2_22_2","first-page":"409","article-title":"Boosted classification trees and class probability\/quantile estimation","volume":"8","author":"Mease D.","year":"2007","unstructured":"MeaseD. WynerA.J. and BujaA., Boosted classification trees and class probability\/quantile estimation, Journal of Machine Learning Research 8(3) (2007), 409\u2013439.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_23_2","unstructured":"ManiI. and ZhangI. Knn approach to unbalanced data distributions: A case study involving information extraction in: Proceedings of Workshop on Learning from Imbalanced Datasets ICML vol. 126 2003 pp. 1\u20137."},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2015.10.012"},{"key":"e_1_3_2_25_2","doi-asserted-by":"crossref","unstructured":"Van HulseJ. KhoshgoftaarT.M. and NapolitanoA. Experimental perspectives on learning from imbalanced data in: Proceedings of the 24th International Conference on Machine learning 2007 pp. 935\u2013942.","DOI":"10.1145\/1273496.1273614"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"e_1_3_2_27_2","doi-asserted-by":"crossref","unstructured":"HanH. WangW.-Y. and MaoB.-H. Borderline-smote: A new over-sampling method in imbalanced data sets learning in: International Conference on Intelligent Computing 2005 pp. 878\u2013887.","DOI":"10.1007\/11538059_91"},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","unstructured":"BunkhumpornpatC. SinapiromsaranK. and LursinsapC. Safe-level-smote: Safe-level-synthetic minority over-sampling technique for handling the class imbalanced problem in: Pacific-Asia Conference on Knowledge Discovery and Data Mining 2009 pp. 475\u2013482.","DOI":"10.1007\/978-3-642-01307-2_43"},{"key":"e_1_3_2_29_2","doi-asserted-by":"crossref","unstructured":"HeH. BaiY. GarciaE.A. and LiS. ADASYN: Adaptive synthetic sampling approach for imbalanced learning in: 2008 IEEE International Joint Conference on Neural Networks IEEE 2008 pp. 1322\u20131328.","DOI":"10.1109\/IJCNN.2008.4633969"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40747-021-00638-w"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115297"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2012.232"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2018.06.056"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-019-01380-z"},{"key":"e_1_3_2_35_2","unstructured":"De La CallejaJ. and FuentesO. A distance-based over-sampling method for learning from imbalanced data sets in: FLAIRS Conference 2007 pp. 634\u2013635."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1967.1053964"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022627411411"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2019.06.100"},{"key":"e_1_3_2_39_2","first-page":"2825","article-title":"Scikit-learn: Machine learning in python","volume":"12","author":"Pedregosa F.","year":"2011","unstructured":"PedregosaF. VaroquauxG. GramfortA. MichelV. ThirionB. GriselO. BlondelM. PrettenhoferP. WeissR. DubourgV. et al., Scikit-learn: Machine learning in python, Journal of Machine Learning Research 12 (2011), 2825\u20132830.","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"e_1_3_2_40_2","first-page":"559","article-title":"Imbalanced-learn: A python toolbox to tackle the curse of imbalanced datasets in machine learning","volume":"18","author":"Lema\u00eetre G.","year":"2017","unstructured":"Lema\u00eetreG. NogueiraF. and AridasC.K., Imbalanced-learn: A python toolbox to tackle the curse of imbalanced datasets in machine learning, Journal of Machine Learning Research 18(1) (2017), 559\u2013563.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_41_2","doi-asserted-by":"crossref","unstructured":"JapkowiczN. Assessment metrics for imbalanced learning Imbalanced learning: Foundations algorithms and applications 2013 pp. 187\u2013206.","DOI":"10.1002\/9781118646106.ch8"}],"container-title":["Intelligent Data Analysis: An International Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/IDA-227111","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/IDA-227111","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/IDA-227111","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:20:17Z","timestamp":1777454417000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/IDA-227111"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11]]},"references-count":40,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,11]]}},"alternative-id":["10.3233\/IDA-227111"],"URL":"https:\/\/doi.org\/10.3233\/ida-227111","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"value":"1088-467X","type":"print"},{"value":"1571-4128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11]]}}}