{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,5]],"date-time":"2026-09-05T05:12:13Z","timestamp":1788585133831,"version":"build-2803163510"},"reference-count":134,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T00:00:00Z","timestamp":1669161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2022,12,31]]},"abstract":"<jats:p>Class label noise is a critical component of data quality that directly inhibits the predictive performance of machine learning algorithms. While many data-level and algorithm-level methods exist for treating label noise, the challenges associated with big data call for new and improved methods. This survey addresses these concerns by providing an extensive literature review on treating label noise within big data. We begin with an introduction to the class label noise problem and traditional methods for treating label noise. Next, we present 30 methods for treating class label noise in a range of big data contexts, i.e., high-volume, high-variety, and high-velocity problems. The surveyed works include distributed solutions capable of operating on datasets of arbitrary sizes, deep learning techniques for large-scale datasets with limited clean labels, and streaming techniques for detecting class noise in the presence of concept drift. Common trends and best practices are identified in each of these areas, implementation details are reviewed, empirical results are compared across studies when applicable, and references to 17 open-source projects and programming packages are provided. An emphasis on label noise challenges, solutions, and empirical results as they relate to big data distinguishes this work as a unique contribution that will inspire future research and guide machine learning practitioners.<\/jats:p>","DOI":"10.1145\/3492546","type":"journal-article","created":{"date-parts":[[2022,4,11]],"date-time":"2022-04-11T01:44:06Z","timestamp":1649641446000},"page":"1-43","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":35,"title":["A Survey on Classifying Big Data with Label Noise"],"prefix":"10.1145","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3511-0624","authenticated-orcid":false,"given":"Justin M.","family":"Johnson","sequence":"first","affiliation":[{"name":"Florida Atlantic University, Boca Raton, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taghi M.","family":"Khoshgoftaar","sequence":"additional","affiliation":[{"name":"Florida Atlantic University, Boca Raton, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,11,23]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"2020. Google Scholar. Retrieved from https:\/\/scholar.google.com\/."},{"key":"e_1_3_1_3_2","unstructured":"2020. IEEE Xplore Digital Library. Retrieved from https:\/\/ieeexplore.ieee.org."},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00153759\/"},{"key":"e_1_3_1_5_2","first-page":"255","article-title":"KEEL data-mining software tool: Data set repository, integration of algorithms and experimental analysis framework","volume":"17","author":"Alcala-Fdez Jesus","year":"2010","unstructured":"Jesus Alcala-Fdez, Alberto Fern\u00e1ndez, Juli\u00e1n Luengo, J. Derrac, S Garc\u00eda, Luciano Sanchez, and Francisco Herrera. 2010. KEEL data-mining software tool: Data set repository, integration of algorithms and experimental analysis framework. J. Mult.-Val. Logic Soft Comput. 17 (1 2010), 255\u2013287.","journal-title":"J. Mult.-Val. Logic Soft Comput."},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098163"},{"key":"e_1_3_1_7_2","unstructured":"Apache Software Foundation. 2020. Hadoop. Retrieved from https:\/\/hadoop.apache.org."},{"key":"e_1_3_1_8_2","first-page":"233","volume-title":"Proceedings of the 34th International Conference on Machine Learning (ICML\u201917)","author":"Arpit Devansh","year":"2017","unstructured":"Devansh Arpit, Stanis\u0142aw Jastrzundefinedbski, Nicolas Ballas, David Krueger, Emmanuel Bengio, Maxinder S. Kanwal, Tegan Maharaj, Asja Fischer, Aaron Courville, Yoshua Bengio, and Simon Lacoste-Julien. 2017. A closer look at memorization in deep networks. In Proceedings of the 34th International Conference on Machine Learning (ICML\u201917). JMLR.org, 233\u2013242."},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44522-6_64"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553380"},{"key":"e_1_3_1_11_2","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NeurIPS)","author":"Berthelot David","year":"2019","unstructured":"David Berthelot, Nicholas Carlini, Ian Goodfellow, Nicolas Papernot, Avital Oliver, and Colin Raffel. 2019. MixMatch: A holistic approach to semi-supervised learning. In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_3_1_12_2","first-page":"82","volume-title":"Proceedings of the 29th Conference on Uncertainty in Artificial Intelligence (UAI\u201913)","author":"Bootkrajang Jakramate","year":"2013","unstructured":"Jakramate Bootkrajang and Ata Kab\u00e1n. 2013. Boosting in the presence of label noise. In Proceedings of the 29th Conference on Uncertainty in Artificial Intelligence (UAI\u201913). AUAI Press, 82\u201391."},{"key":"e_1_3_1_13_2","volume-title":"Proceedings of the 19th European Symposium on Artificial Neural Networks","author":"Bootkrajang Jakramate","year":"2011","unstructured":"Jakramate Bootkrajang and Ata Kab\u00e1n. 2011. Multi-class classification in the presence of labelling errors. In Proceedings of the 19th European Symposium on Artificial Neural Networks."},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.5555\/3013545.3013548"},{"key":"e_1_3_1_15_2","article-title":"Language models are few-shot learners","volume":"2005","author":"Brown Tom B.","year":"2020","unstructured":"Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. CoRR abs\/2005.14165 (2020).","journal-title":"CoRR"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2012.05.002"},{"key":"e_1_3_1_17_2","first-page":"11","volume-title":"EWSL","author":"Clark Peter","year":"1987","unstructured":"Peter Clark and Tim Niblett. 1987. Induction in noisy domains. In EWSL, Ivan Bratko and Nada Lavrac (Eds.). Citeseer, 11\u201330. http:\/\/dblp.uni-trier.de\/db\/conf\/ecml\/ewsl87.html#ClarkN87."},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"e_1_3_1_19_2","volume-title":"Dask: Library for Dynamic Task Scheduling","author":"Team Dask Development","year":"2016","unstructured":"Dask Development Team. 2016. Dask: Library for Dynamic Task Scheduling. Retrieved from https:\/\/dask.org."},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Yifan Ding Liqiang Wang Deliang Fan and Boqing Gong. 2018. A Semi-Supervised Two-Stage Approach to Learning from Noisy Labels. arxiv:cs.CV\/1802.02679.","DOI":"10.1109\/WACV.2018.00138"},{"key":"e_1_3_1_22_2","unstructured":"Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. Retrieved from http:\/\/archive.ics.uci.edu\/ml."},{"key":"e_1_3_1_23_2","unstructured":"Edd Dumbill. 2012. What is Big Data?: An Introduction to the Big Data Landscape. Retrieved from http:\/\/radar.oreilly.com\/2012\/01\/what-is-big-data.html."},{"key":"e_1_3_1_24_2","first-page":"245","article-title":"Identifying learners robust to low quality data.","volume":"33","author":"Folleco Andres","year":"2009","unstructured":"Andres Folleco, Taghi Khoshgoftaar, Jason Van Hulse, and Amri Napolitano. 2009. Identifying learners robust to low quality data. Informatica (Slovenia) 33 (1 2009), 245\u2013259.","journal-title":"Informatica (Slovenia)"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2013.2292894"},{"key":"e_1_3_1_26_2","first-page":"1401","volume-title":"Proceedings of the 16th International Joint Conference on Artificial Intelligence","author":"Freund Yoav","year":"1999","unstructured":"Yoav Freund and Robert E. Schapire. 1999. A short introduction to boosting. In Proceedings of the 16th International Joint Conference on Artificial Intelligence. Morgan Kaufmann, 1401\u20131406."},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1016218223"},{"key":"e_1_3_1_28_2","first-page":"143","volume-title":"Proceedings of the of 16th International Conference on Machine Learning (ICML\u201999)","author":"Gamberger Dragan","year":"1999","unstructured":"Dragan Gamberger, Rudjer Boskovic, Nada Lavrac, and Ciril Groselj. 1999. Experiments with noise filtering in a medical domain. In Proceedings of the of 16th International Conference on Machine Learning (ICML\u201999). Morgan Kaufmann, 143\u2013151."},{"key":"e_1_3_1_29_2","unstructured":"Diego Garc\u00ed. 2020. HTE-BD HME-BD ENN-BD Code. Retrieved from https:\/\/github.com\/djgarcia\/NoiseFramework."},{"key":"e_1_3_1_30_2","unstructured":"Diego Garc\u00eda. 2020. IEF_BD Code. Retrieved from https:\/\/github.com\/djgarcia\/IEF_BD."},{"key":"e_1_3_1_31_2","unstructured":"Diego Garc\u00eda. 2020. SmartFiltering Code. Retrieved from https:\/\/github.com\/djgarcia\/SmartFiltering."},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2018.12.002"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1002\/int.22193"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2019.113132"},{"key":"e_1_3_1_35_2","volume-title":"Proceedings of the International Conference on Machine Learning (ICML)","author":"Goldberger J.","year":"2017","unstructured":"J. Goldberger and E. Ben-Reuven. 2017. Training deep neural-networks using a noise adaptation layer. In Proceedings of the International Conference on Machine Learning (ICML)."},{"key":"e_1_3_1_36_2","unstructured":"Sheng Guo. 2020. CurriculumNet Code. Retrieved from https:\/\/github.com\/guoshengcv\/cul."},{"key":"e_1_3_1_37_2","article-title":"CurriculumNet: Weakly supervised learning from large-scale web images","volume":"1808","author":"Guo Sheng","year":"2018","unstructured":"Sheng Guo, Weilin Huang, Haozhi Zhang, Chenfan Zhuang, Dengke Dong, Matthew R. Scott, and Dinglong Huang. 2018. CurriculumNet: Weakly supervised learning from large-scale web images. CoRR abs\/1808.01097 (2018).","journal-title":"CoRR"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2019.11.146"},{"key":"e_1_3_1_39_2","first-page":"8536","volume-title":"Proceedings of the 32nd International Conference on Neural Information Processing Systems (NIPS\u201918)","author":"Han Bo","year":"2018","unstructured":"Bo Han, Quanming Yao, Xingrui Yu, Gang Niu, Miao Xu, Weihua Hu, Ivor W. Tsang, and Masashi Sugiyama. 2018. Co-teaching: Robust training of deep neural networks with extremely noisy labels. In Proceedings of the 32nd International Conference on Neural Information Processing Systems (NIPS\u201918). Curran Associates Inc., 8536\u20138546."},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00524"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_1_42_2","unstructured":"J. Huang. 2020. O2U-net Code. Retrieved from https:\/\/github.com\/hjimce\/O2U-Net."},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00342"},{"key":"e_1_3_1_44_2","first-page":"448","volume-title":"Proceedings of the 32nd International Conference on International Conference on Machine Learning (ICML\u201915)","author":"Ioffe Sergey","year":"2015","unstructured":"Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proceedings of the 32nd International Conference on International Conference on Machine Learning (ICML\u201915). JMLR.org, 448\u2013456."},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2946884"},{"key":"e_1_3_1_46_2","unstructured":"Lu Jiang. 2020. MentorNet Code. Retrieved from https:\/\/github.com\/google\/mentornet."},{"key":"e_1_3_1_47_2","volume-title":"Proceedings of the International Conference on Machine Learning (ICML)","author":"Jiang Lu","year":"2018","unstructured":"Lu Jiang, Zhengyuan Zhou, Thomas Leung, Li-Jia Li, and Li Fei-Fei. 2018. MentorNet: Learning data-driven curriculum for very deep neural networks on corrupted labels. In Proceedings of the International Conference on Machine Learning (ICML)."},{"key":"e_1_3_1_48_2","volume-title":"Proceedings of the CVPR Workshops","author":"Jindal Ishan","year":"2019","unstructured":"Ishan Jindal, Matthew S. Nokleby, and Daniel Pressel. 2019. A nonlinear, noise-aware, quasi-clustering approach to learning deep CNNs from noisy labels. In Proceedings of the CVPR Workshops."},{"key":"e_1_3_1_49_2","article-title":"Estimating continuous distributions in Bayesian classifiers","author":"John George","year":"2013","unstructured":"George John and Pat Langley. 2013. Estimating continuous distributions in Bayesian classifiers. In Proceedings of the 11th Conference on Uncertainty in Artificial Intelligence.","journal-title":"Proceedings of the 11th Conference on Uncertainty in Artificial Intelligence"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBDATA.2019.2921572"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2019.00134"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10796-020-10022-7"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA52953.2021.00192"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAI52525.2021.00227"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-019-0179-2"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11390-007-9054-2"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1016\/0031-3203(81)90102-3"},{"key":"e_1_3_1_58_2","unstructured":"Alex Krizhevsky. 2009. Learning multiple layers of features from tiny images. https:\/\/www.cs.toronto.edu\/kriz\/learning-features-2009-TR.pdf."},{"key":"e_1_3_1_59_2","first-page":"179","volume-title":"Proceedings of the 14th International Conference on Machine Learning","author":"Kubat Miroslav","year":"1997","unstructured":"Miroslav Kubat and Stan Matwin. 1997. Addressing the curse of imbalanced training sets: One-sided selection. In Proceedings of the 14th International Conference on Machine Learning. Morgan Kaufmann, 179\u2013186."},{"key":"e_1_3_1_60_2","first-page":"1189","volume-title":"Advances in Neural Information Processing Systems 23","author":"Kumar M. P.","year":"2010","unstructured":"M. P. Kumar, Benjamin Packer, and Daphne Koller. 2010. Self-paced learning for latent variable models. In Advances in Neural Information Processing Systems 23, J. D. Lafferty, C. K. I. Williams, J. Shawe-Taylor, R. S. Zemel, and A. Culotta (Eds.). Curran Associates, Inc., 1189\u20131197. Retrieved from http:\/\/papers.nips.cc\/paper\/3923-self-paced-learning-for-latent-variable-models.pdf."},{"key":"e_1_3_1_61_2","first-page":"306","article-title":"Estimating a kernel Fisher discriminant in the presence of label noise.","author":"Lawrence Neil","year":"2001","unstructured":"Neil Lawrence and Bernhard Sch\u00f6lkopf. 2001. Estimating a kernel Fisher discriminant in the presence of label noise. Proceedings of the 18th International Conference on Machine Learning. 306\u2013313.","journal-title":"Proceedings of the 18th International Conference on Machine Learning"},{"key":"e_1_3_1_62_2","article-title":"MNIST handwritten digit database","author":"LeCun Yann","year":"2010","unstructured":"Yann LeCun, Corinna Cortes, and C. J. Burges. 2010. MNIST handwritten digit database. ATT Labs. Retrieved from http:\/\/yann.lecun.com\/exdb\/mnist.","journal-title":"ATT Labs."},{"key":"e_1_3_1_63_2","article-title":"Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks","author":"Lee Dong-Hyun","year":"2013","unstructured":"Dong-Hyun Lee. 2013. Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks. In Proceedings of the ICML Workshop: Challenges in Representation Learning (WREPL).","journal-title":"Proceedings of the ICML Workshop: Challenges in Representation Learning (WREPL)"},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00571"},{"key":"e_1_3_1_65_2","unstructured":"Kuang-Huei Lee. 2020. CleanNet Code. Retrieved from https:\/\/github.com\/kuanghuei\/clean-net."},{"key":"e_1_3_1_66_2","unstructured":"Junnan Li. 2020. DivideMix Code. Retrieved from https:\/\/github.com\/LiJunnan1992\/DivideMix."},{"key":"e_1_3_1_67_2","unstructured":"Junnan Li Richard Socher and Steven C. H. Hoi. 2020. DivideMix: Learning with Noisy Labels as Semi-supervised Learning. arxiv:cs.CV\/2002.07394."},{"key":"e_1_3_1_68_2","article-title":"WebVision database: Visual learning and understanding from web data","volume":"1708","author":"Li Wen","year":"2017","unstructured":"Wen Li, Limin Wang, Wei Li, Eirikur Agustsson, and Luc Van Gool. 2017. WebVision database: Visual learning and understanding from web data. CoRR abs\/1708.02862 (2017).","journal-title":"CoRR"},{"key":"e_1_3_1_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2007.05.006"},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.324"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.5555\/2002472.2002491"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICACCCT.2016.7831734"},{"key":"e_1_3_1_73_2","unstructured":"Jes\u00fas Maillo. 2020. kNN_IS Code. Retrieved from https:\/\/github.com\/JMailloH\/kNN_IS."},{"key":"e_1_3_1_74_2","first-page":"1","article-title":"Exact fuzzy k-nearest neighbor classification for big datasets","author":"Maillo Jes\u00fas","year":"2017","unstructured":"Jes\u00fas Maillo, J. Luengo, S. Garc\u00eda, F. Herrera, and I. Triguero. 2017. Exact fuzzy k-nearest neighbor classification for big datasets. In Proceedings of the IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). 1\u20136.","journal-title":"Proceedings of the IEEE International Conference on Fuzzy Systems (FUZZ-IEEE)"},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.06.012"},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/Trustcom.2015.577"},{"key":"e_1_3_1_77_2","first-page":"1049","article-title":"On the design of loss functions for classification: Theory, robustness to outliers, and SavageBoost.","author":"Masnadi-Shirazi Hamed","year":"2008","unstructured":"Hamed Masnadi-Shirazi and Nuno Vasconcelos. 2008. On the design of loss functions for classification: Theory, robustness to outliers, and SavageBoost. In Proceedings of the 22nd Annual Conference on Neural Information Processing Systems, 1049\u20131056.","journal-title":"Proceedings of the 22nd Annual Conference on Neural Information Processing Systems"},{"key":"e_1_3_1_78_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2019.04.003"},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1025832930864"},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-010-9156-z"},{"key":"e_1_3_1_81_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-014-0808-1"},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2017.06.001"},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/1111449.1111477"},{"key":"e_1_3_1_84_2","unstructured":"Giorgio Patrini. 2020. Loss Correction Code. Retrieved from https:\/\/github.com\/giorgiop\/loss-correction."},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.240"},{"key":"e_1_3_1_86_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-018-1244-4"},{"key":"e_1_3_1_87_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13634-016-0355-x"},{"key":"e_1_3_1_88_2","unstructured":"Scott Reed Honglak Lee Dragomir Anguelov Christian Szegedy Dumitru Erhan and Andrew Rabinovich. 2015. Training Deep Neural Networks on Noisy Labels with Bootstrapping. arxiv:cs.CV\/1412.6596."},{"key":"e_1_3_1_89_2","article-title":"Training deep neural networks on noisy labels with bootstrapping","volume":"1412","author":"Reed S.","year":"2015","unstructured":"S. Reed, H. Lee, Dragomir Anguelov, Christian Szegedy, D. Erhan, and Andrew Rabinovich. 2015. Training deep neural networks on noisy labels with bootstrapping. CoRR abs\/1412.6596 (2015).","journal-title":"CoRR"},{"key":"e_1_3_1_90_2","unstructured":"Facebook AI Research. 2020. Faiss Code. Retrieved from https:\/\/github.com\/JMailloH\/kNN_IS."},{"key":"e_1_3_1_91_2","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-7b98e3ed-013"},{"key":"e_1_3_1_92_2","article-title":"Deep learning is robust to massive label noise","volume":"1705","author":"Rolnick D.","year":"2017","unstructured":"D. Rolnick, Andreas Veit, S. Belongie, and N. Shavit. 2017. Deep learning is robust to massive label noise. arXiv: abs\/1705.10694 (2017).","journal-title":"arXiv:"},{"key":"e_1_3_1_93_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00314"},{"issue":"1","key":"e_1_3_1_94_2","first-page":"4","article-title":"Veracity roadmap: Is big data objective, truthful and credible?","volume":"24","author":"Rubin Victoria","year":"2013","unstructured":"Victoria Rubin and Tatiana Lukoianova. 2013. Veracity roadmap: Is big data objective, truthful and credible? Adv. Classif. Res. Onl. 24, 1 (2013), 4.","journal-title":"Adv. Classif. Res. Onl."},{"key":"e_1_3_1_95_2","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1007\/978-3-030-48256-5_52","volume-title":"Theory and Applications of Dependable Computer Systems","author":"Rusiecki Andrzej","year":"2020","unstructured":"Andrzej Rusiecki. 2020. Standard dropout as remedy for training deep neural networks with label noise. In Theory and Applications of Dependable Computer Systems, Wojciech Zamojski, Jacek Mazurkiewicz, Jaros\u0142aw Sugier, Tomasz Walkowiak, and Janusz Kacprzyk (Eds.). Springer International Publishing, Cham, 534\u2013542."},{"key":"e_1_3_1_96_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00993309"},{"key":"e_1_3_1_97_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2010.12.016"},{"issue":"2","key":"e_1_3_1_98_2","article-title":"Ensemble learning","volume":"11","author":"Sewell Martin","year":"2008","unstructured":"Martin Sewell. 2008. Ensemble learning. RN 11, 2 (2008), 1\u201334. https:\/\/scholar.google.com\/citations?view_op=view_citation&hl=en&user=jhbInA4AAAAJ&citation_for_view=jhbInA4AAAAJ:aqlVkmm33-oC.","journal-title":"RN"},{"key":"e_1_3_1_99_2","doi-asserted-by":"crossref","unstructured":"Karishma Sharma Pinar Donmez Enming Luo Yan Liu and I. Zeki Yalniz. 2020. NoiseRank: Unsupervised Label Noise Reduction with Dependence Models. arxiv:cs.CV\/2003.06729.","DOI":"10.1007\/978-3-030-58583-9_44"},{"key":"e_1_3_1_100_2","doi-asserted-by":"crossref","unstructured":"Fatimah Sidi Payam Hassany Shariat Panahy Lilly Affendey Marzanah A. Jabar Hamidah Ibrahim and Aida Mustapha. 2012. Data quality: A survey of data quality dimensions. In 2012 International Conference on Information Retrieval Knowledge Management . 300\u2013304. DOI:10.1109\/InfRKM.2012.6204995","DOI":"10.1109\/InfRKM.2012.6204995"},{"key":"e_1_3_1_101_2","unstructured":"Hwanjun Song Minseok Kim Dongmin Park and Jae-Gil Lee. 2020. Learning from Noisy Labels with Deep Neural Networks: A Survey. https:\/\/arxiv.org\/abs\/1406.2080."},{"key":"e_1_3_1_102_2","article-title":"Training convolutional networks with noisy labels","author":"Sukhbaatar Sainbayar","year":"2014","unstructured":"Sainbayar Sukhbaatar, Joan Bruna, Manohar Paluri, Lubomir D. Bourdev, and R. Fergus. 2014. Training convolutional networks with noisy labels. Comput. Vis. Pattern Recog. (2014).","journal-title":"Comput. Vis. Pattern Recog."},{"key":"e_1_3_1_103_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"e_1_3_1_104_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.308"},{"key":"e_1_3_1_105_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2015.04.002"},{"key":"e_1_3_1_106_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISDA.2011.6121827"},{"key":"e_1_3_1_107_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8655(02)00225-8"},{"key":"e_1_3_1_108_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8655(97)00035-4"},{"key":"e_1_3_1_109_2","doi-asserted-by":"publisher","DOI":"10.1145\/2812802"},{"issue":"6","key":"e_1_3_1_110_2","first-page":"448","article-title":"An experiment with the edited nearest-neighbor rule","volume":"6","author":"Tomek Ivan","year":"1976","unstructured":"Ivan Tomek. 1976. An experiment with the edited nearest-neighbor rule. IEEE Trans. Syst., Man Cyber. 6, 6 (1976), 448\u2013452.","journal-title":"IEEE Trans. Syst., Man Cyber."},{"key":"e_1_3_1_111_2","article-title":"Two modifications of CNN","author":"Tomek I.","year":"1976","unstructured":"I. Tomek. 1976. Two modifications of CNN. IEEE Trans. Syst. Man Commun. SMC-6 (1976), 769\u2013772.","journal-title":"IEEE Trans. Syst. Man Commun. SMC-6 (1976)"},{"key":"e_1_3_1_112_2","first-page":"2691","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915)","author":"Xiao Tong","year":"2015","unstructured":"Tong Xiao, Tian Xia, Yi Yang, Chang Huang, and Xiaogang Wang. 2015. Learning from massive noisy labeled data for image classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915). 2691\u20132699."},{"key":"e_1_3_1_113_2","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1289"},{"key":"e_1_3_1_114_2","doi-asserted-by":"publisher","DOI":"10.1109\/iThings-GreenCom-CPSCom-SmartData.2016.177"},{"key":"e_1_3_1_115_2","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295311"},{"key":"e_1_3_1_116_2","doi-asserted-by":"publisher","DOI":"10.5555\/645961.674073"},{"key":"e_1_3_1_117_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2009.08.005"},{"key":"e_1_3_1_118_2","doi-asserted-by":"publisher","DOI":"10.5555\/1764295.1764334"},{"key":"e_1_3_1_119_2","article-title":"Modest AdaBoost\u2014Teaching AdaBoost to generalize better","volume":"12","author":"Vezhnevets Alexander","year":"2005","unstructured":"Alexander Vezhnevets and Vladimir Vezhnevets. 2005. Modest AdaBoost\u2014Teaching AdaBoost to generalize better. Graphicon 12 (1 2005).","journal-title":"Graphicon"},{"key":"e_1_3_1_120_2","doi-asserted-by":"publisher","DOI":"10.5555\/3157382.3157504"},{"key":"e_1_3_1_121_2","doi-asserted-by":"publisher","DOI":"10.1007\/11492542_5"},{"key":"e_1_3_1_122_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00906"},{"key":"e_1_3_1_123_2","first-page":"574","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201998)","author":"Weiss Gary M.","year":"1998","unstructured":"Gary M. Weiss and Haym Hirsh. 1998. The problem with noise and small disjuncts. In Proceedings of the International Conference on Machine Learning (ICML\u201998). 574\u2013578."},{"key":"e_1_3_1_124_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1972.4309137"},{"key":"e_1_3_1_125_2","volume-title":"Data Mining: Practical Machine Learning Tools and Techniques (3rd ed.)","author":"Witten Ian H.","year":"2011","unstructured":"Ian H. Witten, Eibe Frank, and Mark A. Hall. 2011. Data Mining: Practical Machine Learning Tools and Techniques (3rd ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA."},{"key":"e_1_3_1_126_2","unstructured":"Tong Xiao. 2020. CVPR15 Learning from Massive Noisy Labeled Data for Image Classification Code. Retrieved from https:\/\/github.com\/Cysu\/noisy_label."},{"key":"e_1_3_1_127_2","doi-asserted-by":"publisher","DOI":"10.3233\/978-1-61499-405-3-200"},{"key":"e_1_3_1_128_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32281-5_34"},{"key":"e_1_3_1_129_2","first-page":"10","volume-title":"Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing (HotCloud\u201910)","author":"Zaharia Matei","year":"2010","unstructured":"Matei Zaharia, Mosharaf Chowdhury, Michael J. Franklin, Scott Shenker, and Ion Stoica. 2010. Spark: Cluster computing with working sets. In Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing (HotCloud\u201910). USENIX Association, 10\u201310. Retrieved from http:\/\/dl.acm.org\/citation.cfm?id=1863103.1863113."},{"key":"e_1_3_1_130_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIST.2016.7805041"},{"key":"e_1_3_1_131_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2010.11.004"},{"key":"e_1_3_1_132_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00133"},{"key":"e_1_3_1_133_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-004-0751-8"},{"key":"e_1_3_1_134_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-005-0012-8"},{"key":"e_1_3_1_135_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2008.45"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3492546","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3492546","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T15:30:51Z","timestamp":1750174251000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3492546"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,23]]},"references-count":134,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,31]]}},"alternative-id":["10.1145\/3492546"],"URL":"https:\/\/doi.org\/10.1145\/3492546","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"value":"1936-1955","type":"print"},{"value":"1936-1963","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,23]]},"assertion":[{"value":"2020-12-11","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-16","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}