{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T05:32:50Z","timestamp":1784007170673,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":78,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T00:00:00Z","timestamp":1691107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-2007951, IIS-2143895"],"award-info":[{"award-number":["IIS-2007951, IIS-2143895"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,8,6]]},"DOI":"10.1145\/3580305.3599522","type":"proceedings-article","created":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T18:10:58Z","timestamp":1691172658000},"page":"2523-2535","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["To Aggregate or Not? Learning with Separate Noisy Labels"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3573-1711","authenticated-orcid":false,"given":"Jiaheng","family":"Wei","sequence":"first","affiliation":[{"name":"University of California, Santa Cruz, Santa Cruz, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3894-5862","authenticated-orcid":false,"given":"Zhaowei","family":"Zhu","sequence":"additional","affiliation":[{"name":"University of California, Santa Cruz, Santa Cruz, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9497-7044","authenticated-orcid":false,"given":"Tianyi","family":"Luo","sequence":"additional","affiliation":[{"name":"Amazon Search Science and AI, Palo Alto, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6097-0226","authenticated-orcid":false,"given":"Ehsan","family":"Amid","sequence":"additional","affiliation":[{"name":"Google Research, Brain Team, Mountain View, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1040-3527","authenticated-orcid":false,"given":"Abhishek","family":"Kumar","sequence":"additional","affiliation":[{"name":"University of California, Santa Cruz, Mountain View, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8420-6011","authenticated-orcid":false,"given":"Yang","family":"Liu","sequence":"additional","affiliation":[{"name":"University of California, Santa Cruz, Santa Cruz, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,8,4]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Aggnet: deep learning from crowds for mitosis detection in breast cancer histology images","author":"Albarqouni Shadi","year":"2016","unstructured":"Shadi Albarqouni , Christoph Baur , Felix Achilles , Vasileios Belagiannis , Stefanie Demirci , and Nassir Navab . 2016. Aggnet: deep learning from crowds for mitosis detection in breast cancer histology images . IEEE transactions on medical imaging , Vol. 35 , 5 ( 2016 ), 1313--1321. Shadi Albarqouni, Christoph Baur, Felix Achilles, Vasileios Belagiannis, Stefanie Demirci, and Nassir Navab. 2016. Aggnet: deep learning from crowds for mitosis detection in breast cancer histology images. IEEE transactions on medical imaging , Vol. 35, 5 (2016), 1313--1321."},{"key":"e_1_3_2_2_2_1","volume-title":"Advances in Neural Information Processing Systems","volume":"32","author":"Amid Ehsan","year":"2019","unstructured":"Ehsan Amid , Manfred K Warmuth , Rohan Anil , and Tomer Koren . 2019 . Robust bi-tempered logistic loss based on Bregman divergences . Advances in Neural Information Processing Systems , Vol. 32 (2019). Ehsan Amid, Manfred K Warmuth, Rohan Anil, and Tomer Koren. 2019. Robust bi-tempered logistic loss based on Bregman divergences. Advances in Neural Information Processing Systems , Vol. 32 (2019)."},{"key":"e_1_3_2_2_3_1","volume-title":"Multiplicative Reweighting for Robust Neural Network Optimization. arXiv preprint arXiv:2102.12192","author":"Bar Noga","year":"2021","unstructured":"Noga Bar , Tomer Koren , and Raja Giryes . 2021. Multiplicative Reweighting for Robust Neural Network Optimization. arXiv preprint arXiv:2102.12192 ( 2021 ). Noga Bar, Tomer Koren, and Raja Giryes. 2021. Multiplicative Reweighting for Robust Neural Network Optimization. arXiv preprint arXiv:2102.12192 (2021)."},{"key":"e_1_3_2_2_4_1","volume-title":"Advances in Neural Information Processing Systems","volume":"30","author":"Chang Haw-Shiuan","year":"2017","unstructured":"Haw-Shiuan Chang , Erik Learned-Miller , and Andrew McCallum . 2017 . Active bias: Training more accurate neural networks by emphasizing high variance samples . Advances in Neural Information Processing Systems , Vol. 30 (2017). Haw-Shiuan Chang, Erik Learned-Miller, and Andrew McCallum. 2017. Active bias: Training more accurate neural networks by emphasizing high variance samples. Advances in Neural Information Processing Systems , Vol. 30 (2017)."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"crossref","unstructured":"Zhijun Chen Huimin Wang Hailong Sun Pengpeng Chen Tao Han Xudong Liu and Jie Yang. 2020. Structured Probabilistic End-to-End Learning from Crowds.. In IJCAI. 1512--1518.  Zhijun Chen Huimin Wang Hailong Sun Pengpeng Chen Tao Han Xudong Liu and Jie Yang. 2020. Structured Probabilistic End-to-End Learning from Crowds.. In IJCAI. 1512--1518.","DOI":"10.24963\/ijcai.2020\/210"},{"key":"e_1_3_2_2_6_1","volume-title":"Learning with Instance-Dependent Label Noise: A Sample Sieve Approach. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=2VXyy9mIyU3","author":"Cheng Hao","year":"2021","unstructured":"Hao Cheng , Zhaowei Zhu , Xingyu Li , Yifei Gong , Xing Sun , and Yang Liu . 2021 . Learning with Instance-Dependent Label Noise: A Sample Sieve Approach. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=2VXyy9mIyU3 Hao Cheng, Zhaowei Zhu, Xingyu Li, Yifei Gong, Xing Sun, and Yang Liu. 2021. Learning with Instance-Dependent Label Noise: A Sample Sieve Approach. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=2VXyy9mIyU3"},{"key":"e_1_3_2_2_7_1","volume-title":"International Conference on Learning Representations (ICLR).","author":"Cheng Hao","year":"2023","unstructured":"Hao Cheng , Zhaowei Zhu , Xing Sun , and Yang Liu . 2023 . Mitigating Memorization of Noisy Labels via Regularization between Representations . In International Conference on Learning Representations (ICLR). Hao Cheng, Zhaowei Zhu, Xing Sun, and Yang Liu. 2023. Mitigating Memorization of Noisy Labels via Regularization between Representations. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.2307\/2346806"},{"key":"e_1_3_2_2_9_1","unstructured":"Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml  Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/0165551512437638"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357713.3384290"},{"key":"e_1_3_2_2_12_1","volume-title":"International Conference on Machine Learning. PMLR, 3280--3291","author":"Fu Daniel","year":"2020","unstructured":"Daniel Fu , Mayee Chen , Frederic Sala , Sarah Hooper , Kayvon Fatahalian , and Christopher R\u00e9 . 2020 . Fast and three-rious: Speeding up weak supervision with triplet methods . In International Conference on Machine Learning. PMLR, 3280--3291 . Daniel Fu, Mayee Chen, Frederic Sala, Sarah Hooper, Kayvon Fatahalian, and Christopher R\u00e9. 2020. Fast and three-rious: Speeding up weak supervision with triplet methods. In International Conference on Machine Learning. PMLR, 3280--3291."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11756"},{"key":"e_1_3_2_2_14_1","volume-title":"A survey of label-noise representation learning: Past, present and future. arXiv preprint arXiv:2011.04406","author":"Han Bo","year":"2020","unstructured":"Bo Han , Quanming Yao , Tongliang Liu , Gang Niu , Ivor W Tsang , James T Kwok , and Masashi Sugiyama . 2020. A survey of label-noise representation learning: Past, present and future. arXiv preprint arXiv:2011.04406 ( 2020 ). Bo Han, Quanming Yao, Tongliang Liu, Gang Niu, Ivor W Tsang, James T Kwok, and Masashi Sugiyama. 2020. A survey of label-noise representation learning: Past, present and future. arXiv preprint arXiv:2011.04406 (2020)."},{"key":"e_1_3_2_2_15_1","volume-title":"Co-teaching: Robust training of deep neural networks with extremely noisy labels. In Advances in neural information processing systems. 8527--8537.","author":"Han Bo","year":"2018","unstructured":"Bo Han , Quanming Yao , Xingrui Yu , Gang Niu , Miao Xu , Weihua Hu , Ivor Tsang , and Masashi Sugiyama . 2018 . Co-teaching: Robust training of deep neural networks with extremely noisy labels. In Advances in neural information processing systems. 8527--8537. Bo Han, Quanming Yao, Xingrui Yu, Gang Niu, Miao Xu, Weihua Hu, Ivor Tsang, and Masashi Sugiyama. 2018. Co-teaching: Robust training of deep neural networks with extremely noisy labels. In Advances in neural information processing systems. 8527--8537."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_2_17_1","unstructured":"Jeff Howe et al. 2006. The rise of crowdsourcing. Wired magazine Vol. 14 6 (2006) 1--4.  Jeff Howe et al. 2006. The rise of crowdsourcing. Wired magazine Vol. 14 6 (2006) 1--4."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-013-0306-1"},{"key":"e_1_3_2_2_19_1","unstructured":"Alex Krizhevsky Geoffrey Hinton etal 2009. Learning multiple layers of features from tiny images. Technical Report. Citeseer.  Alex Krizhevsky Geoffrey Hinton et al. 2009. Learning multiple layers of features from tiny images. Technical Report. Citeseer."},{"key":"e_1_3_2_2_20_1","volume-title":"Constrained Instance and Class Reweighting for Robust Learning under Label Noise. arXiv preprint arXiv:2111.05428","author":"Kumar Abhishek","year":"2021","unstructured":"Abhishek Kumar and Ehsan Amid . 2021. Constrained Instance and Class Reweighting for Robust Learning under Label Noise. arXiv preprint arXiv:2111.05428 ( 2021 ). Abhishek Kumar and Ehsan Amid. 2021. Constrained Instance and Class Reweighting for Robust Learning under Label Noise. arXiv preprint arXiv:2111.05428 (2021)."},{"key":"e_1_3_2_2_21_1","volume-title":"Sharper lower bounds on the performance of the empirical risk minimization algorithm. Bernoulli","author":"Lecu\u00e9 Guillaume","year":"2010","unstructured":"Guillaume Lecu\u00e9 and Shahar Mendelson . 2010. Sharper lower bounds on the performance of the empirical risk minimization algorithm. Bernoulli ( 2010 ), 605--613. Guillaume Lecu\u00e9 and Shahar Mendelson. 2010. Sharper lower bounds on the performance of the empirical risk minimization algorithm. Bernoulli (2010), 605--613."},{"key":"e_1_3_2_2_22_1","unstructured":"Shikun Li Xiaobo Xia Hansong Zhang Yibing Zhan Shiming Ge and Tongliang Liu. 2022. Estimating noise transition matrix with label correlations for noisy multi-label learning. In Advances in Neural Information Processing Systems.  Shikun Li Xiaobo Xia Hansong Zhang Yibing Zhan Shiming Ge and Tongliang Liu. 2022. Estimating noise transition matrix with label correlations for noisy multi-label learning. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_2_23_1","volume-title":"Adaptive Early-Learning Correction for Segmentation from Noisy Annotations. arXiv preprint arXiv:2110.03740","author":"Liu Sheng","year":"2021","unstructured":"Sheng Liu , Kangning Liu , Weicheng Zhu , Yiqiu Shen , and Carlos Fernandez-Granda . 2021. Adaptive Early-Learning Correction for Segmentation from Noisy Annotations. arXiv preprint arXiv:2110.03740 ( 2021 ). Sheng Liu, Kangning Liu, Weicheng Zhu, Yiqiu Shen, and Carlos Fernandez-Granda. 2021. Adaptive Early-Learning Correction for Segmentation from Noisy Annotations. arXiv preprint arXiv:2110.03740 (2021)."},{"key":"e_1_3_2_2_24_1","volume-title":"Early-learning regularization prevents memorization of noisy labels. Advances in neural information processing systems","author":"Liu Sheng","year":"2020","unstructured":"Sheng Liu , Jonathan Niles-Weed , Narges Razavian , and Carlos Fernandez-Granda . 2020. Early-learning regularization prevents memorization of noisy labels. Advances in neural information processing systems , Vol. 33 ( 2020 ), 20331--20342. Sheng Liu, Jonathan Niles-Weed, Narges Razavian, and Carlos Fernandez-Granda. 2020. Early-learning regularization prevents memorization of noisy labels. Advances in neural information processing systems , Vol. 33 (2020), 20331--20342."},{"key":"e_1_3_2_2_25_1","volume-title":"Robust Training under Label Noise by Over-parameterization. arXiv preprint arXiv:2202.14026","author":"Liu Sheng","year":"2022","unstructured":"Sheng Liu , Zhihui Zhu , Qing Qu , and Chong You . 2022. Robust Training under Label Noise by Over-parameterization. arXiv preprint arXiv:2202.14026 ( 2022 ). Sheng Liu, Zhihui Zhu, Qing Qu, and Chong You. 2022. Robust Training under Label Noise by Over-parameterization. arXiv preprint arXiv:2202.14026 (2022)."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2456899"},{"key":"e_1_3_2_2_27_1","volume-title":"International Conference on Machine Learning. PMLR, 6725--6735","author":"Liu Yang","year":"2021","unstructured":"Yang Liu . 2021 . Understanding instance-level label noise: Disparate impacts and treatments . In International Conference on Machine Learning. PMLR, 6725--6735 . Yang Liu. 2021. Understanding instance-level label noise: Disparate impacts and treatments. In International Conference on Machine Learning. PMLR, 6725--6735."},{"key":"e_1_3_2_2_28_1","volume-title":"International Conference on Machine Learning. PMLR, 6226--6236","author":"Liu Yang","year":"2020","unstructured":"Yang Liu and Hongyi Guo . 2020 . Peer loss functions: Learning from noisy labels without knowing noise rates . In International Conference on Machine Learning. PMLR, 6226--6236 . Yang Liu and Hongyi Guo. 2020. Peer loss functions: Learning from noisy labels without knowing noise rates. In International Conference on Machine Learning. PMLR, 6226--6236."},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2796314.2745874"},{"key":"e_1_3_2_2_30_1","volume-title":"International Conference on Machine Learning. PMLR, 6448--6458","author":"Lukasik Michal","year":"2020","unstructured":"Michal Lukasik , Srinadh Bhojanapalli , Aditya Menon , and Sanjiv Kumar . 2020 . Does label smoothing mitigate label noise? . In International Conference on Machine Learning. PMLR, 6448--6458 . Michal Lukasik, Srinadh Bhojanapalli, Aditya Menon, and Sanjiv Kumar. 2020. Does label smoothing mitigate label noise?. In International Conference on Machine Learning. PMLR, 6448--6458."},{"key":"e_1_3_2_2_31_1","volume-title":"Research Replication Prediction Using Weakly Supervised Learning. In In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings.","author":"Luo Tianyi","year":"2020","unstructured":"Tianyi Luo , Xingyu Li , Hainan Wang , and Yang Liu . 2020 . Research Replication Prediction Using Weakly Supervised Learning. In In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings. Tianyi Luo, Xingyu Li, Hainan Wang, and Yang Liu. 2020. Research Replication Prediction Using Weakly Supervised Learning. In In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings."},{"key":"e_1_3_2_2_32_1","volume-title":"Machine truth serum. arXiv preprint arXiv:1909.13004","author":"Luo Tianyi","year":"2019","unstructured":"Tianyi Luo and Yang Liu . 2019. Machine truth serum. arXiv preprint arXiv:1909.13004 ( 2019 ). Tianyi Luo and Yang Liu. 2019. Machine truth serum. arXiv preprint arXiv:1909.13004 (2019)."},{"key":"e_1_3_2_2_33_1","volume-title":"International Conference on Machine Learning. PMLR, 6543--6553","author":"Ma Xingjun","year":"2020","unstructured":"Xingjun Ma , Hanxun Huang , Yisen Wang , Simone Romano , Sarah Erfani , and James Bailey . 2020 . Normalized loss functions for deep learning with noisy labels . In International Conference on Machine Learning. PMLR, 6543--6553 . Xingjun Ma, Hanxun Huang, Yisen Wang, Simone Romano, Sarah Erfani, and James Bailey. 2020. Normalized loss functions for deep learning with noisy labels. In International Conference on Machine Learning. PMLR, 6543--6553."},{"key":"e_1_3_2_2_34_1","volume-title":"Warmuth","author":"Majidi Negin","year":"2021","unstructured":"Negin Majidi , Ehsan Amid , Hossein Talebi , and Manfred K . Warmuth . 2021 . Exponentiated Gradient Reweighting for Robust Training Under Label Noise and Beyond . arXiv preprint arXiv:2104.01493 (2021). Negin Majidi, Ehsan Amid, Hossein Talebi, and Manfred K. Warmuth. 2021. Exponentiated Gradient Reweighting for Robust Training Under Label Noise and Beyond. arXiv preprint arXiv:2104.01493 (2021)."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2008.926323"},{"key":"e_1_3_2_2_36_1","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media","volume":"9","author":"Mitra Tanushree","year":"2015","unstructured":"Tanushree Mitra and Eric Gilbert . 2015 . Credbank: A large-scale social media corpus with associated credibility annotations . In Proceedings of the International AAAI Conference on Web and Social Media , Vol. 9 . 258--267. Tanushree Mitra and Eric Gilbert. 2015. Credbank: A large-scale social media corpus with associated credibility annotations. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 9. 258--267."},{"key":"e_1_3_2_2_37_1","unstructured":"Nagarajan Natarajan Inderjit S Dhillon Pradeep K Ravikumar and Ambuj Tewari. 2013. Learning with noisy labels. In Advances in neural information processing systems. 1196--1204.  Nagarajan Natarajan Inderjit S Dhillon Pradeep K Ravikumar and Ambuj Tewari. 2013. Learning with noisy labels. In Advances in neural information processing systems. 1196--1204."},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.240"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1806781116"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00971"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-41154-0_1"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33014763"},{"key":"e_1_3_2_2_43_1","volume-title":"Sen Wu, Daniel Selsam, and Christopher R\u00e9.","author":"Ratner Alexander J","year":"2016","unstructured":"Alexander J Ratner , Christopher M De Sa , Sen Wu, Daniel Selsam, and Christopher R\u00e9. 2016 . Data programming: Creating large training sets, quickly. Advances in neural information processing systems , Vol. 29 (2016). Alexander J Ratner, Christopher M De Sa, Sen Wu, Daniel Selsam, and Christopher R\u00e9. 2016. Data programming: Creating large training sets, quickly. Advances in neural information processing systems , Vol. 29 (2016)."},{"key":"e_1_3_2_2_44_1","article-title":"Learning from crowds","volume":"11","author":"Raykar Vikas C","year":"2010","unstructured":"Vikas C Raykar , Shipeng Yu , Linda H Zhao , Gerardo Hermosillo Valadez , Charles Florin , Luca Bogoni , and Linda Moy . 2010 . Learning from crowds . Journal of machine learning research , Vol. 11 , 4 (2010). Vikas C Raykar, Shipeng Yu, Linda H Zhao, Gerardo Hermosillo Valadez, Charles Florin, Luca Bogoni, and Linda Moy. 2010. Learning from crowds. Journal of machine learning research , Vol. 11, 4 (2010).","journal-title":"Journal of machine learning research"},{"key":"e_1_3_2_2_45_1","volume-title":"Training deep neural networks on noisy labels with bootstrapping. arXiv preprint arXiv:1412.6596","author":"Reed Scott","year":"2014","unstructured":"Scott Reed , Honglak Lee , Dragomir Anguelov , Christian Szegedy , Dumitru Erhan , and Andrew Rabinovich . 2014. Training deep neural networks on noisy labels with bootstrapping. arXiv preprint arXiv:1412.6596 ( 2014 ). Scott Reed, Honglak Lee, Dragomir Anguelov, Christian Szegedy, Dumitru Erhan, and Andrew Rabinovich. 2014. Training deep neural networks on noisy labels with bootstrapping. arXiv preprint arXiv:1412.6596 (2014)."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2648786"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11506"},{"key":"e_1_3_2_2_48_1","volume-title":"International conference on machine learning. PMLR, 433--441","author":"Rodrigues Filipe","year":"2014","unstructured":"Filipe Rodrigues , Francisco Pereira , and Bernardete Ribeiro . 2014 . Gaussian process classification and active learning with multiple annotators . In International conference on machine learning. PMLR, 433--441 . Filipe Rodrigues, Francisco Pereira, and Bernardete Ribeiro. 2014. Gaussian process classification and active learning with multiple annotators. In International conference on machine learning. PMLR, 433--441."},{"key":"e_1_3_2_2_49_1","volume-title":"Moira SN Berens, Cas Van Den Bogaard, Piergiorgio Cerello, Hao Chen, Qi Dou, Maria Evelina Fantacci, Bram Geurts, et al.","author":"Adiyoso Setio Arnaud Arindra","year":"2017","unstructured":"Arnaud Arindra Adiyoso Setio , Alberto Traverso , Thomas De Bel , Moira SN Berens, Cas Van Den Bogaard, Piergiorgio Cerello, Hao Chen, Qi Dou, Maria Evelina Fantacci, Bram Geurts, et al. 2017 . Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge. Medical image analysis , Vol. 42 (2017), 1--13. Arnaud Arindra Adiyoso Setio, Alberto Traverso, Thomas De Bel, Moira SN Berens, Cas Van Den Bogaard, Piergiorgio Cerello, Hao Chen, Qi Dou, Maria Evelina Fantacci, Bram Geurts, et al. 2017. Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge. Medical image analysis , Vol. 42 (2017), 1--13."},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2017.2659740"},{"key":"e_1_3_2_2_51_1","volume-title":"Inferring ground truth from subjective labelling of venus images. Advances in neural information processing systems","author":"Smyth Padhraic","year":"1994","unstructured":"Padhraic Smyth , Usama Fayyad , Michael Burl , Pietro Perona , and Pierre Baldi . 1994. Inferring ground truth from subjective labelling of venus images. Advances in neural information processing systems , Vol. 7 ( 1994 ). Padhraic Smyth, Usama Fayyad, Michael Burl, Pietro Perona, and Pierre Baldi. 1994. Inferring ground truth from subjective labelling of venus images. Advances in neural information processing systems , Vol. 7 (1994)."},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3152527"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313554"},{"key":"e_1_3_2_2_54_1","volume-title":"Advances in Neural Information Processing Systems","volume":"34","author":"Wang Jingkang","year":"2021","unstructured":"Jingkang Wang , Hongyi Guo , Zhaowei Zhu , and Yang Liu . 2021 . Policy Learning Using Weak Supervision . Advances in Neural Information Processing Systems , Vol. 34 (2021). Jingkang Wang, Hongyi Guo, Zhaowei Zhu, and Yang Liu. 2021. Policy Learning Using Weak Supervision. Advances in Neural Information Processing Systems , Vol. 34 (2021)."},{"key":"e_1_3_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00041"},{"key":"e_1_3_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01374"},{"key":"e_1_3_2_2_57_1","volume-title":"Advances in Neural Information Processing Systems","volume":"34","author":"Wei Hongxin","year":"2021","unstructured":"Hongxin Wei , Lue Tao , Renchunzi Xie , and Bo An . 2021 . Open-set label noise can improve robustness against inherent label noise . Advances in Neural Information Processing Systems , Vol. 34 (2021). Hongxin Wei, Lue Tao, Renchunzi Xie, and Bo An. 2021. Open-set label noise can improve robustness against inherent label noise. Advances in Neural Information Processing Systems , Vol. 34 (2021)."},{"key":"e_1_3_2_2_58_1","volume-title":"International Conference on Machine Learning (ICML). PMLR.","author":"Wei Hongxin","year":"2023","unstructured":"Hongxin Wei , Lue Tao , Renchunzi Xie , Lei Feng , and Bo An . 2023 a. Mitigating memorization of noisy labels by clipping the model prediction . In International Conference on Machine Learning (ICML). PMLR. Hongxin Wei, Lue Tao, Renchunzi Xie, Lei Feng, and Bo An. 2023 a. Mitigating memorization of noisy labels by clipping the model prediction. In International Conference on Machine Learning (ICML). PMLR."},{"key":"e_1_3_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3168696"},{"key":"e_1_3_2_2_60_1","volume-title":"When Label Smoothing Meets Noisy Labels. In International Conference on Machine Learning. PMLR, 23589--23614","author":"Wei Jiaheng","year":"2022","unstructured":"Jiaheng Wei , Hangyu Liu , Tongliang Liu , Gang Niu , Masashi Sugiyama , and Yang Liu . 2022 a. To Smooth or Not? When Label Smoothing Meets Noisy Labels. In International Conference on Machine Learning. PMLR, 23589--23614 . Jiaheng Wei, Hangyu Liu, Tongliang Liu, Gang Niu, Masashi Sugiyama, and Yang Liu. 2022a. To Smooth or Not? When Label Smoothing Meets Noisy Labels. In International Conference on Machine Learning. PMLR, 23589--23614."},{"key":"e_1_3_2_2_61_1","volume-title":"When optimizing $ f $-divergence is robust with label noise. arXiv preprint arXiv:2011.03687","author":"Wei Jiaheng","year":"2020","unstructured":"Jiaheng Wei and Yang Liu . 2020. When optimizing $ f $-divergence is robust with label noise. arXiv preprint arXiv:2011.03687 ( 2020 ). Jiaheng Wei and Yang Liu. 2020. When optimizing $ f $-divergence is robust with label noise. arXiv preprint arXiv:2011.03687 (2020)."},{"key":"e_1_3_2_2_62_1","volume-title":"Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotations. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=TBWA6PLJZQm","author":"Wei Jiaheng","year":"2022","unstructured":"Jiaheng Wei , Zhaowei Zhu , Hao Cheng , Tongliang Liu , Gang Niu , and Yang Liu . 2022 c. Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotations. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=TBWA6PLJZQm Jiaheng Wei, Zhaowei Zhu, Hao Cheng, Tongliang Liu, Gang Niu, and Yang Liu. 2022c. Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotations. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=TBWA6PLJZQm"},{"key":"e_1_3_2_2_63_1","volume-title":"2023 b. Fairness Improves Learning from Noisily Labeled Long-Tailed Data. arXiv preprint arXiv:2303.12291","author":"Wei Jiaheng","year":"2023","unstructured":"Jiaheng Wei , Zhaowei Zhu , Gang Niu , Tongliang Liu , Sijia Liu , Masashi Sugiyama , and Yang Liu . 2023 b. Fairness Improves Learning from Noisily Labeled Long-Tailed Data. arXiv preprint arXiv:2303.12291 ( 2023 ). Jiaheng Wei, Zhaowei Zhu, Gang Niu, Tongliang Liu, Sijia Liu, Masashi Sugiyama, and Yang Liu. 2023 b. Fairness Improves Learning from Noisily Labeled Long-Tailed Data. arXiv preprint arXiv:2303.12291 (2023)."},{"key":"e_1_3_2_2_64_1","volume-title":"Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. Advances in neural information processing systems","author":"Whitehill Jacob","year":"2009","unstructured":"Jacob Whitehill , Ting-fan Wu, Jacob Bergsma , Javier Movellan , and Paul Ruvolo . 2009. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. Advances in neural information processing systems , Vol. 22 ( 2009 ). Jacob Whitehill, Ting-fan Wu, Jacob Bergsma, Javier Movellan, and Paul Ruvolo. 2009. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. Advances in neural information processing systems , Vol. 22 (2009)."},{"key":"e_1_3_2_2_65_1","volume-title":"International conference on learning representations.","author":"Xia Xiaobo","year":"2020","unstructured":"Xiaobo Xia , Tongliang Liu , Bo Han , Chen Gong , Nannan Wang , Zongyuan Ge , and Yi Chang . 2020 a. Robust early-learning: Hindering the memorization of noisy labels . In International conference on learning representations. Xiaobo Xia, Tongliang Liu, Bo Han, Chen Gong, Nannan Wang, Zongyuan Ge, and Yi Chang. 2020a. Robust early-learning: Hindering the memorization of noisy labels. In International conference on learning representations."},{"key":"e_1_3_2_2_66_1","volume-title":"Sample Selection with Uncertainty of Losses for Learning with Noisy Labels. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=xENf4QUL4LW","author":"Xia Xiaobo","year":"2022","unstructured":"Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Jun Yu , Gang Niu , and Masashi Sugiyama . 2022 . Sample Selection with Uncertainty of Losses for Learning with Noisy Labels. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=xENf4QUL4LW Xiaobo Xia, Tongliang Liu, Bo Han, Mingming Gong, Jun Yu, Gang Niu, and Masashi Sugiyama. 2022. Sample Selection with Uncertainty of Losses for Learning with Noisy Labels. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=xENf4QUL4LW"},{"key":"e_1_3_2_2_67_1","first-page":"7597","article-title":"Part-dependent label noise: Towards instance-dependent label noise","volume":"33","author":"Xia Xiaobo","year":"2020","unstructured":"Xiaobo Xia , Tongliang Liu , Bo Han , Nannan Wang , Mingming Gong , Haifeng Liu , Gang Niu , Dacheng Tao , and Masashi Sugiyama . 2020 b. Part-dependent label noise: Towards instance-dependent label noise . Advances in Neural Information Processing Systems , Vol. 33 (2020), 7597 -- 7610 . Xiaobo Xia, Tongliang Liu, Bo Han, Nannan Wang, Mingming Gong, Haifeng Liu, Gang Niu, Dacheng Tao, and Masashi Sugiyama. 2020b. Part-dependent label noise: Towards instance-dependent label noise. Advances in Neural Information Processing Systems , Vol. 33 (2020), 7597--7610.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_68_1","volume-title":"Advances in Neural Information Processing Systems","volume":"32","author":"Xia Xiaobo","year":"2019","unstructured":"Xiaobo Xia , Tongliang Liu , Nannan Wang , Bo Han , Chen Gong , Gang Niu , and Masashi Sugiyama . 2019 . Are anchor points really indispensable in label-noise learning ? Advances in Neural Information Processing Systems , Vol. 32 (2019). Xiaobo Xia, Tongliang Liu, Nannan Wang, Bo Han, Chen Gong, Gang Niu, and Masashi Sugiyama. 2019. Are anchor points really indispensable in label-noise learning? Advances in Neural Information Processing Systems , Vol. 32 (2019)."},{"key":"e_1_3_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i8.20851"},{"key":"e_1_3_2_2_70_1","volume-title":"International Conference on Machine Learning. PMLR, 7164--7173","author":"Yu Xingrui","year":"2019","unstructured":"Xingrui Yu , Bo Han , Jiangchao Yao , Gang Niu , Ivor Tsang , and Masashi Sugiyama . 2019 . How does disagreement help generalization against label corruption? . In International Conference on Machine Learning. PMLR, 7164--7173 . Xingrui Yu, Bo Han, Jiangchao Yao, Gang Niu, Ivor Tsang, and Masashi Sugiyama. 2019. How does disagreement help generalization against label corruption?. In International Conference on Machine Learning. PMLR, 7164--7173."},{"key":"e_1_3_2_2_71_1","volume-title":"Wrench: A comprehensive benchmark for weak supervision. arXiv preprint arXiv:2109.11377","author":"Zhang Jieyu","year":"2021","unstructured":"Jieyu Zhang , Yue Yu , Yinghao Li , Yujing Wang , Yaming Yang , Mao Yang , and Alexander Ratner . 2021 . Wrench: A comprehensive benchmark for weak supervision. arXiv preprint arXiv:2109.11377 (2021). Jieyu Zhang, Yue Yu, Yinghao Li, Yujing Wang, Yaming Yang, Mao Yang, and Alexander Ratner. 2021. Wrench: A comprehensive benchmark for weak supervision. arXiv preprint arXiv:2109.11377 (2021)."},{"key":"e_1_3_2_2_72_1","volume-title":"Ensemble methods: foundations and algorithms","author":"Zhou Zhi-Hua","unstructured":"Zhi-Hua Zhou . 2012. Ensemble methods: foundations and algorithms . CRC press . Zhi-Hua Zhou. 2012. Ensemble methods: foundations and algorithms. CRC press."},{"key":"e_1_3_2_2_73_1","volume-title":"International Conference on Machine Learning (ICML).","author":"Zhu Zhaowei","year":"2022","unstructured":"Zhaowei Zhu , Zihao Dong , and Yang Liu . 2022 a. Detecting corrupted labels without training a model to predict . In International Conference on Machine Learning (ICML). Zhaowei Zhu, Zihao Dong, and Yang Liu. 2022a. Detecting corrupted labels without training a model to predict. In International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00998"},{"key":"e_1_3_2_2_75_1","volume-title":"The Rich Get Richer: Disparate Impact of Semi-Supervised Learning. arXiv preprint arXiv:2110.06282","author":"Zhu Zhaowei","year":"2021","unstructured":"Zhaowei Zhu , Tianyi Luo , and Yang Liu . 2021b. The Rich Get Richer: Disparate Impact of Semi-Supervised Learning. arXiv preprint arXiv:2110.06282 ( 2021 ). Zhaowei Zhu, Tianyi Luo, and Yang Liu. 2021b. The Rich Get Richer: Disparate Impact of Semi-Supervised Learning. arXiv preprint arXiv:2110.06282 (2021)."},{"key":"e_1_3_2_2_76_1","volume-title":"International Conference on Machine Learning. PMLR, 12912--12923","author":"Zhu Zhaowei","year":"2021","unstructured":"Zhaowei Zhu , Yiwen Song , and Yang Liu . 2021 c. Clusterability as an alternative to anchor points when learning with noisy labels . In International Conference on Machine Learning. PMLR, 12912--12923 . Zhaowei Zhu, Yiwen Song, and Yang Liu. 2021c. Clusterability as an alternative to anchor points when learning with noisy labels. In International Conference on Machine Learning. PMLR, 12912--12923."},{"key":"e_1_3_2_2_77_1","volume-title":"Beyond Images: Label Noise Transition Matrix Estimation for Tasks with Lower-Quality Features. In International Conference on Machine Learning (ICML). PMLR.","author":"Zhu Zhaowei","year":"2022","unstructured":"Zhaowei Zhu , Jialu Wang , and Yang Liu . 2022 b. Beyond Images: Label Noise Transition Matrix Estimation for Tasks with Lower-Quality Features. In International Conference on Machine Learning (ICML). PMLR. Zhaowei Zhu, Jialu Wang, and Yang Liu. 2022b. Beyond Images: Label Noise Transition Matrix Estimation for Tasks with Lower-Quality Features. In International Conference on Machine Learning (ICML). PMLR."},{"key":"e_1_3_2_2_78_1","volume-title":"International Conference on Machine Learning (ICML).","author":"Zhu Zhaowei","year":"2023","unstructured":"Zhaowei Zhu , Yuanshun Yao , Jiankai Sun , Hang Li , and Yang Liu . 2023 . Weak Proxies are Sufficient and Preferable for Fairness with Missing Sensitive Attributes . In International Conference on Machine Learning (ICML). Zhaowei Zhu, Yuanshun Yao, Jiankai Sun, Hang Li, and Yang Liu. 2023. Weak Proxies are Sufficient and Preferable for Fairness with Missing Sensitive Attributes. In International Conference on Machine Learning (ICML)."}],"event":{"name":"KDD '23: The 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Long Beach CA USA","acronym":"KDD '23","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580305.3599522","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3580305.3599522","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3580305.3599522","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:52Z","timestamp":1750178272000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580305.3599522"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,4]]},"references-count":78,"alternative-id":["10.1145\/3580305.3599522","10.1145\/3580305"],"URL":"https:\/\/doi.org\/10.1145\/3580305.3599522","relation":{},"subject":[],"published":{"date-parts":[[2023,8,4]]},"assertion":[{"value":"2023-08-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}