{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T08:59:51Z","timestamp":1765357191399,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":24,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,8,23]],"date-time":"2022-08-23T00:00:00Z","timestamp":1661212800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,8,23]]},"DOI":"10.1145\/3539813.3545127","type":"proceedings-article","created":{"date-parts":[[2022,8,25]],"date-time":"2022-08-25T22:18:32Z","timestamp":1661465912000},"page":"214-222","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Filtering out Outliers in Learning to Rank"],"prefix":"10.1145","author":[{"given":"Federico","family":"Marcuzzi","sequence":"first","affiliation":[{"name":"Universit\u00e0 Ca' Foscari Venezia, Venice, Italy"}]},{"given":"Claudio","family":"Lucchese","sequence":"additional","affiliation":[{"name":"Universit\u00e0 Ca' Foscari Venezia, Venice, Italy"}]},{"given":"Salvatore","family":"Orlando","sequence":"additional","affiliation":[{"name":"Universit\u00e0 Ca' Foscari Venezia, Venice, Italy"}]}],"member":"320","published-online":{"date-parts":[[2022,8,25]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553380"},{"key":"e_1_3_2_1_2_1","volume-title":"An Alternative Cross Entropy Loss for Learning-to-Rank. In WWW '21: The Web Conference 2021","author":"Bruch Sebastian","year":"2021","unstructured":"Sebastian Bruch . 2021 . An Alternative Cross Entropy Loss for Learning-to-Rank. In WWW '21: The Web Conference 2021 , Virtual Event \/ Ljubljana, Slovenia, April 19--23 , 2021, Jure Leskovec, Marko Grobelnik, Marc Najork, Jie Tang, and Leila Zia (Eds.). ACM \/ IW3C2, 118--126. https:\/\/doi.org\/10.1145\/3442381.3449794 10.1145\/3442381.3449794 Sebastian Bruch. 2021. An Alternative Cross Entropy Loss for Learning-to-Rank. In WWW '21: The Web Conference 2021, Virtual Event \/ Ljubljana, Slovenia, April 19--23, 2021, Jure Leskovec, Marko Grobelnik, Marc Najork, Jie Tang, and Leila Zia (Eds.). ACM \/ IW3C2, 118--126. https:\/\/doi.org\/10.1145\/3442381.3449794"},{"key":"e_1_3_2_1_3_1","volume-title":"SIGIR 2008 workshop on learning to rank for information retrieval","volume":"1","author":"Carvalho Vitor R","year":"2008","unstructured":"Vitor R Carvalho , Jonathan L Elsas , William W Cohen , and Jaime G Carbonell . 2008 . A meta-learning approach for robust rank learning . In SIGIR 2008 workshop on learning to rank for information retrieval , Vol. 1 . Vitor R Carvalho, Jonathan L Elsas, William W Cohen, and Jaime G Carbonell. 2008. A meta-learning approach for robust rank learning. In SIGIR 2008 workshop on learning to rank for information retrieval, Vol. 1."},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the Yahoo! Learning to Rank Challenge, held at ICML 2010, Haifa, Israel, June 25, 2010 (JMLR Proceedings","volume":"24","author":"Chapelle Olivier","year":"2011","unstructured":"Olivier Chapelle and Yi Chang . 2011 . Yahoo! Learning to Rank Challenge Overview . In Proceedings of the Yahoo! Learning to Rank Challenge, held at ICML 2010, Haifa, Israel, June 25, 2010 (JMLR Proceedings , Vol. 14), Olivier Chapelle, Yi Chang, and Tie-Yan Liu (Eds.). JMLR.org, 1-- 24 . http:\/\/proceedings.mlr.press\/v14\/chapelle11a.html Olivier Chapelle and Yi Chang. 2011. Yahoo! Learning to Rank Challenge Overview. In Proceedings of the Yahoo! Learning to Rank Challenge, held at ICML 2010, Haifa, Israel, June 25, 2010 (JMLR Proceedings, Vol. 14), Olivier Chapelle, Yi Chang, and Tie-Yan Liu (Eds.). JMLR.org, 1--24. http:\/\/proceedings.mlr.press\/v14\/chapelle11a.html"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2094072.2094078"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646033"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2576230"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2020\/305"},{"key":"e_1_3_2_1_9_1","volume-title":"The design of experiments","author":"Fisher R.A.","year":"1935","unstructured":"R.A. Fisher . 1935. The design of experiments . 1935 . Oliver and Boyd , Edinburgh . R.A. Fisher. 1935. The design of experiments. 1935. Oliver and Boyd, Edinburgh."},{"key":"e_1_3_2_1_10_1","volume-title":"3rd International Conference on Learning Representations, ICLR","author":"Goodfellow Ian J.","year":"2015","unstructured":"Ian J. Goodfellow , Jonathon Shlens , and Christian Szegedy . 2015. Explaining and Harnessing Adversarial Examples . In 3rd International Conference on Learning Representations, ICLR 2015 , San Diego, CA , USA, May 7--9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds .). http:\/\/arxiv.org\/abs\/1412.6572 Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy. 2015. Explaining and Harnessing Adversarial Examples. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). http:\/\/arxiv.org\/abs\/1412.6572"},{"key":"e_1_3_2_1_11_1","volume-title":"Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018","author":"Han Bo","year":"2018","unstructured":"Bo Han , Quanming Yao , Xingrui Yu , Gang Niu , Miao Xu , Weihua Hu , Ivor W. Tsang , and Masashi Sugiyama . 2018 . Co-teaching: Robust training of deep neural networks with extremely noisy labels . In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018 , NeurIPS 2018, December 3--8, 2018, Montr\u00e9al, Canada, Samy Bengio, Hanna M.Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds.). 8536--8546. https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/a19744e268754fb0148b017647355b7b-Abstract.html Bo Han, Quanming Yao, Xingrui Yu, Gang Niu, Miao Xu, Weihua Hu, Ivor W. Tsang, and Masashi Sugiyama. 2018. Co-teaching: Robust training of deep neural networks with extremely noisy labels. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3--8, 2018, Montr\u00e9al, Canada, Samy Bengio, Hanna M.Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds.). 8536--8546. https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/a19744e268754fb0148b017647355b7b-Abstract.html"},{"key":"e_1_3_2_1_12_1","volume-title":"SIGIR 2000: Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, July 24--28","author":"J\u00e4rvelin Kalervo","year":"2000","unstructured":"Kalervo J\u00e4rvelin and Jaana Kek\u00e4l\u00e4inen . 2000 . IR evaluation methods for retrieving highly relevant documents . In SIGIR 2000: Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, July 24--28 , 2000, Athens, Greece, Emmanuel J. Yannakoudakis, Nicholas J. Belkin, Peter Ingwersen, and Mun-Kew Leong (Eds.). ACM, 41--48. https:\/\/doi.org\/10.1145\/345508.345545 10.1145\/345508.345545 Kalervo J\u00e4rvelin and Jaana Kek\u00e4l\u00e4inen. 2000. IR evaluation methods for retrieving highly relevant documents. In SIGIR 2000: Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, July 24--28, 2000, Athens, Greece, Emmanuel J. Yannakoudakis, Nicholas J. Belkin, Peter Ingwersen, and Mun-Kew Leong (Eds.). ACM, 41--48. https:\/\/doi.org\/10.1145\/345508.345545"},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the First International Conference on Knowledge Discovery and Data Mining (KDD-95)","author":"John George H.","year":"1995","unstructured":"George H. John . 1995 . Robust Decision Trees: Removing Outliers from Databases . In Proceedings of the First International Conference on Knowledge Discovery and Data Mining (KDD-95) , Montreal, Canada, August 20--21 , 1995, Usama M. Fayyad and Ramasamy Uthurusamy (Eds.). AAAI Press, 174--179. http:\/\/www.aaai.org\/Library\/KDD\/1995\/kdd95-044.php George H. John. 1995. Robust Decision Trees: Removing Outliers from Databases. In Proceedings of the First International Conference on Knowledge Discovery and Data Mining (KDD-95), Montreal, Canada, August 20--21, 1995, Usama M. Fayyad and Ramasamy Uthurusamy (Eds.). AAAI Press, 174--179. http:\/\/www.aaai.org\/Library\/KDD\/1995\/kdd95-044.php"},{"key":"e_1_3_2_1_14_1","volume-title":"LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017","author":"Ke Guolin","year":"2017","unstructured":"Guolin Ke , Qi Meng , Thomas Finley , Taifeng Wang , Wei Chen , Weidong Ma , Qiwei Ye , and Tie-Yan Liu . 2017 . LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017 , December 4 --9 , 2017, Long Beach, CA, USA, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 3146--3154. https:\/\/proceedings.neurips.cc\/paper\/2017\/hash\/6449f44a102fde848669bdd9eb6b76fa-Abstract.html Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4--9, 2017, Long Beach, CA, USA, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 3146--3154. https:\/\/proceedings.neurips.cc\/paper\/2017\/hash\/6449f44a102fde848669bdd9eb6b76fa-Abstract.html"},{"key":"e_1_3_2_1_15_1","volume-title":"Isolation Forest. In Proceedings of the 8th IEEE International Conference on Data Mining (ICDM 2008","author":"Liu Fei Tony","year":"2008","unstructured":"Fei Tony Liu , Kai Ming Ting , and Zhi-Hua Zhou . 2008 . Isolation Forest. In Proceedings of the 8th IEEE International Conference on Data Mining (ICDM 2008 ), December 15 --19 , 2008, Pisa, Italy. IEEE Computer Society, 413--422. https:\/\/doi.org\/10.1109\/ICDM.2008.17 10.1109\/ICDM.2008.17 Fei Tony Liu, Kai Ming Ting, and Zhi-Hua Zhou. 2008. Isolation Forest. In Proceedings of the 8th IEEE International Conference on Data Mining (ICDM 2008), December 15--19, 2008, Pisa, Italy. IEEE Computer Society, 413--422. https:\/\/doi.org\/10.1109\/ICDM.2008.17"},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13--18","volume":"6236","author":"Liu Yang","year":"2020","unstructured":"Yang Liu and Hongyi Guo . 2020 . Peer Loss Functions: Learning from Noisy Labels without Knowing Noise Rates . In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13--18 July 2020, Virtual Event (Proceedings of Machine Learning Research , Vol. 119). PMLR, 6226-- 6236 . http:\/\/proceedings.mlr.press\/v119\/liu20e.html Yang Liu and Hongyi Guo. 2020. Peer Loss Functions: Learning from Noisy Labels without Knowing Noise Rates. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13--18 July 2020, Virtual Event (Proceedings of Machine Learning Research, Vol. 119). PMLR, 6226--6236. http:\/\/proceedings.mlr.press\/v119\/liu20e.html"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210048"},{"key":"e_1_3_2_1_18_1","volume-title":"8th International Conference on Learning Representations, ICLR 2020","author":"Nguyen Duc Tam","year":"2020","unstructured":"Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi- Phuong-Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , and Thomas Brox . 2020 . SELF: Learning to Filter Noisy Labels with Self-Ensembling . In 8th International Conference on Learning Representations, ICLR 2020 , Addis Ababa, Ethiopia, April 26--30 , 2020. OpenReview.net. https:\/\/openreview.net\/forum?id=HkgsPhNYPS Duc Tam Nguyen, Chaithanya Kumar Mummadi, Thi-Phuong-Nhung Ngo, Thi Hoai Phuong Nguyen, Laura Beggel, and Thomas Brox. 2020. SELF: Learning to Filter Noisy Labels with Self-Ensembling. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26--30, 2020. OpenReview.net. https:\/\/openreview.net\/forum?id=HkgsPhNYPS"},{"key":"e_1_3_2_1_19_1","volume-title":"CoRR abs\/1306.2597","author":"Qin Tao","year":"2013","unstructured":"Tao Qin and Tie-Yan Liu . 2013. Introducing LETOR 4.0 Datasets . CoRR abs\/1306.2597 ( 2013 ). http:\/\/arxiv.org\/abs\/1306.2597 Tao Qin and Tie-Yan Liu. 2013. Introducing LETOR 4.0 Datasets. CoRR abs\/1306.2597 (2013). http:\/\/arxiv.org\/abs\/1306.2597"},{"key":"e_1_3_2_1_20_1","unstructured":"J. Ross Quinlan. 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann.  J. Ross Quinlan. 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann."},{"key":"e_1_3_2_1_21_1","volume-title":"3rd International Conference on Learning Representations, ICLR","author":"Reed Scott E.","year":"2015","unstructured":"Scott E. Reed , Honglak Lee , Dragomir Anguelov , Christian Szegedy , Dumitru Erhan , and Andrew Rabinovich . 2015. Training Deep Neural Networks on Noisy Labels with Bootstrapping . In 3rd International Conference on Learning Representations, ICLR 2015 , San Diego, CA , USA, May 7--9, 2015,Workshop Track Proceedings, Yoshua Bengio and Yann LeCun (Eds .). http:\/\/arxiv.org\/abs\/1412.6596 Scott E. Reed, Honglak Lee, Dragomir Anguelov, Christian Szegedy, Dumitru Erhan, and Andrew Rabinovich. 2015. Training Deep Neural Networks on Noisy Labels with Bootstrapping. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015,Workshop Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). http:\/\/arxiv.org\/abs\/1412.6596"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9112-1"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3142096"},{"key":"e_1_3_2_1_24_1","volume-title":"Sabuncu","author":"Zhang Zhilu","year":"2018","unstructured":"Zhilu Zhang and Mert R . Sabuncu . 2018 . Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3--8, 2018, Montr\u00e9al, Canada, Samy Bengio, Hanna M.Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds .). 8792--8802. https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/f2925f97bc13ad2852a7a551802feea0-Abstract.html Zhilu Zhang and Mert R. Sabuncu. 2018. Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3--8, 2018, Montr\u00e9al, Canada, Samy Bengio, Hanna M.Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds.). 8792--8802. https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/f2925f97bc13ad2852a7a551802feea0-Abstract.html"}],"event":{"name":"ICTIR '22: The 2022 ACM SIGIR International Conference on the Theory of Information Retrieval","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Madrid Spain","acronym":"ICTIR '22"},"container-title":["Proceedings of the 2022 ACM SIGIR International Conference on Theory of Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3539813.3545127","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3539813.3545127","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:10:03Z","timestamp":1750183803000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3539813.3545127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,23]]},"references-count":24,"alternative-id":["10.1145\/3539813.3545127","10.1145\/3539813"],"URL":"https:\/\/doi.org\/10.1145\/3539813.3545127","relation":{},"subject":[],"published":{"date-parts":[[2022,8,23]]},"assertion":[{"value":"2022-08-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}