{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T21:16:20Z","timestamp":1772918180383,"version":"3.50.1"},"reference-count":72,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,12,26]],"date-time":"2024-12-26T00:00:00Z","timestamp":1735171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ARC Discovery Projects","award":["DP220102635"],"award-info":[{"award-number":["DP220102635"]}]},{"name":"Robust Meta Learning for Risk-aware Recommender Systems"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2025,2,28]]},"abstract":"<jats:p>Recommender systems have become important tools in the daily life of human beings since they are powerful to address information overload, and discover relevant and useful items for users. The success of recommender systems largely relies on the interaction history between users and items, which is expected to accurately reflect the preferences of users on items. However, the expectation is easily broken in practice, due to the corruptions made in the interaction history, resulting in unreliable and untrusted recommender systems. Previous works either ignore this issue (assume that the interaction history is precise) or are limited to handling additive noise. Motivated by this, in this paper, we study rating flip noise which widely exists in the interaction history of recommender systems and combat it by modelling the noise generation process. Specifically, the rating flip noise allows a rating to be flipped to any other ratings within the given rating set, which reflects various real-world situations of rating corruption, e.g., a user may randomly click a rating from the rating set and then submit it. The noise generation process is modelled by the noise transition matrix that denotes the probabilities of a clean rating flip into a noisy rating. A statistically consistent algorithm is afterwards applied with the estimated transition matrix to learn a robust recommender system against rating flip noise. Comprehensive experiments on multiple benchmarks confirm the superiority of our method.<\/jats:p>","DOI":"10.1145\/3641285","type":"journal-article","created":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T12:26:44Z","timestamp":1709209604000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Robust Recommender Systems with Rating Flip Noise"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-6961-7455","authenticated-orcid":false,"given":"Shanshan","family":"Ye","sequence":"first","affiliation":[{"name":"Australian Artificial Intelligence Institute, University of Technology Sydney, Ultimo, Broadway, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0690-4732","authenticated-orcid":false,"given":"Jie","family":"Lu","sequence":"additional","affiliation":[{"name":"Australian Artificial Intelligence Institute, University of Technology Sydney, Ultimo, Sydney, Australia"}]}],"member":"320","published-online":{"date-parts":[[2024,12,26]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2005.99"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.10626"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-28244-7_3"},{"key":"e_1_3_2_5_2","first-page":"24392","article-title":"Understanding and improving early stopping for learning with noisy labels","volume":"34","author":"Bai Yingbin","year":"2021","unstructured":"Yingbin Bai, Erkun Yang, Bo Han, Yanhua Yang, Jiatong Li, Yinian Mao, Gang Niu, and Tongliang Liu. 2021. Understanding and improving early stopping for learning with noisy labels. Advances in Neural Information Processing Systems 34 (2021), 24392\u201324403.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-018-9654-y"},{"key":"e_1_3_2_7_2","volume-title":"Pattern Recognition and Machine Learning","author":"Bishop Christopher M.","year":"2006","unstructured":"Christopher M. Bishop and Nasser M. Nasrabadi. 2006. Pattern Recognition and Machine Learning. Vol. 4. Springer."},{"key":"e_1_3_2_8_2","unstructured":"Mathieu Blondel Akinori Fujino Naonori Ueda and Masakazu Ishihata. 2016. Higher-order factorization machines. In NeurIPS\u201916."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5751"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3343117"},{"key":"e_1_3_2_11_2","first-page":"417","volume-title":"WWW","author":"Fan Wenqi","year":"2019","unstructured":"Wenqi Fan, Yao Ma, Qing Li, Yuan He, Eric Zhao, Jiliang Tang, and Dawei Yin. 2019. Graph neural networks for social recommendation. In WWW. 417\u2013426."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2021.3094662"},{"key":"e_1_3_2_13_2","article-title":"A survey on trustworthy recommender systems","author":"Ge Yingqiang","year":"2022","unstructured":"Yingqiang Ge, Shuchang Liu, Zuohui Fu, Juntao Tan, Zelong Li, Shuyuan Xu, Yunqi Li, Yikun Xian, and Yongfeng Zhang. 2022. A survey on trustworthy recommender systems. arXiv preprint arXiv:2207.12515 (2022).","journal-title":"arXiv preprint arXiv:2207.12515"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.09.081"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/138859.138867"},{"key":"e_1_3_2_16_2","volume-title":"ICLR","author":"Goldberger Jacob","year":"2017","unstructured":"Jacob Goldberger and Ehud Ben-Reuven. 2017. Training deep neural-networks using a noise adaptation layer. In ICLR."},{"key":"e_1_3_2_17_2","first-page":"8527","volume-title":"NeurIPS","author":"Han Bo","year":"2018","unstructured":"Bo Han, Quanming Yao, Xingrui Yu, Gang Niu, Miao Xu, Weihua Hu, Ivor Tsang, and Masashi Sugiyama. 2018. Co-teaching: Robust training of deep neural networks with extremely noisy labels. In NeurIPS. 8527\u20138537."},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.5555\/3304889.3304969"},{"key":"e_1_3_2_19_2","first-page":"173","volume-title":"WWW","author":"He Xiangnan","year":"2017","unstructured":"Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In WWW. 173\u2013182."},{"key":"e_1_3_2_20_2","first-page":"193","volume-title":"WWW","author":"Hsieh Cheng-Kang","year":"2017","unstructured":"Cheng-Kang Hsieh, Longqi Yang, Yin Cui, Tsung-Yi Lin, Serge Belongie, and Deborah Estrin. 2017. Collaborative metric learning. In WWW. 193\u2013201."},{"key":"e_1_3_2_21_2","first-page":"2309","volume-title":"ICML","author":"Jiang Lu","year":"2018","unstructured":"Lu Jiang, Zhengyuan Zhou, Thomas Leung, Li-Jia Li, and Li Fei-Fei. 2018. MentorNet: Learning data-driven curriculum for very deep neural networks on corrupted labels. In ICML. 2309\u20132318."},{"key":"e_1_3_2_22_2","volume-title":"ICLR","author":"Jiang Zhimeng","year":"2022","unstructured":"Zhimeng Jiang, Kaixiong Zhou, Zirui Liu, Li Li, Rui Chen, Soo-Hyun Choi, and Xia Hu. 2022. An information fusion approach to learning with instance-dependent label noise. In ICLR."},{"key":"e_1_3_2_23_2","article-title":"Adam: A method for stochastic optimization","author":"Kingma Diederik P.","year":"2014","unstructured":"Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).","journal-title":"arXiv preprint arXiv:1412.6980"},{"key":"e_1_3_2_24_2","first-page":"91","article-title":"Advances in collaborative filtering","author":"Koren Yehuda","year":"2021","unstructured":"Yehuda Koren, Steffen Rendle, and Robert Bell. 2021. Advances in collaborative filtering. Recommender Systems Handbook (2021), 91\u2013142.","journal-title":"Recommender Systems Handbook"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403258"},{"key":"e_1_3_2_26_2","first-page":"4313","volume-title":"International Conference on Artificial Intelligence and Statistics","author":"Li Mingchen","year":"2020","unstructured":"Mingchen Li, Mahdi Soltanolkotabi, and Samet Oymak. 2020. Gradient descent with early stopping is provably robust to label noise for overparameterized neural networks. In International Conference on Artificial Intelligence and Statistics. PMLR, 4313\u20134324."},{"key":"e_1_3_2_27_2","first-page":"689","volume-title":"WWW","author":"Liang Dawen","year":"2018","unstructured":"Dawen Liang, Rahul G. Krishnan, Matthew D. Hoffman, and Tony Jebara. 2018. Variational autoencoders for collaborative filtering. In WWW. 689\u2013698."},{"key":"e_1_3_2_28_2","volume-title":"WWW","author":"Lin Zihan","year":"2022","unstructured":"Zihan Lin, Changxin Tian, Yupeng Hou, and Wayne Xin Zhao. 2022. Improving graph collaborative filtering with neighborhood-enriched contrastive learning. In WWW. 2320\u20132329."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2456899"},{"key":"e_1_3_2_30_2","volume-title":"International Conference on Information Technology and Applications","author":"Lu Jie","year":"2004","unstructured":"Jie Lu. 2004. A personalized e-learning material recommender system. In International Conference on Information Technology and Applications. Macquarie Scientific Publishing."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2015.03.008"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1142\/11947"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2013.78"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159728"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.240"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3109859.3109896"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2010.127"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/371920.372071"},{"key":"e_1_3_2_39_2","first-page":"838","volume-title":"AISTATS","author":"Scott Clayton","year":"2015","unstructured":"Clayton Scott. 2015. A rate of convergence for mixture proportion estimation, with application to learning from noisy labels. In AISTATS. 838\u2013846."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2742726"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/WI-IAT.2011.109"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3152527"},{"key":"e_1_3_2_43_2","volume-title":"Machine Learning from Weak Supervision: An Empirical Risk Minimization Approach","author":"Sugiyama Masashi","year":"2022","unstructured":"Masashi Sugiyama, Han Bao, Takashi Ishida, Nan Lu, and Tomoya Sakai. 2022. Machine Learning from Weak Supervision: An Empirical Risk Minimization Approach. MIT Press."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2019.00165"},{"key":"e_1_3_2_45_2","first-page":"729","volume-title":"WWW","author":"Tay Yi","year":"2018","unstructured":"Yi Tay, Luu Anh Tuan, and Siu Cheung Hui. 2018. Latent relational metric learning via memory-based attention for collaborative ranking. In WWW. 729\u2013739."},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401134"},{"key":"e_1_3_2_47_2","article-title":"Trustworthy recommender systems","author":"Wang Shoujin","year":"2022","unstructured":"Shoujin Wang, Xiuzhen Zhang, Yan Wang, Huan Liu, and Francesco Ricci. 2022. Trustworthy recommender systems. arXiv preprint arXiv:2208.06265 (2022).","journal-title":"arXiv preprint arXiv:2208.06265"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467249"},{"key":"e_1_3_2_49_2","first-page":"7978","volume-title":"NeurIPS","author":"Wei Hongxin","year":"2021","unstructured":"Hongxin Wei, Lue Tao, Renchunzi Xie, and Bo An. 2021. Open-set label noise can improve robustness against inherent label noise. In NeurIPS. 7978\u20137992."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3018661.3018689"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462862"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2022.3145690"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/2835776.2835837"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3532058"},{"key":"e_1_3_2_55_2","volume-title":"NeurIPS","author":"Xia Xiaobo","year":"2019","unstructured":"Xiaobo Xia, Tongliang Liu, Nannan Wang, Bo Han, Chen Gong, Gang Niu, and Masashi Sugiyama. 2019. Are anchor points really indispensable in label-noise learning?. In NeurIPS."},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3574157"},{"key":"e_1_3_2_57_2","article-title":"Deconfounded causal collaborative filtering","author":"Xu Shuyuan","year":"2021","unstructured":"Shuyuan Xu, Juntao Tan, Shelby Heinecke, Vena Jia Li, and Yongfeng Zhang. 2021. Deconfounded causal collaborative filtering. ACM Transactions on Recommender Systems (2021).","journal-title":"ACM Transactions on Recommender Systems"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.02.008"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2014.2355842"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2013.16"},{"key":"e_1_3_2_61_2","unstructured":"Yu Yao Tongliang Liu Bo Han Mingming Gong Jiankang Deng Gang Niu and Masashi Sugiyama. 2020. Dual t: Reducing estimation error for transition matrix in label-noise learning. In NeurIPS\u201920. 7260\u20137271."},{"key":"e_1_3_2_62_2","first-page":"403","volume-title":"Australasian Joint Conference on Artificial Intelligence","author":"Ye Shanshan","year":"2023","unstructured":"Shanshan Ye and Jie Lu. 2023. Sequence unlearning for sequential recommender systems. In Australasian Joint Conference on Artificial Intelligence. Springer, 403\u2013415."},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2023.01.089"},{"key":"e_1_3_2_64_2","article-title":"Manipulating federated recommender systems: Poisoning with synthetic users and its countermeasures","author":"Yuan Wei","year":"2023","unstructured":"Wei Yuan, Quoc Viet Hung Nguyen, Tieke He, Liang Chen, and Hongzhi Yin. 2023. Manipulating federated recommender systems: Poisoning with synthetic users and its countermeasures. arXiv preprint arXiv:2304.03054 (2023).","journal-title":"arXiv preprint arXiv:2304.03054"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3539597.3570463"},{"key":"e_1_3_2_66_2","article-title":"Manipulating visually-aware federated recommender systems and its countermeasures","author":"Yuan Wei","year":"2023","unstructured":"Wei Yuan, Shilong Yuan, Kai Zheng, Quoc Viet Hung Nguyen, and Hongzhi Yin. 2023. Manipulating visually-aware federated recommender systems and its countermeasures. arXiv preprint arXiv:2305.08183 (2023).","journal-title":"arXiv preprint arXiv:2305.08183"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.11.021"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40747-020-00212-w"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3158369"},{"key":"e_1_3_2_70_2","first-page":"12501","volume-title":"ICML","author":"Zhang Yivan","year":"2021","unstructured":"Yivan Zhang, Gang Niu, and Masashi Sugiyama. 2021. Learning noise transition matrix from only noisy labels via total variation regularization. In ICML. 12501\u201312512."},{"key":"e_1_3_2_71_2","volume-title":"IJCAI","author":"Zhang Yongfeng","year":"2015","unstructured":"Yongfeng Zhang, Yunzhi Tan, Min Zhang, Yiqun Liu, Tat-Seng Chua, and Shaoping Ma. 2015. Catch the black sheep: Unified framework for shilling attack detection based on fraudulent action propagation. In IJCAI."},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3579355"},{"key":"e_1_3_2_73_2","first-page":"12846","volume-title":"ICML","author":"Zhou Xiong","year":"2021","unstructured":"Xiong Zhou, Xianming Liu, Junjun Jiang, Xin Gao, and Xiangyang Ji. 2021. Asymmetric loss functions for learning with noisy labels. In ICML. 12846\u201312856."}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3641285","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3641285","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:17:48Z","timestamp":1750295868000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3641285"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,26]]},"references-count":72,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,2,28]]}},"alternative-id":["10.1145\/3641285"],"URL":"https:\/\/doi.org\/10.1145\/3641285","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,26]]},"assertion":[{"value":"2023-06-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-01-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}