{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T16:26:43Z","timestamp":1778603203364,"version":"3.51.4"},"reference-count":82,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2024,8,19]],"date-time":"2024-08-19T00:00:00Z","timestamp":1724025600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R & D Program of China","doi-asserted-by":"crossref","award":["2023YFF0905402"],"award-info":[{"award-number":["2023YFF0905402"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62102420"],"award-info":[{"award-number":["62102420"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Beijing Outstanding Young Scientist Program","award":["BJJWZYJH012019100020098"],"award-info":[{"award-number":["BJJWZYJH012019100020098"]}]},{"name":"KuaiShou Technology Programs","award":["2022020091"],"award-info":[{"award-number":["2022020091"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2024,11,30]]},"abstract":"<jats:p>Contrastive learning has recently emerged as an effective strategy for improving the performance of sequential recommendation. However, traditional models commonly construct the contrastive loss by directly optimizing human-designed positive and negative samples, resulting in a model that is overly sensitive to heuristic rules. To address this limitation, we propose a novel soft contrastive framework for sequential recommendation in this article. Our main idea is to extend the point-wise contrast to a region-level comparison, where we aim to identify instances near the initially selected positive\/negative samples that exhibit similar contrastive properties. This extension improves the model\u2019s robustness to human heuristics. To achieve this objective, we introduce an adversarial contrastive loss that allows us to explore the sample regions more effectively. Specifically, we begin by considering the user behavior sequence as a holistic entity. We construct adversarial samples by introducing a continuous perturbation vector to the sequence representation. This perturbation vector adds variability to the sequence, enabling more flexible exploration of the sample regions. Moreover, we extend the aforementioned strategy by applying perturbations directly to the items within the sequence. This accounts for the sequential nature of the items. To capture these sequential relationships, we utilize a recurrent neural network to associate the perturbations, which introduces an inductive bias for more efficient exploration of adversarial samples. To demonstrate the effectiveness of our model, we conduct extensive experiments on five real-world datasets.<\/jats:p>","DOI":"10.1145\/3665325","type":"journal-article","created":{"date-parts":[[2024,5,16]],"date-time":"2024-05-16T15:03:54Z","timestamp":1715871834000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Soft Contrastive Sequential Recommendation"],"prefix":"10.1145","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3115-0285","authenticated-orcid":false,"given":"Yabin","family":"Zhang","sequence":"first","affiliation":[{"name":"Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1890-5556","authenticated-orcid":false,"given":"Zhenlei","family":"Wang","sequence":"additional","affiliation":[{"name":"Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0886-3543","authenticated-orcid":false,"given":"Wenhui","family":"Yu","sequence":"additional","affiliation":[{"name":"Kuaishou Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0697-8985","authenticated-orcid":false,"given":"Lantao","family":"Hu","sequence":"additional","affiliation":[{"name":"Kuaishou Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9266-0780","authenticated-orcid":false,"given":"Peng","family":"Jiang","sequence":"additional","affiliation":[{"name":"Kuaishou Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3636-3618","authenticated-orcid":false,"given":"Kun","family":"Gai","sequence":"additional","affiliation":[{"name":"Unaffiliated, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0144-1775","authenticated-orcid":false,"given":"Xu","family":"Chen","sequence":"additional","affiliation":[{"name":"Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,8,19]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1002\/aaai.12056"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-19-5443-6_57"},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","unstructured":"Tao Bai Jinqi Luo Jun Zhao Bihan Wen and Qian Wang. 2021. Recent advances in adversarial training for adversarial robustness. Retrieved from https:\/\/arxiv.org\/pdf\/2102.01356","DOI":"10.24963\/ijcai.2021\/591"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72575-6_8"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331192"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3512090"},{"key":"e_1_3_2_8_2","unstructured":"Kyunghyun Cho Bart Van Merri\u00ebnboer Caglar Gulcehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. Retrieved from https:\/\/arxiv.org\/pdf\/2102.01356"},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","unstructured":"Yung-Sung Chuang Rumen Dangovski Hongyin Luo Yang Zhang Shiyu Chang Marin Solja\u010di\u0107 Shang-Wen Li Wen-tau Yih Yoon Kim and James Glass. 2022. DiffCSE: Difference-based contrastive learning for sentence embeddings. arXiv:2204.10298. Retrieved from https:\/\/aclanthology.org\/2022.naacl-main.311","DOI":"10.18653\/v1\/2022.naacl-main.311"},{"key":"e_1_3_2_10_2","unstructured":"Yizhou Dang Enneng Yang Guibing Guo Linying Jiang Xingwei Wang Xiaoxiao Xu Qinghui Sun and Hong Liu. 2022. Uniform sequence better: Time interval aware data augmentation for sequential recommendation. Retrieved from https:\/\/arxiv.org\/pdf\/2212.08262"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/WACV56688.2023.00273"},{"key":"e_1_3_2_12_2","unstructured":"Jacob Devlin Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. Retrieved from https:\/\/arxiv.org\/pdf\/1810.04805"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00945"},{"key":"e_1_3_2_14_2","unstructured":"William Falcon and Kyunghyun Cho. 2020. A framework for contrastive self-supervised learning and designing a new approach. Retrieved from https:\/\/arxiv.org\/pdf\/2009.00104"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","unstructured":"Hongchao Fang Sicheng Wang Meng Zhou Jiayuan Ding and Pengtao Xie. 2020. Cert: Contrastive self-supervised learning for language understanding. Retrieved from https:\/\/arxiv.org\/pdf\/2005.12766","DOI":"10.36227\/techrxiv.12308378.v1"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.5555\/2886521.2886559"},{"key":"e_1_3_2_17_2","unstructured":"Tianyu Gao Xingcheng Yao and Danqi Chen. 2021. SimCSE: Simple contrastive learning of sentence embeddings. Retrieved from https:\/\/arxiv.org\/abs\/2104.08821"},{"key":"e_1_3_2_18_2","unstructured":"John Giorgi Osvald Nitski Bo Wang and Gary Bader. 2020. DeCLUTR: Deep contrastive learning for unsupervised textual representations. Retrieved from https:\/\/arxiv.org\/abs\/2006.03659"},{"key":"e_1_3_2_19_2","unstructured":"Ian J. Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and harnessing adversarial examples. Retrieved from https:\/\/arxiv.org\/abs\/2006.03659"},{"key":"e_1_3_2_20_2","unstructured":"Ian J. Goodfellow Jonathon Shlens and Christian Szegedy. 2015. Explaining and harnessing adversarial examples. Retrieved from https:\/\/arxiv.org\/abs\/2006.03659"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2016.0030"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052569"},{"key":"e_1_3_2_23_2","unstructured":"Bal\u00e1zs Hidasi Alexandros Karatzoglou Linas Baltrunas and Domonkos Tikk. 2015. Session-based recommendations with recurrent neural networks. Retrieved from https:\/\/arxiv.org\/abs\/1511.06939"},{"key":"e_1_3_2_24_2","first-page":"17081","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"33","author":"Ho Chih-Hui","year":"2020","unstructured":"Chih-Hui Ho and Nuno Nvasconcelos. 2020. Contrastive learning with adversarial examples. Proceedings of the Advances in Neural Information Processing Systems, Vol. 33, 17081\u201317093."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582418"},{"key":"e_1_3_2_26_2","unstructured":"Hyolim Kang Jinwoo Kim Kyungmin Kim Taehyun Kim and Seon Joo Kim. 2021. Winning the CVPR\u20192021 kinetics-GEBD challenge: Contrastive learning approach. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:235593133"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2018.00035"},{"key":"e_1_3_2_28_2","unstructured":"Taeuk Kim Kang Min Yoo and Sang-goo Lee. 2021. Self-guided contrastive learning for BERT sentence representations. Retrieved from https:\/\/arxiv.org\/abs\/2106.07345"},{"key":"e_1_3_2_29_2","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. Retrieved from https:\/\/arxiv.org\/pdf\/1412.6980"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13636-022-00269-0"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00980"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781351251389-8"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3031549"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3132926"},{"key":"e_1_3_2_35_2","unstructured":"Junnan Li Pan Zhou Caiming Xiong and Steven CH Hoi. 2020. Prototypical contrastive learning of unsupervised representations. Retrieved from https:\/\/arxiv.org\/abs\/2005.04966"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482448"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2003.1167344"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219950"},{"issue":"1","key":"e_1_3_2_39_2","first-page":"857","article-title":"Self-supervised learning: Generative or contrastive","volume":"35","author":"Liu Xiao","year":"2021","unstructured":"Xiao Liu, Fanjin Zhang, Zhenyu Hou, Li Mian, Zhaoyu Wang, Jing Zhang, and Jie Tang. 2021c. Self-supervised learning: Generative or contrastive. IEEE Transactions on Knowledge and Data Engineering 35, 1 (2021), 857\u2013876.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_40_2","unstructured":"Zhiwei Liu Yongjun Chen Jia Li Philip S Yu Julian McAuley and Caiming Xiong. 2021a. Contrastive self-supervised sequential recommendation with robust augmentation. Retrieved from https:\/\/arxiv.org\/abs\/2108.06479"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463036"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.physrep.2012.02.006"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403091"},{"key":"e_1_3_2_44_2","unstructured":"Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras and Adrian Vladu. 2017. Towards deep learning models resistant to adversarial attacks. Retrieved from http:\/\/www.arxiv.org\/abs\/1706.06083"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767755"},{"key":"e_1_3_2_46_2","unstructured":"Deshui Miao Jiaqi Zhang Wenbo Xie Jian Song Xin Li Lijuan Jia and Ning Guo. 2021. Simple contrastive representation adversarial learning for NLP tasks. Retrieved from https:\/\/arxiv.org\/abs\/2111.13301"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2020.3026000"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2012.02.001"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1080\/15405702.2019.1627548"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-022-07378-0"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM51629.2021.00063"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3488560.3498433"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2010.127"},{"key":"e_1_3_2_54_2","unstructured":"Steffen Rendle Christoph Freudenthaler Zeno Gantner and Lars Schmidt-Thieme. 2012. BPR: Bayesian personalized ranking from implicit feedback. Retrieved from https:\/\/arxiv.org\/abs\/1205.2618"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772773"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/245108.245121"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-85820-3_1"},{"key":"e_1_3_2_58_2","unstructured":"Hojjat Salehinejad Sharan Sankar Joseph Barfett Errol Colak and Shahrokh Valaee. 2017. Recent advances in recurrent neural networks. Retrieved from https:\/\/arxiv.org\/abs\/1801.01078"},{"key":"e_1_3_2_59_2","doi-asserted-by":"crossref","unstructured":"Peter Shaw Jakob Uszkoreit and Ashish Vaswani. 2018. Self-attention with relative position representations. Retrieved from https:\/\/arxiv.org\/abs\/1803.02155","DOI":"10.18653\/v1\/N18-2074"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11941"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357895"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210023"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2014.09.019"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159656"},{"key":"e_1_3_2_65_2","first-page":"12259","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"32","author":"Tu Zhuozhuo","year":"2019","unstructured":"Zhuozhuo Tu, Jingwei Zhang, and Dacheng Tao. 2019. Theoretical analysis of adversarial learning: A minimax approach. Proceedings of the Advances in Neural Information Processing Systems, Vol. 32, 12259\u201312269."},{"key":"e_1_3_2_66_2","first-page":"6000","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems, Vol. 30, 6000\u20136010."},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/3528667"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219869"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557317"},{"key":"e_1_3_2_70_2","unstructured":"Yisen Wang Xingjun Ma James Bailey Jinfeng Yi Bowen Zhou and Quanquan Gu. 2021. On the convergence and robustness of adversarial training. Retrieved from https:\/\/arxiv.org\/abs\/2112.08304"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557404"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3018661.3018689"},{"key":"e_1_3_2_73_2","unstructured":"Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun and Hao Ma. 2020. Clear: Contrastive learning for sentence representation. Retrieved from https:\/\/arxiv.org\/abs\/2012.15466"},{"key":"e_1_3_2_74_2","unstructured":"Tete Xiao Xiaolong Wang Alexei A. Efros and Trevor Darrell. 2020. What should not be contrastive in contrastive learning. Retrieved from https:\/\/arxiv.org\/abs\/2008.05659"},{"key":"e_1_3_2_75_2","unstructured":"Xu Xie Fei Sun Zhaoyang Liu Jinyang Gao Bolin Ding and Bin Cui. 2020. Contrastive pre-training for sequential recommendation. Retrieved from http:\/\/www.arxiv.org\/abs\/2010.14395"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE53745.2022.00099"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531937"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159688"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01009"},{"key":"e_1_3_2_80_2","unstructured":"Wayne Xin Zhao Yupeng Hou Xingyu Pan Chen Yang Zeyu Zhang Zihan Lin Jingsen Zhang Shuqing Bian Jiakai Tang Wenqi Sun Yushuo Chen Lanling Xu Gaowei Zhang Zhen Tian Changxin Tian Shanlei Mu Xinyan Fan Xu Chen and Ji-Rong Wen. 2022. RecBole 2.0: Towards a more up-to-date recommendation library. Retrieved from https:\/\/arxiv.org\/abs\/2206.07351"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3185994"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3411954"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3449802"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3665325","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3665325","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:19Z","timestamp":1750291399000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3665325"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,19]]},"references-count":82,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,11,30]]}},"alternative-id":["10.1145\/3665325"],"URL":"https:\/\/doi.org\/10.1145\/3665325","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,19]]},"assertion":[{"value":"2023-10-25","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-05","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}