{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T02:03:52Z","timestamp":1777341832924,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":52,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T00:00:00Z","timestamp":1720569600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,7,10]]},"DOI":"10.1145\/3626772.3657971","type":"proceedings-article","created":{"date-parts":[[2024,7,11]],"date-time":"2024-07-11T12:40:05Z","timestamp":1720701605000},"page":"2502-2506","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Masked Graph Transformer for Large-Scale Recommendation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6360-558X","authenticated-orcid":false,"given":"Huiyuan","family":"Chen","sequence":"first","affiliation":[{"name":"Visa Research, Foster City, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6675-1398","authenticated-orcid":false,"given":"Zhe","family":"Xu","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Urbana and Champaign, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9807-2963","authenticated-orcid":false,"given":"Chin-Chia Michael","family":"Yeh","sequence":"additional","affiliation":[{"name":"Visa Research, Foster City, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3165-6136","authenticated-orcid":false,"given":"Vivian","family":"Lai","sequence":"additional","affiliation":[{"name":"Visa Research, Foster City, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4422-9889","authenticated-orcid":false,"given":"Yan","family":"Zheng","sequence":"additional","affiliation":[{"name":"Visa Research, Foster City, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-7746-2468","authenticated-orcid":false,"given":"Minghua","family":"Xu","sequence":"additional","affiliation":[{"name":"Visa Research, Foster City, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4405-3887","authenticated-orcid":false,"given":"Hanghang","family":"Tong","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Urbana and Champaign, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,7,11]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Dexiong Chen Leslie O'Bray and Karsten Borgwardt. 2022b. Structure-aware transformer for graph representation learning. In ICLR."},{"key":"e_1_3_2_1_2_1","volume-title":"Xiaoting Li, Yan Zheng, Fei Wang, and Hao Yang.","author":"Chen Huiyuan","year":"2022","unstructured":"Huiyuan Chen, Yusan Lin, Menghai Pan, Lan Wang, Chin-Chia Michael Yeh, Xiaoting Li, Yan Zheng, Fei Wang, and Hao Yang. 2022a. Denoising self-attentive sequential recommendation. In RecSys."},{"key":"e_1_3_2_1_3_1","volume-title":"Fei Wang, and Hao Yang.","author":"Chen Huiyuan","year":"2021","unstructured":"Huiyuan Chen, Lan Wang, Yusan Lin, Chin-Chia Michael Yeh, Fei Wang, and Hao Yang. 2021. Structured graph convolutional networks with stochastic masks for recommender systems. In SIGIR."},{"key":"e_1_3_2_1_4_1","volume-title":"Yujie Fan, Yan Zheng, Junpeng Wang, Vivian Lai, Mahashweta Das, and Hao Yang.","author":"Chen Huiyuan","year":"2023","unstructured":"Huiyuan Chen, Chin-Chia Michael Yeh, Yujie Fan, Yan Zheng, Junpeng Wang, Vivian Lai, Mahashweta Das, and Hao Yang. 2023. Sharpness-Aware Graph Collaborative Filtering. In SIGIR."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3512162"},{"key":"e_1_3_2_1_6_1","volume-title":"Afroz Mohiuddin, Lukasz Kaiser, David Benjamin Belanger, Lucy J Colwell, and Adrian Weller.","author":"Choromanski Krzysztof Marcin","year":"2021","unstructured":"Krzysztof Marcin Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamas Sarlos, Peter Hawkins, Jared Quincy Davis, Afroz Mohiuddin, Lukasz Kaiser, David Benjamin Belanger, Lucy J Colwell, and Adrian Weller. 2021. Rethinking Attention with Performers. In ICLR."},{"key":"e_1_3_2_1_7_1","volume-title":"Thomas Laurent, Yoshua Bengio, and Xavier Bresson.","author":"Dwivedi Vijay Prakash","year":"2021","unstructured":"Vijay Prakash Dwivedi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio, and Xavier Bresson. 2021. Graph Neural Networks with Learnable Structural and Positional Representations. In ICLR."},{"key":"e_1_3_2_1_8_1","volume-title":"Transformers meet directed graphs. In International Conference on Machine Learning.","author":"Geisler Simon","year":"2023","unstructured":"Simon Geisler, Yujia Li, Daniel J Mankowitz, Ali Taylan Cemgil, Stephan G\u00fcnnemann, and Cosmin Paduraru. 2023. Transformers meet directed graphs. In International Conference on Machine Learning."},{"key":"e_1_3_2_1_9_1","unstructured":"Dongchen Han Xuran Pan Yizeng Han Shiji Song and Gao Huang. 2023. Flatten transformer: Vision transformer using focused linear attention. In CVPR."},{"key":"e_1_3_2_1_10_1","unstructured":"Bobby He and Thomas Hofmann. 2024. Simplifying Transformer Blocks. In ICLR."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401063"},{"key":"e_1_3_2_1_12_1","unstructured":"Siyuan Huang Yunchong Song Jiayue Zhou and Zhouhan Lin. 2023. Tailoring Self-Attention for Graph via Rooted Subtrees. In NeurIPS."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467408"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Md Shamim Hussain Mohammed J Zaki and Dharmashankar Subramanian. 2022. Global self-attention as a replacement for graph convolution. In KDD.","DOI":"10.1145\/3534678.3539296"},{"key":"e_1_3_2_1_15_1","volume-title":"Llm maybe longlm: Self-extend llm context window without tuning. arXiv preprint arXiv:2401.01325","author":"Jin Hongye","year":"2024","unstructured":"Hongye Jin, Xiaotian Han, Jingfeng Yang, Zhimeng Jiang, Zirui Liu, Chia-Yuan Chang, Huiyuan Chen, and Xia Hu. 2024. Llm maybe longlm: Self-extend llm context window without tuning. arXiv preprint arXiv:2401.01325 (2024)."},{"key":"e_1_3_2_1_16_1","unstructured":"Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas and Francc ois Fleuret. 2020. Transformers are rnns: Fast autoregressive transformers with linear attention. In ICML."},{"key":"e_1_3_2_1_17_1","unstructured":"Jinwoo Kim Dat Nguyen Seonwoo Min Sungjun Cho Moontae Lee Honglak Lee and Seunghoon Hong. 2022. Pure transformers are powerful graph learners. In NeurIPS."},{"key":"e_1_3_2_1_18_1","volume-title":"Reformer: The Efficient Transformer. In ICLR.","author":"Kitaev Nikita","year":"2019","unstructured":"Nikita Kitaev, Lukasz Kaiser, and Anselm Levskaya. 2019. Reformer: The Efficient Transformer. In ICLR."},{"key":"e_1_3_2_1_19_1","unstructured":"Devin Kreuzer Dominique Beaini William L Hamilton Vincent L\u00e9tourneau and Prudencio Tossou. 2021. Rethinking Graph Transformers with Spectral Attention. In NeurIPS."},{"key":"e_1_3_2_1_20_1","volume-title":"Minghua Xu, Yiwei Cai, and Hao Yang.","author":"Lai Vivian","year":"2023","unstructured":"Vivian Lai, Huiyuan Chen, Chin-Chia Michael Yeh, Minghua Xu, Yiwei Cai, and Hao Yang. 2023. Enhancing Transformers without Self-supervised Learning: A Loss Landscape Perspective in Sequential Recommendation. In RecSys."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Chaoliu Li Lianghao Xia Xubin Ren Yaowen Ye Yong Xu and Chao Huang. 2023. Graph Transformer for Recommendation. In SIGIR.","DOI":"10.1145\/3539618.3591723"},{"key":"e_1_3_2_1_22_1","unstructured":"Qimai Li Zhichao Han and Xiao-Ming Wu. 2018. Deeper insights into graph convolutional networks for semi-supervised learning. In AAAI."},{"key":"e_1_3_2_1_23_1","unstructured":"Zhu Li Jean-Francois Ton Dino Oglic and Dino Sejdinovic. 2019. Towards a unified analysis of random Fourier features. In ICML."},{"key":"e_1_3_2_1_24_1","unstructured":"Liheng Ma Chen Lin Derek Lim Adriana Romero-Soriano Puneet K. Dokania Mark Coates Philip H.S. Torr and Ser-Nam Lim. 2023. Graph inductive biases in transformers without message passing. In ICML."},{"key":"e_1_3_2_1_25_1","unstructured":"Kelong Mao Jieming Zhu Xi Xiao Biao Lu Zhaowei Wang and Xiuqiang He. 2021. UltraGCN: ultra simplification of graph convolutional networks for recommendation. In CIKM."},{"key":"e_1_3_2_1_26_1","unstructured":"Zhen Qin Weixuan Sun Hui Deng Dongxu Li Yunshen Wei Baohong Lv Junjie Yan Lingpeng Kong and Yiran Zhong. 2022. cosFormer: Rethinking Softmax In Attention. In ICLR."},{"key":"e_1_3_2_1_27_1","volume":"202","author":"Raffel Colin","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. The Journal of Machine Learning Research (2020).","journal-title":"Peter J Liu."},{"key":"e_1_3_2_1_28_1","volume-title":"Anh Tuan Luu, Guy Wolf, and Dominique Beaini.","author":"Ladislav Ramp\u00e1vs","year":"2022","unstructured":"Ladislav Ramp\u00e1vs ek, Michael Galkin, Vijay Prakash Dwivedi, Anh Tuan Luu, Guy Wolf, and Dominique Beaini. 2022. Recipe for a general, powerful, scalable graph transformer. In NeurIPS."},{"key":"e_1_3_2_1_29_1","volume-title":"Valerii Likhosherstov, and Adrian Weller.","author":"Reid Isaac","year":"2023","unstructured":"Isaac Reid, Krzysztof Marcin Choromanski, Valerii Likhosherstov, and Adrian Weller. 2023. Simplex random features. In ICML."},{"key":"e_1_3_2_1_30_1","volume-title":"Proceedings of the 25th conference on uncertainty in artificial intelligence.","author":"Rendle Steffen","year":"2009","unstructured":"Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th conference on uncertainty in artificial intelligence."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Peter Shaw Jakob Uszkoreit and Ashish Vaswani. 2018. Self-Attention with Relative Position Representations. In NAACL-HLT.","DOI":"10.18653\/v1\/N18-2074"},{"key":"e_1_3_2_1_32_1","volume-title":"Exphormer: Sparse transformers for graphs. In ICML.","author":"Shirzad Hamed","year":"2023","unstructured":"Hamed Shirzad, Ameya Velingker, Balaji Venkatachalam, Danica J Sutherland, and Ali Kemal Sinop. 2023. Exphormer: Sparse transformers for graphs. In ICML."},{"key":"e_1_3_2_1_33_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In NeurIPS."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Chenyang Wang Yuanqing Yu Weizhi Ma Min Zhang Chong Chen Yiqun Liu and Shaoping Ma. 2022a. Towards Representation Alignment and Uniformity in Collaborative Filtering. In KDD.","DOI":"10.1145\/3534678.3539253"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3580305.3599347"},{"key":"e_1_3_2_1_36_1","volume-title":"Linformer: Self-attention with linear complexity. arXiv preprint arXiv:2006.04768","author":"Wang Sinong","year":"2020","unstructured":"Sinong Wang, Belinda Z Li, Madian Khabsa, Han Fang, and Hao Ma. 2020. Linformer: Self-attention with linear complexity. arXiv preprint arXiv:2006.04768 (2020)."},{"key":"e_1_3_2_1_37_1","unstructured":"Tongzhou Wang and Phillip Isola. 2020. Understanding contrastive representation learning through alignment and uniformity on the hypersphere. In ICML."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Yu Wang Yuying Zhao Yushun Dong Huiyuan Chen Jundong Li and Tyler Derr. 2022b. Improving fairness in graph neural networks via mitigating sensitive attribute leakage. In KDD.","DOI":"10.1145\/3534678.3539404"},{"key":"e_1_3_2_1_39_1","volume-title":"Lightgt: A light graph transformer for multimedia recommendation. In SIGIR.","author":"Wei Yinwei","year":"2023","unstructured":"Yinwei Wei, Wenqi Liu, Fan Liu, Xiang Wang, Liqiang Nie, and Tat-Seng Chua. 2023. Lightgt: A light graph transformer for multimedia recommendation. In SIGIR."},{"key":"e_1_3_2_1_40_1","unstructured":"Jiancan Wu Xiang Wang Fuli Feng Xiangnan He Liang Chen Jianxun Lian and Xing Xie. 2021. Self-supervised graph learning for recommendation. In SIGIR."},{"key":"e_1_3_2_1_41_1","volume-title":"Nodeformer: A scalable graph structure learning transformer for node classification. In NeurIPS.","author":"Wu Qitian","year":"2022","unstructured":"Qitian Wu, Wentao Zhao, Zenan Li, David P Wipf, and Junchi Yan. 2022. Nodeformer: A scalable graph structure learning transformer for node classification. In NeurIPS."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Zhe Xu Yuzhong Chen Menghai Pan Huiyuan Chen Mahashweta Das Hao Yang and Hanghang Tong. 2023. Kernel Ridge Regression-Based Graph Dataset Distillation. In KDD.","DOI":"10.1145\/3580305.3599398"},{"key":"e_1_3_2_1_43_1","unstructured":"Yuchen Yan Yuzhong Chen Huiyuan Chen Minghua Xu Mahashweta Das Hao Yang and Hanghang Tong. 2023. From Trainable Negative Depth to Edge Heterophily in Graphs. In NeurIPS."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3589334.3645516"},{"key":"e_1_3_2_1_45_1","unstructured":"Chin-Chia Michael Yeh Xin Dai Huiyuan Chen Yan Zheng Yujie Fan Audrey Der Vivian Lai Zhongfang Zhuang Junpeng Wang Liang Wang et al. 2023. Toward a foundation model for time series data. In CIKM."},{"key":"e_1_3_2_1_46_1","unstructured":"Chin-Chia Michael Yeh Mengting Gu Yan Zheng Huiyuan Chen Javid Ebrahimi Zhongfang Zhuang Junpeng Wang Liang Wang and Wei Zhang. 2022. Embedding Compression with Hashing for Efficient Representation Learning in Large-Scale Graph. In KDD."},{"key":"e_1_3_2_1_47_1","unstructured":"Chengxuan Ying Tianle Cai Shengjie Luo Shuxin Zheng Guolin Ke Di He Yanming Shen and Tie-Yan Liu. 2021. Do transformers really perform badly for graph representation?. In NeurIPS."},{"key":"e_1_3_2_1_48_1","volume-title":"Krzysztof M Choromanski, Daniel N Holtmann-Rice, and Sanjiv Kumar.","author":"Yu Felix Xinnan X","year":"2016","unstructured":"Felix Xinnan X Yu, Ananda Theertha Suresh, Krzysztof M Choromanski, Daniel N Holtmann-Rice, and Sanjiv Kumar. 2016. Orthogonal random features. In NeurIPS."},{"key":"e_1_3_2_1_49_1","unstructured":"Junliang Yu Hongzhi Yin Xin Xia Tong Chen Lizhen Cui and Quoc Viet Hung Nguyen. 2022. Are graph augmentations necessary? simple graph contrastive learning for recommendation. In SIGIR."},{"key":"e_1_3_2_1_50_1","volume-title":"Joshua Ainslie, Chris Alberti, Santiago Ontanon, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, et al.","author":"Zaheer Manzil","year":"2020","unstructured":"Manzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontanon, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, et al. 2020. Big bird: Transformers for longer sequences. In NeurIPS."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"crossref","unstructured":"Yuying Zhao Yu Wang Yi Zhang Pamela Wisniewski Charu Aggarwal and Tyler Derr. 2024 a. Leveraging Opposite Gender Interaction Ratio as a Path towards Fairness in Online Dating Recommendations Based on User Sexual Orientation. In AAAI.","DOI":"10.1609\/aaai.v38i20.30263"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3589334.3645662"}],"event":{"name":"SIGIR 2024: The 47th International ACM SIGIR Conference on Research and Development in Information Retrieval","location":"Washington DC USA","acronym":"SIGIR 2024","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3626772.3657971","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3626772.3657971","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T05:18:59Z","timestamp":1755839939000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3626772.3657971"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,10]]},"references-count":52,"alternative-id":["10.1145\/3626772.3657971","10.1145\/3626772"],"URL":"https:\/\/doi.org\/10.1145\/3626772.3657971","relation":{},"subject":[],"published":{"date-parts":[[2024,7,10]]},"assertion":[{"value":"2024-07-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}