{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:21:55Z","timestamp":1750220515118,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T00:00:00Z","timestamp":1618790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,19]]},"DOI":"10.1145\/3442381.3449946","type":"proceedings-article","created":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T19:34:17Z","timestamp":1622748857000},"page":"1262-1273","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Linear-Time Self Attention with Codeword Histogram for Efficient Recommendation"],"prefix":"10.1145","author":[{"given":"Yongji","family":"Wu","sequence":"first","affiliation":[{"name":"Duke University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Defu","family":"Lian","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Neil Zhenqiang","family":"Gong","sequence":"additional","affiliation":[{"name":"Duke University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lu","family":"Yin","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingyang","family":"Yin","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingren","family":"Zhou","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongxia","family":"Yang","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,6,3]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Joshua Ainslie Santiago Ontanon Chris Alberti Philip Pham Anirudh Ravula Sumit Sanghai 2020. Encoding long and structured data in transformers. arXiv preprint arXiv:2004.08483(2020). Joshua Ainslie Santiago Ontanon Chris Alberti Philip Pham Anirudh Ravula Sumit Sanghai 2020. Encoding long and structured data in transformers. arXiv preprint arXiv:2004.08483(2020).","DOI":"10.18653\/v1\/2020.emnlp-main.19"},{"key":"e_1_3_2_1_2_1","volume-title":"Longformer: The long-document transformer. arXiv preprint arXiv:2004.05150(2020).","author":"Beltagy Iz","year":"2020","unstructured":"Iz Beltagy , Matthew\u00a0 E Peters , and Arman Cohan . 2020 . Longformer: The long-document transformer. arXiv preprint arXiv:2004.05150(2020). Iz Beltagy, Matthew\u00a0E Peters, and Arman Cohan. 2020. Longformer: The long-document transformer. arXiv preprint arXiv:2004.05150(2020)."},{"key":"e_1_3_2_1_3_1","unstructured":"Yoshua Bengio Nicholas L\u00e9onard and Aaron Courville. 2013. Estimating or propagating gradients through stochastic neurons for conditional computation. arXiv preprint arXiv:1308.3432(2013). Yoshua Bengio Nicholas L\u00e9onard and Aaron Courville. 2013. Estimating or propagating gradients through stochastic neurons for conditional computation. arXiv preprint arXiv:1308.3432(2013)."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1008"},{"key":"e_1_3_2_1_5_1","volume-title":"Learning K-way D-dimensional Discrete Codes for Compact Embedding Representations. In International Conference on Machine Learning. 854\u2013863","author":"Chen Ting","year":"2018","unstructured":"Ting Chen , Martin\u00a0Renqiang Min , and Yizhou Sun . 2018 . Learning K-way D-dimensional Discrete Codes for Compact Embedding Representations. In International Conference on Machine Learning. 854\u2013863 . Ting Chen, Martin\u00a0Renqiang Min, and Yizhou Sun. 2018. Learning K-way D-dimensional Discrete Codes for Compact Embedding Representations. In International Conference on Machine Learning. 854\u2013863."},{"key":"e_1_3_2_1_6_1","unstructured":"Rewon Child Scott Gray Alec Radford and Ilya Sutskever. 2019. Generating long sequences with sparse transformers. arXiv preprint arXiv:1904.10509(2019). Rewon Child Scott Gray Alec Radford and Ilya Sutskever. 2019. Generating long sequences with sparse transformers. arXiv preprint arXiv:1904.10509(2019)."},{"volume-title":"Introduction to algorithms","author":"Cormen H","key":"e_1_3_2_1_7_1","unstructured":"Thomas\u00a0 H Cormen , Charles\u00a0 E Leiserson , Ronald\u00a0 L Rivest , and Clifford Stein . 2009. Introduction to algorithms . MIT press . Thomas\u00a0H Cormen, Charles\u00a0E Leiserson, Ronald\u00a0L Rivest, and Clifford Stein. 2009. Introduction to algorithms. MIT press."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i01.5333"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1285"},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long and Short Papers). 4171\u20134186. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 4171\u20134186."},{"key":"e_1_3_2_1_11_1","volume-title":"Object detection with discriminatively trained part-based models","author":"Felzenszwalb F","year":"2009","unstructured":"Pedro\u00a0 F Felzenszwalb , Ross\u00a0 B Girshick , David McAllester , and Deva Ramanan . 2009. Object detection with discriminatively trained part-based models . IEEE transactions on pattern analysis and machine intelligence 32, 9( 2009 ), 1627\u20131645. Pedro\u00a0F Felzenszwalb, Ross\u00a0B Girshick, David McAllester, and Deva Ramanan. 2009. Object detection with discriminatively trained part-based models. IEEE transactions on pattern analysis and machine intelligence 32, 9(2009), 1627\u20131645."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.240"},{"key":"e_1_3_2_1_13_1","volume-title":"IEEE transactions on information theory 44, 6","author":"Gray M.","year":"1998","unstructured":"Robert\u00a0 M. Gray and David\u00a0 L. Neuhoff . 1998. Quantization. IEEE transactions on information theory 44, 6 ( 1998 ), 2325\u20132383. Robert\u00a0M. Gray and David\u00a0L. Neuhoff. 1998. Quantization. IEEE transactions on information theory 44, 6 (1998), 2325\u20132383."},{"key":"e_1_3_2_1_14_1","unstructured":"Ruiqi Guo Sanjiv Kumar Krzysztof Choromanski and David Simcha. 2016. Quantization based fast inner product search. In Artificial Intelligence and Statistics. 482\u2013490. Ruiqi Guo Sanjiv Kumar Krzysztof Choromanski and David Simcha. 2016. Quantization based fast inner product search. In Artificial Intelligence and Statistics. 482\u2013490."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2827872"},{"key":"e_1_3_2_1_16_1","unstructured":"Anna Huang Monica Dinculescu Ashish Vaswani and Douglas Eck. 2018. Visualizing Music Self-Attention. (2018). Anna Huang Monica Dinculescu Ashish Vaswani and Douglas Eck. 2018. Visualizing Music Self-Attention. (2018)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.57"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2018.00035"},{"key":"e_1_3_2_1_19_1","volume-title":"Reformer: The Efficient Transformer. In International Conference on Learning Representations.","author":"Kitaev Nikita","year":"2019","unstructured":"Nikita Kitaev , Lukasz Kaiser , and Anselm Levskaya . 2019 . Reformer: The Efficient Transformer. In International Conference on Learning Representations. Nikita Kitaev, Lukasz Kaiser, and Anselm Levskaya. 2019. Reformer: The Efficient Transformer. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_20_1","volume-title":"International Conference on Computer Science, Engineering and Education Applications. Springer International Publishing, 658\u2013668","author":"Kochura Yuriy","year":"2019","unstructured":"Yuriy Kochura , Yuri Gordienko , Vlad Taran , Nikita Gordienko , Alexandr Rokovyi , Oleg Alienin , and Sergii Stirenko . 2019 . Batch size influence on performance of graphic and tensor processing units during training and inference phases . In International Conference on Computer Science, Engineering and Education Applications. Springer International Publishing, 658\u2013668 . Yuriy Kochura, Yuri Gordienko, Vlad Taran, Nikita Gordienko, Alexandr Rokovyi, Oleg Alienin, and Sergii Stirenko. 2019. Batch size influence on performance of graphic and tensor processing units during training and inference phases. In International Conference on Computer Science, Engineering and Education Applications. Springer International Publishing, 658\u2013668."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.263"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/322217.322232"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380187"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380151"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403252"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Ali Madani Bryan McCann Nikhil Naik Nitish\u00a0Shirish Keskar Namrata Anand Raphael\u00a0R Eguchi Po-Ssu Huang and Richard Socher. 2020. ProGen: Language Modeling for Protein Generation. arXiv preprint arXiv:2004.03497(2020). Ali Madani Bryan McCann Nikhil Naik Nitish\u00a0Shirish Keskar Namrata Anand Raphael\u00a0R Eguchi Po-Ssu Huang and Richard Socher. 2020. ProGen: Language Modeling for Protein Generation. arXiv preprint arXiv:2004.03497(2020).","DOI":"10.1101\/2020.03.07.982272"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1018"},{"key":"e_1_3_2_1_28_1","unstructured":"Aurko Roy Mohammad Saffar Ashish Vaswani and David Grangier. 2020. Efficient content-based sparse attention with routing transformers. arXiv preprint arXiv:2003.05997(2020). Aurko Roy Mohammad Saffar Ashish Vaswani and David Grangier. 2020. Efficient content-based sparse attention with routing transformers. arXiv preprint arXiv:2003.05997(2020)."},{"key":"e_1_3_2_1_29_1","unstructured":"Anshumali Shrivastava and Ping Li. 2014. Asymmetric LSH (ALSH) for sublinear time maximum inner product search (MIPS). In Advances in neural information processing systems. 2321\u20132329. Anshumali Shrivastava and Ping Li. 2014. Asymmetric LSH (ALSH) for sublinear time maximum inner product search (MIPS). In Advances in neural information processing systems. 2321\u20132329."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1032"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357895"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159656"},{"key":"e_1_3_2_1_33_1","volume-title":"Sparse Sinkhorn Attention. In International Conference on Machine Learning.","author":"Tay Yi","year":"2020","unstructured":"Yi Tay , Dara Bahri , Liu Yang , Donald Metzler , and Da-Cheng Juan . 2020 . Sparse Sinkhorn Attention. In International Conference on Machine Learning. Yi Tay, Dara Bahri, Liu Yang, Donald Metzler, and Da-Cheng Juan. 2020. Sparse Sinkhorn Attention. In International Conference on Machine Learning."},{"key":"e_1_3_2_1_34_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan\u00a0N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998\u20136008. Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan\u00a0N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998\u20136008."},{"key":"e_1_3_2_1_35_1","unstructured":"Petar Veli\u010dkovi\u0107 Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio and Yoshua Bengio. 2017. Graph attention networks. arXiv preprint arXiv:1710.10903(2017). Petar Veli\u010dkovi\u0107 Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio and Yoshua Bengio. 2017. Graph attention networks. arXiv preprint arXiv:1710.10903(2017)."},{"key":"e_1_3_2_1_36_1","unstructured":"Apoorv Vyas Angelos Katharopoulos and Fran\u00e7ois Fleuret. 2020. Fast Transformers with Clustered Attention. Advances in Neural Information Processing Systems. Apoorv Vyas Angelos Katharopoulos and Fran\u00e7ois Fleuret. 2020. Fast Transformers with Clustered Attention. Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_37_1","volume-title":"Linformer: Self-Attention with Linear Complexity. arXiv preprint arXiv:2006.04768(2020).","author":"Wang Sinong","year":"2020","unstructured":"Sinong Wang , Belinda Li , Madian Khabsa , Han Fang , and Hao Ma . 2020 . Linformer: Self-Attention with Linear Complexity. arXiv preprint arXiv:2006.04768(2020). Sinong Wang, Belinda Li, Madian Khabsa, Han Fang, and Hao Ma. 2020. Linformer: Self-Attention with Linear Complexity. arXiv preprint arXiv:2006.04768(2020)."},{"key":"e_1_3_2_1_38_1","volume-title":"Non-local Neural Networks. In 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 7794\u20137803","author":"Wang Xiaolong","year":"2018","unstructured":"Xiaolong Wang , Ross Girshick , Abhinav Gupta , and Kaiming He . 2018 . Non-local Neural Networks. In 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 7794\u20137803 . Xiaolong Wang, Ross Girshick, Abhinav Gupta, and Kaiming He. 2018. Non-local Neural Networks. In 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 7794\u20137803."},{"key":"e_1_3_2_1_39_1","unstructured":"Markus Weimer Alexandros Karatzoglou Quoc\u00a0V Le and Alex\u00a0J Smola. 2008. CoFI Rank - Maximum Margin Matrix Factorization for Collaborative Ranking. In Advances in Neural Information Processing Systems. 1593\u20131600. Markus Weimer Alexandros Karatzoglou Quoc\u00a0V Le and Alex\u00a0J Smola. 2008. CoFI Rank - Maximum Margin Matrix Factorization for Collaborative Ranking. In Advances in Neural Information Processing Systems. 1593\u20131600."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"crossref","unstructured":"Jiannan Xiang Xin\u00a0Eric Wang and William\u00a0Yang Wang. 2020. Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation. arXiv preprint arXiv:2009.13112(2020). Jiannan Xiang Xin\u00a0Eric Wang and William\u00a0Yang Wang. 2020. Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation. arXiv preprint arXiv:2009.13112(2020).","DOI":"10.18653\/v1\/2020.findings-emnlp.62"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Chengfeng Xu Pengpeng Zhao Yanchi Liu Victor\u00a0S Sheng Jiajie Xu Fuzhen Zhuang Junhua Fang and Xiaofang Zhou. 2019. Graph Contextualized Self-Attention Network for Session-based Recommendation.. In IJCAI. 3940\u20133946. Chengfeng Xu Pengpeng Zhao Yanchi Liu Victor\u00a0S Sheng Jiajie Xu Fuzhen Zhuang Junhua Fang and Xiaofang Zhou. 2019. Graph Contextualized Self-Attention Network for Session-based Recommendation.. In IJCAI. 3940\u20133946.","DOI":"10.24963\/ijcai.2019\/547"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403172"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3290609"},{"key":"e_1_3_2_1_44_1","unstructured":"Manzil Zaheer Guru Guruganesh Avinava Dubey Joshua Ainslie Chris Alberti Santiago Ontanon Philip Pham Anirudh Ravula Qifan Wang Li Yang 2020. Big bird: Transformers for longer sequences. arXiv preprint arXiv:2007.14062(2020). Manzil Zaheer Guru Guruganesh Avinava Dubey Joshua Ainslie Chris Alberti Santiago Ontanon Philip Pham Anirudh Ravula Qifan Wang Li Yang 2020. Big bird: Transformers for longer sequences. arXiv preprint arXiv:2007.14062(2020)."},{"key":"e_1_3_2_1_45_1","volume-title":"International Conference on Machine Learning. PMLR, 7354\u20137363","author":"Zhang Han","year":"2019","unstructured":"Han Zhang , Ian Goodfellow , Dimitris Metaxas , and Augustus Odena . 2019 . Self-attention generative adversarial networks . In International Conference on Machine Learning. PMLR, 7354\u20137363 . Han Zhang, Ian Goodfellow, Dimitris Metaxas, and Augustus Odena. 2019. Self-attention generative adversarial networks. In International Conference on Machine Learning. PMLR, 7354\u20137363."},{"key":"e_1_3_2_1_46_1","unstructured":"Shuai Zhang Yi Tay Lina Yao and Aixin Sun. 2018. Next item recommendation with self-attention. arXiv preprint arXiv:1808.06414(2018). Shuai Zhang Yi Tay Lina Yao and Aixin Sun. 2018. Next item recommendation with self-attention. arXiv preprint arXiv:1808.06414(2018)."}],"event":{"name":"WWW '21: The Web Conference 2021","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"],"location":"Ljubljana Slovenia","acronym":"WWW '21"},"container-title":["Proceedings of the Web Conference 2021"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3449946","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442381.3449946","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:32Z","timestamp":1750195472000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3449946"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,19]]},"references-count":46,"alternative-id":["10.1145\/3442381.3449946","10.1145\/3442381"],"URL":"https:\/\/doi.org\/10.1145\/3442381.3449946","relation":{},"subject":[],"published":{"date-parts":[[2021,4,19]]},"assertion":[{"value":"2021-06-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}