{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T15:20:56Z","timestamp":1777130456132,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":22,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,8,23]]},"DOI":"10.1145\/3394486.3403262","type":"proceedings-article","created":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T23:03:59Z","timestamp":1597964639000},"page":"2114-2124","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":39,"title":["On Sampling Top-K Recommendation Evaluation"],"prefix":"10.1145","author":[{"given":"Dong","family":"Li","sequence":"first","affiliation":[{"name":"Kent State University, Kent, OH, USA"}]},{"given":"Ruoming","family":"Jin","sequence":"additional","affiliation":[{"name":"Kent State University, Kent, OH, USA"}]},{"given":"Jing","family":"Gao","sequence":"additional","affiliation":[{"name":"iLambda, Aurora, OH, USA"}]},{"given":"Zhi","family":"Liu","sequence":"additional","affiliation":[{"name":"iLambda, Aurora, OH, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,8,20]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"crossref","unstructured":"Immanuel Bayer X. He B. Kanagal and S. Rendle. 2017. A Generic Coordinate Descent Framework for Learning from Implicit Feedback. In WWW'17.  Immanuel Bayer X. He B. Kanagal and S. Rendle. 2017. A Generic Coordinate Descent Framework for Learning from Implicit Feedback. In WWW'17.","DOI":"10.1145\/3038912.3052694"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"crossref","unstructured":"Paolo Cremonesi Yehuda Koren and Roberto Turrin. 2010. Performance of Recommender Algorithms on Top-n Recommendation Tasks. In RecSys'10.  Paolo Cremonesi Yehuda Koren and Roberto Turrin. 2010. Performance of Recommender Algorithms on Top-n Recommendation Tasks. In RecSys'10.","DOI":"10.1145\/1864708.1864721"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Maurizio Ferrari Dacrema P. Cremonesi and D. Jannach. 2019. Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches. In RecSys'19.  Maurizio Ferrari Dacrema P. Cremonesi and D. Jannach. 2019. Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches. In RecSys'19.","DOI":"10.1145\/3298689.3347058"},{"key":"e_1_3_2_2_4_1","unstructured":"Mukund Deshpande and George Karypis. 2004. Item-Based Top-N Recommendation Algorithms. ACM Trans. Inf. Syst. (2004).  Mukund Deshpande and George Karypis. 2004. Item-Based Top-N Recommendation Algorithms. ACM Trans. Inf. Syst. (2004)."},{"key":"e_1_3_2_2_5_1","volume-title":"Collaborative Memory Network for Recommendation Systems. In SIGIR'18","author":"Ebesu Travis","year":"2018","unstructured":"Travis Ebesu , Bin Shen , and Yi Fang . 2018 . Collaborative Memory Network for Recommendation Systems. In SIGIR'18 . Travis Ebesu, Bin Shen, and Yi Fang. 2018. Collaborative Memory Network for Recommendation Systems. In SIGIR'18."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Ali Mamdouh Elkahky Y. Song and X. He. 2015. A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems. In WWW'15.  Ali Mamdouh Elkahky Y. Song and X. He. 2015. A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems. In WWW'15.","DOI":"10.1145\/2736277.2741667"},{"key":"e_1_3_2_2_7_1","unstructured":"Xiangnan He L. Liao H. Zhang L. Nie X. Hu and T. Chua. 2017. Neural Collaborative Filtering. In WWW'17.  Xiangnan He L. Liao H. Zhang L. Nie X. Hu and T. Chua. 2017. Neural Collaborative Filtering. In WWW'17."},{"key":"e_1_3_2_2_8_1","unstructured":"Binbin Hu C. Shi W. X. Zhao and P. S. Yu. 2018. Leveraging Meta-Path Based Context for Top- N Recommendation with A Neural Co-Attention Model. In KDD'18.  Binbin Hu C. Shi W. X. Zhao and P. S. Yu. 2018. Leveraging Meta-Path Based Context for Top- N Recommendation with A Neural Co-Attention Model. In KDD'18."},{"key":"e_1_3_2_2_9_1","volume-title":"ICDM'08","author":"Hu Y.","unstructured":"Y. Hu , Y. Koren , and C. Volinsky . 2008. Collaborative filtering for implicit feedback datasets . In ICDM'08 . Y. Hu, Y. Koren, and C. Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In ICDM'08."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401944"},{"key":"e_1_3_2_2_11_1","volume-title":"ICLR'2019","author":"Krichene Walid","unstructured":"Walid Krichene , N. Mayoraz , S. Rendle , L. Zhang , X. Yi , L. Hong , Ed H. Chi , and J. R. Anderson . 2019. Efficient Training on Very Large Corpora via Gramian Estimation . In ICLR'2019 . Walid Krichene, N. Mayoraz, S. Rendle, L. Zhang, X. Yi, L. Hong, Ed H. Chi, and J. R. Anderson. 2019. Efficient Training on Very Large Corpora via Gramian Estimation. In ICLR'2019."},{"key":"e_1_3_2_2_12_1","unstructured":"Wentian Li Pedro Miramontes and Cocho Germinal. 2010. Fitting Ranked Linguistic Data with Two-Parameter Functions. (2010).  Wentian Li Pedro Miramontes and Cocho Germinal. 2010. Fitting Ranked Linguistic Data with Two-Parameter Functions. (2010)."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Dawen Liang R. G. Krishnan M. D. Hoffman and T. Jebara. 2018. Variational Autoencoders for Collaborative Filtering. In WWW'18.  Dawen Liang R. G. Krishnan M. D. Hoffman and T. Jebara. 2018. Variational Autoencoders for Collaborative Filtering. In WWW'18.","DOI":"10.1145\/3178876.3186150"},{"key":"e_1_3_2_2_14_1","volume-title":"Signals and Systems","author":"Rao K. Deergha","unstructured":"K. Deergha Rao . 2018. Signals and Systems . Springer International Publishing . K. Deergha Rao. 2018. Signals and Systems .Springer International Publishing."},{"key":"e_1_3_2_2_15_1","volume-title":"Evaluation Metrics for Item Recommendation under Sampling. arxiv","author":"Rendle Steffen","year":"1912","unstructured":"Steffen Rendle . 2019. Evaluation Metrics for Item Recommendation under Sampling. arxiv : 1912 .02263 Steffen Rendle. 2019. Evaluation Metrics for Item Recommendation under Sampling. arxiv: 1912.02263"},{"key":"e_1_3_2_2_16_1","unstructured":"Steffen Rendle Li Zhang and Yehuda Koren. 2019. On the Difficulty of Evaluating Baselines: A Study on Recommender Systems. (2019).  Steffen Rendle Li Zhang and Yehuda Koren. 2019. On the Difficulty of Evaluating Baselines: A Study on Recommender Systems. (2019)."},{"key":"e_1_3_2_2_17_1","volume-title":"Embarrassingly Shallow Autoencoders for Sparse Data. WWW'19","author":"Steck Harald","year":"2019","unstructured":"Harald Steck . 2019 . Embarrassingly Shallow Autoencoders for Sparse Data. WWW'19 (2019). Harald Steck. 2019. Embarrassingly Shallow Autoencoders for Sparse Data. WWW'19 (2019)."},{"key":"e_1_3_2_2_18_1","volume-title":"Neural Graph Collaborative Filtering. SIGIR'19","author":"Wang Xiang","year":"2019","unstructured":"Xiang Wang , Xiangnan He , Meng Wang , Fuli Feng , and Tat-Seng Chua . 2019 a . Neural Graph Collaborative Filtering. SIGIR'19 (2019). Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019 a. Neural Graph Collaborative Filtering. SIGIR'19 (2019)."},{"key":"e_1_3_2_2_19_1","volume-title":"The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI2019","author":"Wang Xiang","unstructured":"Xiang Wang , D. Wang , C. Xu , X. He , Y. Cao , and T. Chua . 2019 b. Explainable Reasoning over Knowledge Graphs for Recommendation . In The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI2019 . Xiang Wang, D. Wang, C. Xu, X. He, Y. Cao, and T. Chua. 2019 b. Explainable Reasoning over Knowledge Graphs for Recommendation. In The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI2019."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159681"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Longqi Yang Y. Cui Y. Xuan C. Wang S. J. Belongie and D. Estrin. 2018b. Unbiased Offline Recommender Evaluation for Missing-Not-at-Random Implicit Feedback. In RecSys'18.  Longqi Yang Y. Cui Y. Xuan C. Wang S. J. Belongie and D. Estrin. 2018b. Unbiased Offline Recommender Evaluation for Missing-Not-at-Random Implicit Feedback. In RecSys'18.","DOI":"10.1145\/3240323.3240355"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Shuai Zhang Lina Yao Aixin Sun and Yi Tay. 2019. Deep Learning Based Recommender System: A Survey and New Perspectives. ACM Comput. Surv. (2019).  Shuai Zhang Lina Yao Aixin Sun and Yi Tay. 2019. Deep Learning Based Recommender System: A Survey and New Perspectives. ACM Comput. Surv. (2019).","DOI":"10.1145\/3285029"}],"event":{"name":"KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Virtual Event CA USA","acronym":"KDD '20","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3403262","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394486.3403262","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:01:47Z","timestamp":1750197707000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3403262"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,20]]},"references-count":22,"alternative-id":["10.1145\/3394486.3403262","10.1145\/3394486"],"URL":"https:\/\/doi.org\/10.1145\/3394486.3403262","relation":{},"subject":[],"published":{"date-parts":[[2020,8,20]]},"assertion":[{"value":"2020-08-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}