{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T06:58:20Z","timestamp":1776063500420,"version":"3.50.1"},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,8]]},"abstract":"<jats:p>In implicit feedback-based recommender systems, user exposure data, which record whether or not a recommended item has been interacted by a user, provide an important clue on selecting negative training samples. In this work, we improve the negative sampler by integrating the exposure data. We propose to generate high-quality negative instances by adversarial training to favour the dif\ufb01cult instances, and by optimizing additional objective to favour the real negatives in exposure data. However, this idea is non-trivial to implement since the distribution of exposure data is latent and the item space is discrete. To this end, we design a novel RNS method (short for Reinforced Negative Sampler) that generates exposure-alike negative instances through feature matching technique instead of directly choosing from exposure data. Optimized under the reinforcement learning framework, RNS is able to integrate user preference signals in exposure data and hard negatives. Extensive experiments on two real-world datasets demonstrate the effectiveness and rationality of our RNS method. Our implementation is available at: https:\/\/github. com\/dingjingtao\/ReinforceNS.<\/jats:p>","DOI":"10.24963\/ijcai.2019\/309","type":"proceedings-article","created":{"date-parts":[[2019,7,28]],"date-time":"2019-07-28T03:46:05Z","timestamp":1564285565000},"page":"2230-2236","source":"Crossref","is-referenced-by-count":101,"title":["Reinforced Negative Sampling for Recommendation with Exposure Data"],"prefix":"10.24963","author":[{"given":"Jingtao","family":"Ding","sequence":"first","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology (BNRist)"},{"name":"Department of Electronic Engineering, Tsinghua University"}]},{"given":"Yuhan","family":"Quan","sequence":"additional","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology (BNRist)"},{"name":"Department of Electronic Engineering, Tsinghua University"}]},{"given":"Xiangnan","family":"He","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, University of Science and Technology of China"}]},{"given":"Yong","family":"Li","sequence":"additional","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology (BNRist)"},{"name":"Department of Electronic Engineering, Tsinghua University"}]},{"given":"Depeng","family":"Jin","sequence":"additional","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology (BNRist)"},{"name":"Department of Electronic Engineering, Tsinghua University"}]}],"member":"10584","event":{"name":"Twenty-Eighth International Joint Conference on Artificial Intelligence {IJCAI-19}","theme":"Artificial Intelligence","location":"Macao, China","acronym":"IJCAI-2019","number":"28","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"start":{"date-parts":[[2019,8,10]]},"end":{"date-parts":[[2019,8,16]]}},"container-title":["Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2019,7,28]],"date-time":"2019-07-28T03:48:26Z","timestamp":1564285706000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2019\/309"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2019,8]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2019\/309","relation":{},"subject":[],"published":{"date-parts":[[2019,8]]}}}