{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T13:50:07Z","timestamp":1778161807465,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":40,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,4,20]],"date-time":"2020-04-20T00:00:00Z","timestamp":1587340800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,4,20]]},"DOI":"10.1145\/3366423.3380178","type":"proceedings-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T08:11:44Z","timestamp":1588579904000},"page":"995-1005","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Learning from Cross-Modal Behavior Dynamics with Graph-Regularized Neural Contextual Bandit"],"prefix":"10.1145","author":[{"given":"Xian","family":"Wu","sequence":"first","affiliation":[{"name":"university of notre dame, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Suleyman","family":"Cetintas","sequence":"additional","affiliation":[{"name":"Yahoo Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Deguang","family":"Kong","sequence":"additional","affiliation":[{"name":"Google, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Miao","family":"Lu","sequence":"additional","affiliation":[{"name":"Yahoo Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian","family":"Yang","sequence":"additional","affiliation":[{"name":"Yahoo Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nitesh","family":"Chawla","sequence":"additional","affiliation":[{"name":"University of Notre Dame, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,4,20]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Nicolo Cesa-Bianchi Claudio Gentile and Giovanni Zappella. 2013. A gang of bandits. In NIPS. 737\u2013745.  Nicolo Cesa-Bianchi Claudio Gentile and Giovanni Zappella. 2013. A gang of bandits. In NIPS. 737\u2013745."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Jingyuan Chen Hanwang Zhang Xiangnan He Liqiang Nie Wei Liu and Tat-Seng Chua. 2017. Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In SIGIR. ACM 335\u2013344.  Jingyuan Chen Hanwang Zhang Xiangnan He Liqiang Nie Wei Liu and Tat-Seng Chua. 2017. Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In SIGIR. ACM 335\u2013344.","DOI":"10.1145\/3077136.3080797"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Heng-Tze Cheng Levent Koc Jeremiah Harmsen Tal Shaked Tushar Chandra Hrishi Aradhye Glen Anderson Greg Corrado Wei Chai Mustafa Ispir 2016. Wide & deep learning for recommender systems. In RecSys. ACM 7\u201310.  Heng-Tze Cheng Levent Koc Jeremiah Harmsen Tal Shaked Tushar Chandra Hrishi Aradhye Glen Anderson Greg Corrado Wei Chai Mustafa Ispir 2016. Wide & deep learning for recommender systems. In RecSys. ACM 7\u201310.","DOI":"10.1145\/2988450.2988454"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"crossref","unstructured":"Yuxiao Dong Nitesh\u00a0V Chawla 2017. metapath2vec: Scalable representation learning for heterogeneous networks. In KDD. ACM 135\u2013144.  Yuxiao Dong Nitesh\u00a0V Chawla 2017. metapath2vec: Scalable representation learning for heterogeneous networks. In KDD. ACM 135\u2013144.","DOI":"10.1145\/3097983.3098036"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11063-013-9334-5"},{"key":"e_1_3_2_1_6_1","volume-title":"Uncertainty in deep learning","author":"Gal Yarin","unstructured":"Yarin Gal . 2016. Uncertainty in deep learning . University of Cambridge(2016) . Yarin Gal. 2016. Uncertainty in deep learning. University of Cambridge(2016)."},{"key":"e_1_3_2_1_7_1","unstructured":"Yarin Gal and Zoubin Ghahramani. 2016. Dropout as a Bayesian approximation: Representing model uncertainty in deep learning. In ICML. 1050\u20131059.  Yarin Gal and Zoubin Ghahramani. 2016. Dropout as a Bayesian approximation: Representing model uncertainty in deep learning. In ICML. 1050\u20131059."},{"key":"e_1_3_2_1_8_1","unstructured":"Claudio Gentile Shuai Li Purushottam Kar Alexandros Karatzoglou Giovanni Zappella and Evans Etrue. 2017. On context-dependent clustering of bandits. In ICML. JMLR. org 1253\u20131262.  Claudio Gentile Shuai Li Purushottam Kar Alexandros Karatzoglou Giovanni Zappella and Evans Etrue. 2017. On context-dependent clustering of bandits. In ICML. JMLR. org 1253\u20131262."},{"key":"e_1_3_2_1_9_1","unstructured":"Claudio Gentile Shuai Li and Giovanni Zappella. 2014. Online clustering of bandits. In ICML. 757\u2013765.  Claudio Gentile Shuai Li and Giovanni Zappella. 2014. Online clustering of bandits. In ICML. 757\u2013765."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Mihajlo Grbovic Nemanja Djuric Vladan Radosavljevic Fabrizio Silvestri and Narayan Bhamidipati. 2015. Context- and content-aware embeddings for query rewriting in sponsored search. In SIGIR. ACM 383\u2013392.  Mihajlo Grbovic Nemanja Djuric Vladan Radosavljevic Fabrizio Silvestri and Narayan Bhamidipati. 2015. Context- and content-aware embeddings for query rewriting in sponsored search. In SIGIR. ACM 383\u2013392.","DOI":"10.1145\/2766462.2767709"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In KDD. ACM 855\u2013864.  Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In KDD. ACM 855\u2013864.","DOI":"10.1145\/2939672.2939754"},{"key":"e_1_3_2_1_12_1","unstructured":"Xiangnan He Lizi Liao Hanwang Zhang Liqiang Nie Xia Hu and Tat-Seng Chua. 2017. Neural collaborative filtering. In WWW. ACM 173\u2013182.  Xiangnan He Lizi Liao Hanwang Zhang Liqiang Nie Xia Hu and Tat-Seng Chua. 2017. Neural collaborative filtering. In WWW. ACM 173\u2013182."},{"key":"e_1_3_2_1_13_1","unstructured":"Xiangnan He Hanwang Zhang 2016. Fast matrix factorization for online recommendation with implicit feedback. In SIGIR. ACM 549\u2013558.  Xiangnan He Hanwang Zhang 2016. Fast matrix factorization for online recommendation with implicit feedback. In SIGIR. ACM 549\u2013558."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Katja Hofmann Anne Schuth 2013. Reusing historical interaction data for faster online learning to rank for IR. In WSDM. ACM 183\u2013192.  Katja Hofmann Anne Schuth 2013. Reusing historical interaction data for faster online learning to rank for IR. In WSDM. ACM 183\u2013192.","DOI":"10.1145\/2433396.2433419"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Cheng-Kang Hsieh Longqi Yang Yin Cui Tsung-Yi Lin Serge Belongie and Deborah Estrin. 2017. Collaborative metric learning. In WWW. ACM 193\u2013201.  Cheng-Kang Hsieh Longqi Yang Yin Cui Tsung-Yi Lin Serge Belongie and Deborah Estrin. 2017. Collaborative metric learning. In WWW. ACM 193\u2013201.","DOI":"10.1145\/3038912.3052639"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Alexandros Karatzoglou Xavier Amatriain Linas Baltrunas and Nuria Oliver. 2010. Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering. In Recsys. ACM 79\u201386.  Alexandros Karatzoglou Xavier Amatriain Linas Baltrunas and Nuria Oliver. 2010. Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering. In Recsys. ACM 79\u201386.","DOI":"10.1145\/1864708.1864727"},{"key":"e_1_3_2_1_17_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014).","author":"Kingma Diederik","year":"2014","unstructured":"Diederik Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014). Diederik Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014)."},{"key":"e_1_3_2_1_18_1","unstructured":"Nathan Korda Bal\u00e1zs Sz\u00f6r\u00e9nyi and Li Shuai. 2016. Distributed clustering of linear bandits in peer to peer networks. In JMLR Vol.\u00a048. International Machine Learning Societ 1301\u20131309.  Nathan Korda Bal\u00e1zs Sz\u00f6r\u00e9nyi and Li Shuai. 2016. Distributed clustering of linear bandits in peer to peer networks. In JMLR Vol.\u00a048. International Machine Learning Societ 1301\u20131309."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Lihong Li Wei Chu 2011. Unbiased offline evaluation of contextual-bandit-based news article recommendation algorithms. In WSDM. ACM 297\u2013306.  Lihong Li Wei Chu 2011. Unbiased offline evaluation of contextual-bandit-based news article recommendation algorithms. In WSDM. ACM 297\u2013306.","DOI":"10.1145\/1935826.1935878"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Lihong Li Wei Chu John Langford 2010. A contextual-bandit approach to personalized news article recommendation. In WWW. ACM 661\u2013670.  Lihong Li Wei Chu John Langford 2010. A contextual-bandit approach to personalized news article recommendation. In WWW. ACM 661\u2013670.","DOI":"10.1145\/1772690.1772758"},{"key":"e_1_3_2_1_21_1","unstructured":"Shuai Li Claudio Gentile and Alexandros Karatzoglou. 2016. Graph clustering bandits for recommendation. arXiv preprint arXiv:1605.00596(2016).  Shuai Li Claudio Gentile and Alexandros Karatzoglou. 2016. Graph clustering bandits for recommendation. arXiv preprint arXiv:1605.00596(2016)."},{"key":"e_1_3_2_1_22_1","unstructured":"Shuai Li Alexandros Karatzoglou and Claudio Gentile. 2016. Collaborative filtering bandits. In SIGIR. ACM 539\u2013548.  Shuai Li Alexandros Karatzoglou and Claudio Gentile. 2016. Collaborative filtering bandits. In SIGIR. ACM 539\u2013548."},{"key":"e_1_3_2_1_23_1","unstructured":"Xiaopeng Li and James She. 2017. Collaborative Variational Autoencoder for Recommender Systems. In KDD. ACM 305\u2013314.  Xiaopeng Li and James She. 2017. Collaborative Variational Autoencoder for Recommender Systems. In KDD. ACM 305\u2013314."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Shengcai Liao Yang Hu and Xiangyu Zhu. 2015. Person re-identification by local maximal occurrence representation and metric learning. In CVPR. 2197\u20132206.  Shengcai Liao Yang Hu and Xiangyu Zhu. 2015. Person re-identification by local maximal occurrence representation and metric learning. In CVPR. 2197\u20132206.","DOI":"10.1109\/CVPR.2015.7298832"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Bo Liu Ying Wei Yu Zhang Zhixian Yan and Qiang Yang. 2018. Transferable contextual bandit for cross-domain recommendation. In AAAI.  Bo Liu Ying Wei Yu Zhang Zhixian Yan and Qiang Yang. 2018. Transferable contextual bandit for cross-domain recommendation. In AAAI.","DOI":"10.1609\/aaai.v32i1.11699"},{"key":"e_1_3_2_1_26_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen 2013. Distributed representations of words and phrases and their compositionality. In NIPS. 3111\u20133119.  Tomas Mikolov Ilya Sutskever Kai Chen 2013. Distributed representations of words and phrases and their compositionality. In NIPS. 3111\u20133119."},{"key":"e_1_3_2_1_27_1","unstructured":"Atsuyoshi Nakamura. 2015. A ucb-like strategy of collaborative filtering. In ACML. 315\u2013329.  Atsuyoshi Nakamura. 2015. A ucb-like strategy of collaborative filtering. In ACML. 315\u2013329."},{"key":"e_1_3_2_1_28_1","volume-title":"Reducing drift in visual odometry by inferring sun direction using a bayesian convolutional neural network","author":"Peretroukhin Valentin","year":"2035","unstructured":"Valentin Peretroukhin , Lee Clement , and Jonathan Kelly . 2017. Reducing drift in visual odometry by inferring sun direction using a bayesian convolutional neural network . In ICRA. IEEE , 2035 \u20132042. Valentin Peretroukhin, Lee Clement, and Jonathan Kelly. 2017. Reducing drift in visual odometry by inferring sun direction using a bayesian convolutional neural network. In ICRA. IEEE, 2035\u20132042."},{"key":"e_1_3_2_1_29_1","volume-title":"Deep Bayesian Bandits Showdown: An Empirical Comparison of Bayesian Deep Networks for Thompson Sampling. ICLR","author":"Riquelme Carlos","year":"2018","unstructured":"Carlos Riquelme , George Tucker , and Jasper Snoek . 2018. Deep Bayesian Bandits Showdown: An Empirical Comparison of Bayesian Deep Networks for Thompson Sampling. ICLR ( 2018 ). Carlos Riquelme, George Tucker, and Jasper Snoek. 2018. Deep Bayesian Bandits Showdown: An Empirical Comparison of Bayesian Deep Networks for Thompson Sampling. ICLR (2018)."},{"key":"e_1_3_2_1_30_1","unstructured":"Suvash Sedhain Aditya\u00a0Krishna Menon 2018. Customized nonlinear bandits for online response selection in neural conversation models. In AAAI.  Suvash Sedhain Aditya\u00a0Krishna Menon 2018. Customized nonlinear bandits for online response selection in neural conversation models. In AAAI."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Michel Tokic. 2010. Adaptive \u03b5-greedy exploration in reinforcement learning based on value differences. In AAAI. 203\u2013210.  Michel Tokic. 2010. Adaptive \u03b5-greedy exploration in reinforcement learning based on value differences. In AAAI. 203\u2013210.","DOI":"10.1007\/978-3-642-16111-7_23"},{"key":"e_1_3_2_1_32_1","unstructured":"Aaron Van\u00a0den Oord Sander Dieleman and Benjamin Schrauwen. 2013. Deep content-based music recommendation. In NIPS. 2643\u20132651.  Aaron Van\u00a0den Oord Sander Dieleman and Benjamin Schrauwen. 2013. Deep content-based music recommendation. In NIPS. 2643\u20132651."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Huazheng Wang Qingyun Wu and Hongning Wang. 2016. Learning hidden features for contextual bandits. In CIKM. ACM 1633\u20131642.  Huazheng Wang Qingyun Wu and Hongning Wang. 2016. Learning hidden features for contextual bandits. In CIKM. ACM 1633\u20131642.","DOI":"10.1145\/2983323.2983847"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Huazheng Wang Qingyun Wu and Hongning Wang. 2016. Learning hidden features for contextual bandits. In CIKM. ACM 1633\u20131642.  Huazheng Wang Qingyun Wu and Hongning Wang. 2016. Learning hidden features for contextual bandits. In CIKM. ACM 1633\u20131642.","DOI":"10.1145\/2983323.2983847"},{"key":"e_1_3_2_1_35_1","unstructured":"Qingyun Wu Naveen Iyer and Hongning Wang. 2018. Learning Contextual Bandits in a Non-stationary Environment. In SIGIR.  Qingyun Wu Naveen Iyer and Hongning Wang. 2018. Learning Contextual Bandits in a Non-stationary Environment. In SIGIR."},{"key":"e_1_3_2_1_36_1","unstructured":"Qingyun Wu Huazheng Wang Quanquan Gu and Hongning Wang. 2016. Contextual bandits in a collaborative environment. In SIGIR. ACM 529\u2013538.  Qingyun Wu Huazheng Wang Quanquan Gu and Hongning Wang. 2016. Contextual bandits in a collaborative environment. In SIGIR. ACM 529\u2013538."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Fen Xia Tie-Yan Liu Jue Wang Wensheng Zhang and Hang Li. 2008. Listwise approach to learning to rank: theory and algorithm. In ICML. ACM 1192\u20131199.  Fen Xia Tie-Yan Liu Jue Wang Wensheng Zhang and Hang Li. 2008. Listwise approach to learning to rank: theory and algorithm. In ICML. ACM 1192\u20131199.","DOI":"10.1145\/1390156.1390306"},{"key":"e_1_3_2_1_38_1","unstructured":"Xiao Yu Xiang Ren Yizhou Sun Quanquan Gu Bradley Sturt Urvashi Khandelwal Brandon Norick and Jiawei Han. 2014. Personalized entity recommendation: A heterogeneous information network approach. In WSDM. ACM 283\u2013292.  Xiao Yu Xiang Ren Yizhou Sun Quanquan Gu Bradley Sturt Urvashi Khandelwal Brandon Norick and Jiawei Han. 2014. Personalized entity recommendation: A heterogeneous information network approach. In WSDM. ACM 283\u2013292."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939878"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3185994"}],"event":{"name":"WWW '20: The Web Conference 2020","location":"Taipei Taiwan","acronym":"WWW '20","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of The Web Conference 2020"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3366423.3380178","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3366423.3380178","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:33:00Z","timestamp":1750199580000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3366423.3380178"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,20]]},"references-count":40,"alternative-id":["10.1145\/3366423.3380178","10.1145\/3366423"],"URL":"https:\/\/doi.org\/10.1145\/3366423.3380178","relation":{},"subject":[],"published":{"date-parts":[[2020,4,20]]},"assertion":[{"value":"2020-04-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}