{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T14:59:45Z","timestamp":1776956385136,"version":"3.51.4"},"reference-count":99,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,5,22]],"date-time":"2023-05-22T00:00:00Z","timestamp":1684713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2022YFB3104700"],"award-info":[{"award-number":["2022YFB3104700"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Hebei Natural Science Foundation of China","award":["F2022203072"],"award-info":[{"award-number":["F2022203072"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Web"],"published-print":{"date-parts":[[2023,8,31]]},"abstract":"<jats:p><jats:bold>Massive open online courses (MOOCs)<\/jats:bold>, which offer open access and widespread interactive participation through the internet, are quickly becoming the preferred method for online and remote learning. Several MOOC platforms offer the service of course recommendation to users, to improve the learning experience of users. Despite the usefulness of this service, we consider that recommending courses to users directly may neglect their varying degrees of expertise. To mitigate this gap, we examine an interesting problem of concept recommendation in this paper, which can be viewed as recommending knowledge to users in a fine-grained way. We put forward a novel approach, termed<jats:bold>HinCRec-RL, for<jats:underline>C<\/jats:underline>oncept<jats:underline>Rec<\/jats:underline>ommendation in MOOCs, which is based on<jats:underline>H<\/jats:underline>eterogeneous<jats:underline>I<\/jats:underline>nformation<jats:underline>N<\/jats:underline>etworks and<jats:underline>R<\/jats:underline>einforcement<jats:underline>L<\/jats:underline>earning<\/jats:bold>. In particular, we propose to shape the problem of concept recommendation within a reinforcement learning framework to characterize the dynamic interaction between users and knowledge concepts in MOOCs. Furthermore, we propose to form the interactions among users, courses, videos, and concepts into a<jats:bold>heterogeneous information network (HIN)<\/jats:bold>to learn the semantic user representations better. We then employ an attentional graph neural network to represent the users in the HIN, based on meta-paths. Extensive experiments are conducted on a real-world dataset collected from a Chinese MOOC platform,<jats:italic>XuetangX<\/jats:italic>, to validate the efficacy of our proposed HinCRec-RL. Experimental results and analysis demonstrate that our proposed HinCRec-RL performs well when compared with several state-of-the-art models.<\/jats:p>","DOI":"10.1145\/3580510","type":"journal-article","created":{"date-parts":[[2023,3,1]],"date-time":"2023-03-01T12:03:39Z","timestamp":1677672219000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":38,"title":["Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networks"],"prefix":"10.1145","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4449-5845","authenticated-orcid":false,"given":"Jibing","family":"Gong","sequence":"first","affiliation":[{"name":"Yanshan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6937-4180","authenticated-orcid":false,"given":"Yao","family":"Wan","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7237-7382","authenticated-orcid":false,"given":"Ye","family":"Liu","sequence":"additional","affiliation":[{"name":"Salesforce Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6765-4864","authenticated-orcid":false,"given":"Xuewen","family":"Li","sequence":"additional","affiliation":[{"name":"Yanshan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0919-867X","authenticated-orcid":false,"given":"Yi","family":"Zhao","sequence":"additional","affiliation":[{"name":"Yanshan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9902-0180","authenticated-orcid":false,"given":"Cheng","family":"Wang","sequence":"additional","affiliation":[{"name":"Yanshan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6437-9713","authenticated-orcid":false,"given":"Yuting","family":"Lin","sequence":"additional","affiliation":[{"name":"Yanshan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4545-2249","authenticated-orcid":false,"given":"Xiaohan","family":"Fang","sequence":"additional","affiliation":[{"name":"Yanshan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4096-7561","authenticated-orcid":false,"given":"Wenzheng","family":"Feng","sequence":"additional","affiliation":[{"name":"Tsinghua University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8845-0078","authenticated-orcid":false,"given":"Jingyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beihang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3487-4593","authenticated-orcid":false,"given":"Jie","family":"Tang","sequence":"additional","affiliation":[{"name":"Tsinghua University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,5,22]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-29659-3","volume-title":"Recommender Systems","author":"Aggarwal Charu C.","year":"2016","unstructured":"Charu C. Aggarwal et\u00a0al. 2016. Recommender Systems. Vol. 1. Springer."},{"issue":"2","key":"e_1_3_2_3_2","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1109\/TNSE.2020.3031179","article-title":"Integrating blockchain with artificial intelligence for privacy-preserving recommender systems","volume":"8","author":"Bosri Rabeya","year":"2021","unstructured":"Rabeya Bosri, Mohammad Shahriar Rahman, Md. Zakirul Alam Bhuiyan, and Abdullah Al Omar. 2021. Integrating blockchain with artificial intelligence for privacy-preserving recommender systems. IEEE Transactions on Network Science and Engineering 8, 2 (2021), 1009\u20131018.","journal-title":"IEEE Transactions on Network Science and Engineering"},{"key":"e_1_3_2_4_2","volume-title":"Thirty-Second AAAI Conference on Artificial Intelligence","author":"Cai Xiaoyan","year":"2018","unstructured":"Xiaoyan Cai, Junwei Han, and Libin Yang. 2018. Generative adversarial network based heterogeneous bibliographic network representation for personalized citation recommendation. In Thirty-Second AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"3383","DOI":"10.1145\/3442381.3449834","volume-title":"Proceedings of the Web Conference 2021 (WWW\u201921)","author":"Cao Yuwei","year":"2021","unstructured":"Yuwei Cao, Hao Peng, Jia Wu, Yingtong Dou, Jianxin Li, and Philip S. Yu. 2021. Knowledge-preserving incremental social event detection via heterogeneous GNNs. In Proceedings of the Web Conference 2021 (WWW\u201921). Association for Computing Machinery, New York, NY, USA, 3383\u20133395."},{"key":"e_1_3_2_6_2","first-page":"1358","volume-title":"Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4\u20138, 2019","author":"Cen Yukuo","year":"2019","unstructured":"Yukuo Cen, Xu Zou, Jianwei Zhang, Hongxia Yang, Jingren Zhou, and Jie Tang. 2019. Representation learning for attributed multiplex heterogeneous network. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4\u20138, 2019, Ankur Teredesai, Vipin Kumar, Ying Li, R\u00f3mer Rosales, Evimaria Terzi, and George Karypis (Eds.). ACM, 1358\u20131368."},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1145\/3437963.3441762","volume-title":"Proceedings of the 14th ACM International Conference on Web Search and Data Mining","author":"Chen Hongxu","year":"2021","unstructured":"Hongxu Chen, Yicong Li, Xiangguo Sun, Guandong Xu, and Hongzhi Yin. 2021. Temporal meta-path guided explainable recommendation. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 1056\u20131064."},{"key":"e_1_3_2_8_2","doi-asserted-by":"crossref","first-page":"1177","DOI":"10.1145\/3219819.3219986","volume-title":"Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","author":"Chen Hongxu","year":"2018","unstructured":"Hongxu Chen, Hongzhi Yin, Weiqing Wang, Hao Wang, Quoc Viet Hung Nguyen, and Xue Li. 2018. PME: Projected metric embedding on heterogeneous networks for link prediction. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1177\u20131186."},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/ICDM.2018.00019","volume-title":"2018 IEEE International Conference on Data Mining (ICDM)","author":"Chen Penghe","year":"2018","unstructured":"Penghe Chen, Yu Lu, Vincent W. Zheng, and Yang Pian. 2018. Prerequisite-driven deep knowledge tracing. In 2018 IEEE International Conference on Data Mining (ICDM). IEEE, 39\u201348."},{"issue":"2","key":"e_1_3_2_10_2","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1007\/s11280-012-0187-z","article-title":"A hybrid recommendation algorithm adapted in e-learning environments","volume":"17","author":"Chen Wei","year":"2014","unstructured":"Wei Chen, Zhendong Niu, Xiangyu Zhao, and Yi Li. 2014. A hybrid recommendation algorithm adapted in e-learning environments. World Wide Web 17, 2 (2014), 271\u2013284.","journal-title":"World Wide Web"},{"key":"e_1_3_2_11_2","first-page":"1","volume-title":"2020 International Joint Conference on Neural Networks (IJCNN)","author":"Chen Xiaocong","year":"2020","unstructured":"Xiaocong Chen, Chaoran Huang, Lina Yao, Xianzhi Wang, Wenjie Zhang, et\u00a0al. 2020. Knowledge-guided deep reinforcement learning for interactive recommendation. In 2020 International Joint Conference on Neural Networks (IJCNN). IEEE, 1\u20138."},{"key":"e_1_3_2_12_2","volume-title":"International Conference on Learning Representations","author":"Chen Xinshi","year":"2019","unstructured":"Xinshi Chen, Shuang Li, Hui Li, Shaohua Jiang, and Le Song. 2019. Neural model-based reinforcement learning for recommendation. In International Conference on Learning Representations."},{"key":"e_1_3_2_13_2","first-page":"6302","volume-title":"Proceedings of the 28th International Conference on Computational Linguistics, COLING 2020, Barcelona, Spain (Online), December 8\u201313, 2020","author":"Deng Zhongfen","year":"2020","unstructured":"Zhongfen Deng, Hao Peng, Congying Xia, Jianxin Li, Lifang He, and Philip S. Yu. 2020. Hierarchical bi-directional self-attention networks for paper review rating recommendation. In Proceedings of the 28th International Conference on Computational Linguistics, COLING 2020, Barcelona, Spain (Online), December 8\u201313, 2020, Donia Scott, N\u00faria Bel, and Chengqing Zong (Eds.). International Committee on Computational Linguistics, 6302\u20136314."},{"key":"e_1_3_2_14_2","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1145\/3097983.3098036","volume-title":"Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Dong Yuxiao","year":"2017","unstructured":"Yuxiao Dong, Nitesh V. Chawla, and Ananthram Swami. 2017. metapath2vec: Scalable representation learning for heterogeneous networks. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 135\u2013144."},{"key":"e_1_3_2_15_2","first-page":"2478","volume-title":"Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","author":"Fan Shaohua","year":"2019","unstructured":"Shaohua Fan, Junxiong Zhu, Xiaotian Han, Chuan Shi, Linmei Hu, Biyu Ma, and Yongliang Li. 2019. Metapath-guided heterogeneous graph neural network for intent recommendation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2478\u20132486."},{"key":"e_1_3_2_16_2","first-page":"1939","volume-title":"Proceedings of the 2018 World Wide Web Conference","author":"Feng Jun","year":"2018","unstructured":"Jun Feng, Heng Li, Minlie Huang, Shichen Liu, Wenwu Ou, Zhirong Wang, and Xiaoyan Zhu. 2018. Learning to collaborate: Multi-scenario ranking via multi-agent reinforcement learning. In Proceedings of the 2018 World Wide Web Conference. 1939\u20131948."},{"key":"e_1_3_2_17_2","first-page":"517","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"33","author":"Feng Wenzheng","year":"2019","unstructured":"Wenzheng Feng, Jie Tang, and Tracy Xiao Liu. 2019. Understanding dropouts in MOOCs. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 517\u2013524."},{"key":"e_1_3_2_18_2","article-title":"Learning piece-wise linear models from large scale data for ad click prediction","author":"Gai Kun","year":"2017","unstructured":"Kun Gai, Xiaoqiang Zhu, Han Li, Kai Liu, and Zhe Wang. 2017. Learning piece-wise linear models from large scale data for ad click prediction. arXiv preprint arXiv:1704.05194 (2017).","journal-title":"arXiv preprint arXiv:1704.05194"},{"issue":"7","key":"e_1_3_2_19_2","doi-asserted-by":"crossref","first-page":"3801","DOI":"10.1016\/j.eswa.2014.11.042","article-title":"Enhancing memory-based collaborative filtering for group recommender systems","volume":"42","author":"Ghazarian Sarik","year":"2015","unstructured":"Sarik Ghazarian and Mohammad Ali Nematbakhsh. 2015. Enhancing memory-based collaborative filtering for group recommender systems. Expert Systems with Applications 42, 7 (2015), 3801\u20133812.","journal-title":"Expert Systems with Applications"},{"key":"e_1_3_2_20_2","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1145\/3397271.3401057","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Gong Jibing","year":"2020","unstructured":"Jibing Gong, Shen Wang, Jinlong Wang, Wenzheng Feng, Hao Peng, Jie Tang, and Philip S. Yu. 2020. Attentional graph convolutional networks for knowledge concept recommendation in MOOCs in a heterogeneous view. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 79\u201388."},{"key":"e_1_3_2_21_2","first-page":"1025","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems","author":"Hamilton William L.","year":"2017","unstructured":"William L. Hamilton, Rex Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 1025\u20131035."},{"issue":"12","key":"e_1_3_2_22_2","doi-asserted-by":"crossref","first-page":"2354","DOI":"10.1109\/TKDE.2018.2831682","article-title":"NAIS: Neural attentive item similarity model for recommendation","volume":"30","author":"He Xiangnan","year":"2018","unstructured":"Xiangnan He, Zhankui He, Jingkuan Song, Zhenguang Liu, Yu-Gang Jiang, and Tat-Seng Chua. 2018. NAIS: Neural attentive item similarity model for recommendation. IEEE Trans. Knowl. Data Eng. 30, 12 (2018), 2354\u20132366.","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"e_1_3_2_23_2","first-page":"173","volume-title":"Proceedings of the 26th International Conference on World Wide Web","author":"He Xiangnan","year":"2017","unstructured":"Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 173\u2013182."},{"key":"e_1_3_2_24_2","first-page":"1","volume-title":"Proceedings of the Eighth International Workshop on Data Mining for Online Advertising","author":"He Xinran","year":"2014","unstructured":"Xinran He, Junfeng Pan, Ou Jin, Tianbing Xu, Bo Liu, Tao Xu, Yanxin Shi, Antoine Atallah, Ralf Herbrich, Stuart Bowers, et\u00a0al. 2014. Practical lessons from predicting clicks on ads at Facebook. In Proceedings of the Eighth International Workshop on Data Mining for Online Advertising. 1\u20139."},{"key":"e_1_3_2_25_2","first-page":"1683","volume-title":"Proceedings of the 27th ACM International Conference on Information and Knowledge Management","author":"Hu Binbin","year":"2018","unstructured":"Binbin Hu, Chuan Shi, Wayne Xin Zhao, and Tianchi Yang. 2018. Local and global information fusion for top-N recommendation in heterogeneous information network. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. ACM, 1683\u20131686."},{"key":"e_1_3_2_26_2","first-page":"1531","volume-title":"Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","author":"Hu Binbin","year":"2018","unstructured":"Binbin Hu, Chuan Shi, Wayne Xin Zhao, and Philip S. Yu. 2018. Leveraging meta-path based context for top-n recommendation with a neural co-attention model. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 1531\u20131540."},{"key":"e_1_3_2_27_2","doi-asserted-by":"crossref","first-page":"106706","DOI":"10.1016\/j.knosys.2020.106706","article-title":"A deep reinforcement learning based long-term recommender system","volume":"213","author":"Huang Liwei","year":"2021","unstructured":"Liwei Huang, Mingsheng Fu, Fan Li, Hong Qu, Yangjun Liu, and Wenyu Chen. 2021. A deep reinforcement learning based long-term recommender system. Knowledge-Based Systems 213 (2021), 106706.","journal-title":"Knowledge-Based Systems"},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1109\/ICSAI.2018.8599503","volume-title":"2018 5th International Conference on Systems and Informatics (ICSAI)","author":"Huang Ran","year":"2018","unstructured":"Ran Huang and Ran Lu. 2018. Research on content-based MOOC recommender model. In 2018 5th International Conference on Systems and Informatics (ICSAI). IEEE, 676\u2013681."},{"key":"e_1_3_2_29_2","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1145\/3447548.3467408","volume-title":"Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining","author":"Huang Tinglin","year":"2021","unstructured":"Tinglin Huang, Yuxiao Dong, Ming Ding, Zhen Yang, Wenzheng Feng, Xinyu Wang, and Jie Tang. 2021. MixGCF: An improved training method for graph neural network-based recommender systems. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 665\u2013674."},{"key":"e_1_3_2_30_2","first-page":"1","article-title":"Reinforcement learning based on contextual bandits for personalized online learning recommendation systems","author":"Intayoad Wacharawan","year":"2020","unstructured":"Wacharawan Intayoad, Chayapol Kamyod, and Punnarumol Temdee. 2020. Reinforcement learning based on contextual bandits for personalized online learning recommendation systems. Wireless Personal Communications (2020), 1\u201316.","journal-title":"Wireless Personal Communications"},{"key":"e_1_3_2_31_2","first-page":"75","volume-title":"Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","author":"Jin Jiarui","year":"2020","unstructured":"Jiarui Jin, Jiarui Qin, Yuchen Fang, Kounianhua Du, Weinan Zhang, Yong Yu, Zheng Zhang, and Alexander J. Smola. 2020. An efficient neighborhood-based interaction model for recommendation on heterogeneous graph. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 75\u201384."},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1145\/3106426.3106478","volume-title":"Proceedings of the International Conference on Web Intelligence","author":"Jing Xia","year":"2017","unstructured":"Xia Jing and Jie Tang. 2017. Guess you like: Course recommendation in MOOCs. In Proceedings of the International Conference on Web Intelligence. ACM, 783\u2013789."},{"key":"e_1_3_2_33_2","first-page":"659","volume-title":"The 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2013, Chicago, IL, USA, August 11\u201314, 2013","author":"Kabbur Santosh","year":"2013","unstructured":"Santosh Kabbur, Xia Ning, and George Karypis. 2013. FISM: Factored item similarity models for top-N recommender systems. In The 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2013, Chicago, IL, USA, August 11\u201314, 2013. 659\u2013667."},{"key":"e_1_3_2_34_2","article-title":"Online academic course performance prediction using relational graph convolutional neural network.","author":"Karimi Hamid","year":"2020","unstructured":"Hamid Karimi, Tyler Derr, Jiangtao Huang, and Jiliang Tang. 2020. Online academic course performance prediction using relational graph convolutional neural network. International Educational Data Mining Society (2020).","journal-title":"International Educational Data Mining Society"},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","first-page":"107213","DOI":"10.1016\/j.asoc.2021.107213","article-title":"Cross-platform dynamic goods recommendation system based on reinforcement learning and social networks","volume":"104","author":"Ke Gang","year":"2021","unstructured":"Gang Ke, Hong-Le Du, and Yeh-Cheng Chen. 2021. Cross-platform dynamic goods recommendation system based on reinforcement learning and social networks. Applied Soft Computing 104 (2021), 107213.","journal-title":"Applied Soft Computing"},{"key":"e_1_3_2_36_2","first-page":"3146","article-title":"LightGBM: A highly efficient gradient boosting decision tree","volume":"30","author":"Ke Guolin","year":"2017","unstructured":"Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A highly efficient gradient boosting decision tree. Advances in Neural Information Processing Systems 30 (2017), 3146\u20133154.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_37_2","doi-asserted-by":"crossref","first-page":"115926","DOI":"10.1016\/j.eswa.2021.115926","article-title":"A literature review of implemented recommendation techniques used in massive open online courses","volume":"187","author":"Khalid Asra","year":"2022","unstructured":"Asra Khalid, Karsten Lundqvist, and Anne Yates. 2022. A literature review of implemented recommendation techniques used in massive open online courses. Expert Systems with Applications 187 (2022), 115926.","journal-title":"Expert Systems with Applications"},{"key":"e_1_3_2_38_2","volume-title":"3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7\u20139, 2015, Conference Track Proceedings","author":"Kingma Diederik P.","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7\u20139, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.)."},{"key":"e_1_3_2_39_2","first-page":"64","volume-title":"Proceedings of the 2021 SIAM International Conference on Data Mining (SDM)","author":"Li Chen","year":"2021","unstructured":"Chen Li, Linmei Hu, Chuan Shi, Guojie Song, and Yuanfu Lu. 2021. Sequence-aware heterogeneous graph neural collaborative filtering. In Proceedings of the 2021 SIAM International Conference on Data Mining (SDM). SIAM, 64\u201372."},{"key":"e_1_3_2_40_2","first-page":"1419","volume-title":"Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, CIKM 2017, Singapore, November 06-10, 2017","author":"Li Jing","year":"2017","unstructured":"Jing Li, Pengjie Ren, Zhumin Chen, Zhaochun Ren, Tao Lian, and Jun Ma. 2017. Neural attentive session-based recommendation. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, CIKM 2017, Singapore, November 06-10, 2017. 1419\u20131428."},{"issue":"4","key":"e_1_3_2_41_2","doi-asserted-by":"crossref","first-page":"412","DOI":"10.26599\/TST.2018.9010110","article-title":"Course drop-out prediction on MOOC platform via clustering and tensor completion","volume":"24","author":"Liao Jinzhi","year":"2019","unstructured":"Jinzhi Liao, Jiuyang Tang, and Xiang Zhao. 2019. Course drop-out prediction on MOOC platform via clustering and tensor completion. Tsinghua Science and Technology 24, 4 (2019), 412\u2013422.","journal-title":"Tsinghua Science and Technology"},{"key":"e_1_3_2_42_2","article-title":"Deep reinforcement learning based recommendation with explicit user-item interactions modeling","author":"Liu Feng","year":"2018","unstructured":"Feng Liu, Ruiming Tang, Xutao Li, Weinan Zhang, Yunming Ye, Haokun Chen, Huifeng Guo, and Yuzhou Zhang. 2018. Deep reinforcement learning based recommendation with explicit user-item interactions modeling. arXiv preprint arXiv:1810.12027 (2018).","journal-title":"arXiv preprint arXiv:1810.12027"},{"issue":"1","key":"e_1_3_2_43_2","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1080\/09540091.2021.1997915","article-title":"Personalised context-aware re-ranking in recommender system","volume":"34","author":"Liu Xiangyong","year":"2022","unstructured":"Xiangyong Liu, Guojun Wang, and Md. Zakirul Alam Bhuiyan. 2022. Personalised context-aware re-ranking in recommender system. Connection Science 34, 1 (2022), 319\u2013338.","journal-title":"Connection Science"},{"issue":"1","key":"e_1_3_2_44_2","doi-asserted-by":"crossref","first-page":"e4398","DOI":"10.1002\/ett.4398","article-title":"Re-ranking with multiple objective optimization in recommender system","volume":"33","author":"Liu Xiangyong","year":"2022","unstructured":"Xiangyong Liu, Guojun Wang, and Md. Zakirul Alam Bhuiyan. 2022. Re-ranking with multiple objective optimization in recommender system. Transactions on Emerging Telecommunications Technologies 33, 1 (2022), e4398.","journal-title":"Transactions on Emerging Telecommunications Technologies"},{"issue":"2","key":"e_1_3_2_45_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3291756","article-title":"Top-N recommendation with multi-channel positive feedback using factorization machines","volume":"37","author":"Loni Babak","year":"2019","unstructured":"Babak Loni, Roberto Pagano, Martha Larson, and Alan Hanjalic. 2019. Top-N recommendation with multi-channel positive feedback using factorization machines. ACM Transactions on Information Systems (TOIS) 37, 2 (2019), 1\u201323.","journal-title":"ACM Transactions on Information Systems (TOIS)"},{"key":"e_1_3_2_46_2","first-page":"9678","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"33","author":"Lu Weiming","year":"2019","unstructured":"Weiming Lu, Yangfan Zhou, Jiale Yu, and Chenhao Jia. 2019. Concept extraction and prerequisite relation learning from educational data. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 9678\u20139685."},{"issue":"8","key":"e_1_3_2_47_2","doi-asserted-by":"crossref","first-page":"5637","DOI":"10.1109\/TII.2022.3143103","article-title":"Privacy-aware factorization-based hybrid recommendation method for healthcare services","volume":"18","author":"Meng Shunmei","year":"2022","unstructured":"Shunmei Meng, Shaoyu Fan, Qianmu Li, Xinna Wang, Jing Zhang, Xiaolong Xu, Lianyong Qi, and Md. Zakirul Alam Bhuiyan. 2022. Privacy-aware factorization-based hybrid recommendation method for healthcare services. IEEE Transactions on Industrial Informatics 18, 8 (2022), 5637\u20135647.","journal-title":"IEEE Transactions on Industrial Informatics"},{"key":"e_1_3_2_48_2","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1007\/978-981-15-1304-6_9","volume-title":"International Conference on Dependability in Sensor, Cloud, and Big Data Systems and Applications","author":"Omar Abdullah Al","year":"2019","unstructured":"Abdullah Al Omar, Rabeya Bosri, Mohammad Shahriar Rahman, Nasima Begum, and Md. Zakirul Alam Bhuiyan. 2019. Towards privacy-preserving recommender system with blockchains. In International Conference on Dependability in Sensor, Cloud, and Big Data Systems and Applications. Springer, 106\u2013118."},{"key":"e_1_3_2_49_2","first-page":"1421","volume-title":"The World Wide Web Conference","author":"Pan Feiyang","year":"2019","unstructured":"Feiyang Pan, Qingpeng Cai, Pingzhong Tang, Fuzhen Zhuang, and Qing He. 2019. Policy gradients for contextual recommendations. In The World Wide Web Conference. 1421\u20131431."},{"key":"e_1_3_2_50_2","first-page":"1447","volume-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Pan Liangming","year":"2017","unstructured":"Liangming Pan, Chengjiang Li, Juanzi Li, and Jie Tang. 2017. Prerequisite relation learning for concepts in MOOCs. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1447\u20131456."},{"key":"e_1_3_2_51_2","first-page":"875","volume-title":"Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Pan Liangming","year":"2017","unstructured":"Liangming Pan, Xiaochen Wang, Chengjiang Li, Juanzi Li, and Jie Tang. 2017. Course concept extraction in MOOCs via embedding-based graph propagation. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 875\u2013884."},{"issue":"1","key":"e_1_3_2_52_2","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1002\/cae.21785","article-title":"Collaborative filtering recommendation for MOOC application","volume":"25","author":"Pang Yanxia","year":"2017","unstructured":"Yanxia Pang, Yuanyuan Jin, Ying Zhang, and Tao Zhu. 2017. Collaborative filtering recommendation for MOOC application. Computer Applications in Engineering Education 25, 1 (2017), 120\u2013128.","journal-title":"Computer Applications in Engineering Education"},{"issue":"11","key":"e_1_3_2_53_2","doi-asserted-by":"crossref","first-page":"10059","DOI":"10.1016\/j.eswa.2012.02.038","article-title":"A literature review and classification of recommender systems research","volume":"39","author":"Park Deuk Hee","year":"2012","unstructured":"Deuk Hee Park, Hyea Kyeong Kim, Il Young Choi, and Jae Kyeong Kim. 2012. A literature review and classification of recommender systems research. Expert Systems with Applications 39, 11 (2012), 10059\u201310072.","journal-title":"Expert Systems with Applications"},{"issue":"5","key":"e_1_3_2_54_2","first-page":"89","article-title":"Streaming social event detection and evolution discovery in heterogeneous information networks","volume":"15","author":"Peng Hao","year":"2021","unstructured":"Hao Peng, Jianxin Li, Yangqiu Song, Renyu Yang, Rajiv Ranjan, Philip S. Yu, and Lifang He. 2021. Streaming social event detection and evolution discovery in heterogeneous information networks. ACM Trans. Knowl. Discov. Data 15, 5, Article 89 (May2021), 33 pages.","journal-title":"ACM Trans. Knowl. Discov. Data"},{"key":"e_1_3_2_55_2","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/j.ins.2020.01.043","article-title":"Spatial temporal incidence dynamic graph neural networks for traffic flow forecasting","volume":"521","author":"Peng Hao","year":"2020","unstructured":"Hao Peng, Hongfei Wang, Bowen Du, Md. Zakirul Alam Bhuiyan, Hongyuan Ma, Jianwei Liu, Lihong Wang, Zeyu Yang, Linfeng Du, Senzhang Wang, and Philip S. Yu. 2020. Spatial temporal incidence dynamic graph neural networks for traffic flow forecasting. Information Sciences 521 (2020), 277\u2013290.","journal-title":"Information Sciences"},{"issue":"4","key":"e_1_3_2_56_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3490181","article-title":"Reinforced neighborhood selection guided multi-relational graph neural networks","volume":"40","author":"Peng Hao","year":"2021","unstructured":"Hao Peng, Ruitong Zhang, Yingtong Dou, Renyu Yang, Jingyi Zhang, and Philip S. Yu. 2021. Reinforced neighborhood selection guided multi-relational graph neural networks. ACM Transactions on Information Systems (TOIS) 40, 4 (2021), 1\u201346.","journal-title":"ACM Transactions on Information Systems (TOIS)"},{"key":"e_1_3_2_57_2","article-title":"Reinforced, incremental and cross-lingual event detection from social messages","author":"Peng Hao","year":"2022","unstructured":"Hao Peng, Ruitong Zhang, Shaoning Li, Yuwei Cao, Shirui Pan, and Philip Yu. 2022. Reinforced, incremental and cross-lingual event detection from social messages. IEEE Transactions on Pattern Analysis and Machine Intelligence (2022).","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_2_58_2","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1145\/2623330.2623732","volume-title":"Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Perozzi Bryan","year":"2014","unstructured":"Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 701\u2013710."},{"key":"e_1_3_2_59_2","first-page":"93","volume-title":"Proceedings of the Ninth ACM International Conference on Web Search and Data Mining","author":"Qiu Jiezhong","year":"2016","unstructured":"Jiezhong Qiu, Jie Tang, Tracy Xiao Liu, Jie Gong, Chenhui Zhang, Qian Zhang, and Yufei Xue. 2016. Modeling and predicting learning behavior in MOOCs. In Proceedings of the Ninth ACM International Conference on Web Search and Data Mining. ACM, 93\u2013102."},{"key":"e_1_3_2_60_2","first-page":"635","volume-title":"ICEIS (1)","author":"Rabahallah Kahina","year":"2018","unstructured":"Kahina Rabahallah, Latifa Mahdaoui, and Fai\u00e7al Azouaou. 2018. MOOCs recommender system using ontology and memory-based collaborative filtering. In ICEIS (1). 635\u2013641."},{"issue":"3","key":"e_1_3_2_61_2","first-page":"57:1\u201357:22","article-title":"Factorization machines with libFM","volume":"3","author":"Rendle Steffen","year":"2012","unstructured":"Steffen Rendle. 2012. Factorization machines with libFM. ACM TIST 3, 3 (2012), 57:1\u201357:22.","journal-title":"ACM TIST"},{"key":"e_1_3_2_62_2","unstructured":"Steffen Rendle Christoph Freudenthaler Zeno Gantner and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback(UAI\u201909). AUAI Press Arlington Virginia USA 452\u2013461."},{"key":"e_1_3_2_63_2","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1145\/3240323.3240344","volume-title":"Proceedings of the 12th ACM Conference on Recommender Systems","author":"Shen Yilin","year":"2018","unstructured":"Yilin Shen, Yue Deng, Avik Ray, and Hongxia Jin. 2018. Interactive recommendation via deep neural memory augmented contextual bandits. In Proceedings of the 12th ACM Conference on Recommender Systems. 122\u2013130."},{"issue":"2","key":"e_1_3_2_64_2","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1109\/TKDE.2018.2833443","article-title":"Heterogeneous information network embedding for recommendation","volume":"31","author":"Shi Chuan","year":"2019","unstructured":"Chuan Shi, Binbin Hu, Wayne Xin Zhao, and Philip S. Yu. 2019. Heterogeneous information network embedding for recommendation. IEEE Transactions on Knowledge and Data Engineering 31, 2 (2019), 357\u2013370.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_65_2","first-page":"924","volume-title":"International Conference on Machine Learning","author":"Silver David","year":"2013","unstructured":"David Silver, Leonard Newnham, David Barker, Suzanne Weller, and Jason McFall. 2013. Concurrent reinforcement learning from customer interactions. In International Conference on Machine Learning. PMLR, 924\u2013932."},{"key":"e_1_3_2_66_2","first-page":"582","volume-title":"Proceedings of the 13th International Conference on Web Search and Data Mining","author":"Sun Changfeng","year":"2020","unstructured":"Changfeng Sun, Han Liu, Meng Liu, Zhaochun Ren, Tian Gan, and Liqiang Nie. 2020. LARA: Attribute-to-feature adversarial learning for new-item recommendation. In Proceedings of the 13th International Conference on Web Search and Data Mining. 582\u2013590."},{"key":"e_1_3_2_67_2","first-page":"725","volume-title":"Proceedings of the 14th ACM International Conference on Web Search and Data Mining","author":"Sun Xiangguo","year":"2021","unstructured":"Xiangguo Sun, Hongzhi Yin, Bo Liu, Hongxu Chen, Jiuxin Cao, Yingxia Shao, and Nguyen Quoc Viet Hung. 2021. Heterogeneous hypergraph embedding for graph classification. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 725\u2013733."},{"issue":"2","key":"e_1_3_2_68_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-031-01902-9","article-title":"Mining heterogeneous information networks: Principles and methodologies","volume":"3","author":"Sun Yizhou","year":"2012","unstructured":"Yizhou Sun and Jiawei Han. 2012. Mining heterogeneous information networks: Principles and methodologies. Synthesis Lectures on Data Mining and Knowledge Discovery 3, 2 (2012), 1\u2013159.","journal-title":"Synthesis Lectures on Data Mining and Knowledge Discovery"},{"issue":"11","key":"e_1_3_2_69_2","doi-asserted-by":"crossref","first-page":"992","DOI":"10.14778\/3402707.3402736","article-title":"PathSim: Meta path-based top-k similarity search in heterogeneous information networks","volume":"4","author":"Sun Yizhou","year":"2011","unstructured":"Yizhou Sun, Jiawei Han, Xifeng Yan, Philip S. Yu, and Tianyi Wu. 2011. PathSim: Meta path-based top-k similarity search in heterogeneous information networks. Proceedings of the VLDB Endowment 4, 11 (2011), 992\u20131003.","journal-title":"Proceedings of the VLDB Endowment"},{"key":"e_1_3_2_70_2","first-page":"1057","volume-title":"Advances in Neural Information Processing Systems","author":"Sutton Richard S.","year":"2000","unstructured":"Richard S. Sutton, David A. McAllester, Satinder P. Singh, and Yishay Mansour. 2000. Policy gradient methods for reinforcement learning with function approximation. In Advances in Neural Information Processing Systems. 1057\u20131063."},{"key":"e_1_3_2_71_2","volume-title":"Thirtieth AAAI Conference on Artificial Intelligence","author":"Hasselt Hado Van","year":"2016","unstructured":"Hado Van Hasselt, Arthur Guez, and David Silver. 2016. Deep reinforcement learning with double q-learning. In Thirtieth AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_2_72_2","volume-title":"International Conference on Learning Representations","author":"Veli\u010dkovi\u0107 Petar","year":"2018","unstructured":"Petar Veli\u010dkovi\u0107, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Li\u00f2, and Yoshua Bengio. 2018. Graph attention networks. In International Conference on Learning Representations."},{"issue":"7782","key":"e_1_3_2_73_2","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1038\/s41586-019-1724-z","article-title":"Grandmaster level in StarCraft II using multi-agent reinforcement learning","volume":"575","author":"Vinyals Oriol","year":"2019","unstructured":"Oriol Vinyals, Igor Babuschkin, Wojciech M. Czarnecki, Micha\u00ebl Mathieu, Andrew Dudzik, Junyoung Chung, David H. Choi, Richard Powell, Timo Ewalds, Petko Georgiev, et\u00a0al. 2019. Grandmaster level in StarCraft II using multi-agent reinforcement learning. Nature 575, 7782 (2019), 350\u2013354.","journal-title":"Nature"},{"issue":"5","key":"e_1_3_2_74_2","first-page":"827","article-title":"A hybrid e-learning recommendation approach based on learners\u2019 influence propagation","volume":"32","author":"Wan Shanshan","year":"2019","unstructured":"Shanshan Wan and Zhendong Niu. 2019. A hybrid e-learning recommendation approach based on learners\u2019 influence propagation. IEEE Transactions on Knowledge and Data Engineering 32, 5 (2019), 827\u2013840.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_75_2","first-page":"2022","volume-title":"The World Wide Web Conference, WWW 2019, San Francisco, CA, USA, May 13\u201317, 2019","author":"Wang Xiao","year":"2019","unstructured":"Xiao Wang, Houye Ji, Chuan Shi, Bai Wang, Yanfang Ye, Peng Cui, and Philip S. Yu. 2019. Heterogeneous graph attention network. In The World Wide Web Conference, WWW 2019, San Francisco, CA, USA, May 13\u201317, 2019, Ling Liu, Ryen W. White, Amin Mantrach, Fabrizio Silvestri, Julian J. McAuley, Ricardo Baeza-Yates, and Leila Zia (Eds.). ACM, 2022\u20132032."},{"key":"e_1_3_2_76_2","doi-asserted-by":"crossref","first-page":"1726","DOI":"10.1145\/3447548.3467415","volume-title":"Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining","author":"Wang Xiao","year":"2021","unstructured":"Xiao Wang, Nian Liu, Hui Han, and Chuan Shi. 2021. Self-supervised heterogeneous graph neural network with co-contrastive learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 1726\u20131736."},{"key":"e_1_3_2_77_2","volume-title":"J. International Conference on Learning Representations (ICLR 2017)","author":"Welling Max","year":"2016","unstructured":"Max Welling and Thomas N. Kipf. 2016. Semi-supervised classification with graph convolutional networks. In J. International Conference on Learning Representations (ICLR 2017)."},{"issue":"3","key":"e_1_3_2_78_2","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1007\/BF00992696","article-title":"Simple statistical gradient-following algorithms for connectionist reinforcement learning","volume":"8","author":"Williams Ronald J.","year":"1992","unstructured":"Ronald J. Williams. 1992. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning 8, 3-4 (1992), 229\u2013256.","journal-title":"Machine Learning"},{"key":"e_1_3_2_79_2","first-page":"235","volume-title":"Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Wu Le","year":"2019","unstructured":"Le Wu, Peijie Sun, Yanjie Fu, Richang Hong, Xiting Wang, and Meng Wang. 2019. A neural influence diffusion model for social recommendation. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 235\u2013244."},{"key":"e_1_3_2_80_2","first-page":"679","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Wu Le","year":"2020","unstructured":"Le Wu, Yonghui Yang, Kun Zhang, Richang Hong, Yanjie Fu, and Meng Wang. 2020. Joint item recommendation and attribute inference: An adaptive graph convolutional network approach. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 679\u2013688."},{"key":"e_1_3_2_81_2","volume-title":"Proceedings of AAAI","author":"Xie Ruobing","year":"2021","unstructured":"Ruobing Xie, Shaoliang Zhang, Rui Wang, Feng Xia, and Leyu Lin. 2021. Hierarchical reinforcement learning for integrated recommendation. In Proceedings of AAAI."},{"key":"e_1_3_2_82_2","volume-title":"International Conference on Learning Representations","author":"Xu Keyulu","year":"2019","unstructured":"Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2019. How powerful are graph neural networks?. In International Conference on Learning Representations."},{"key":"e_1_3_2_83_2","article-title":"Overcoming data sparsity in group recommendation","author":"Yin Hongzhi","year":"2020","unstructured":"Hongzhi Yin, Qinyong Wang, Kai Zheng, Zhixu Li, and Xiaofang Zhou. 2020. Overcoming data sparsity in group recommendation. IEEE Transactions on Knowledge and Data Engineering (2020).","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_84_2","first-page":"3135","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Yu Jifan","year":"2020","unstructured":"Jifan Yu, Gan Luo, Tong Xiao, Qingyang Zhong, Yuquan Wang, Wenzheng Feng, Junyi Luo, Chenyu Wang, Lei Hou, Juanzi Li, et\u00a0al. 2020. MOOCCube: A large-scale data repository for NLP applications in MOOCs. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 3135\u20133142."},{"key":"e_1_3_2_85_2","first-page":"4292","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Yu Jifan","year":"2019","unstructured":"Jifan Yu, Chenyu Wang, Gan Luo, Lei Hou, Juanzi Li, Jie Tang, and Zhiyuan Liu. 2019. Course concept expansion in MOOCs with external knowledge and interactive game. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. ACL, 4292\u20134302."},{"key":"e_1_3_2_86_2","first-page":"4643","volume-title":"Proceedings of the 30th ACM International Conference on Information & Knowledge Management","author":"Yu Jifan","year":"2021","unstructured":"Jifan Yu, Yuquan Wang, Qingyang Zhong, Gan Luo, Yiming Mao, Kai Sun, Wenzheng Feng, Wei Xu, Shulin Cao, Kaisheng Zeng, et\u00a0al. 2021. MOOCCubeX: A large knowledge-centered repository for adaptive learning in MOOCs. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 4643\u20134652."},{"key":"e_1_3_2_87_2","article-title":"Collaborative list-and-pairwise filtering from implicit feedback","author":"Yu Runlong","year":"2020","unstructured":"Runlong Yu, Qi Liu, Yuyang Ye, Mingyue Cheng, Enhong Chen, and Jianhui Ma. 2020. Collaborative list-and-pairwise filtering from implicit feedback. IEEE Transactions on Knowledge and Data Engineering (2020).","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_88_2","first-page":"39","volume-title":"Proceedings of the 27th ACM International Conference on Multimedia","author":"Yu Tong","year":"2019","unstructured":"Tong Yu, Yilin Shen, Ruiyi Zhang, Xiangyu Zeng, and Hongxia Jin. 2019. Vision-language recommendation via attribute augmented multimodal reinforcement learning. In Proceedings of the 27th ACM International Conference on Multimedia. 39\u201347."},{"issue":"4","key":"e_1_3_2_89_2","first-page":"5","article-title":"Hierarchical reinforcement learning for course recommendation in MOOCs","volume":"5","author":"Zhang Jing","year":"2019","unstructured":"Jing Zhang, Bowen Hao, Bo Chen, Cuiping Li, Hong Chen, and Jimeng Sund. 2019. Hierarchical reinforcement learning for course recommendation in MOOCs. Psychology 5, 4.64 (2019), 5\u201365.","journal-title":"Psychology"},{"key":"e_1_3_2_90_2","doi-asserted-by":"crossref","unstructured":"Sixiao Zhang Hongxu Chen Xiao Ming Lizhen Cui Hongzhi Yin and Guandong Xu. 2021. Where are we in embedding spaces?(KDD\u201921). Association for Computing Machinery New York NY USA 2223\u20132231.","DOI":"10.1145\/3447548.3467421"},{"key":"e_1_3_2_91_2","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1145\/3097983.3098109","volume-title":"Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Zhang Yutao","year":"2017","unstructured":"Yutao Zhang, Robert Chen, Jie Tang, Walter F. Stewart, and Jimeng Sun. 2017. LEAP: Learning to prescribe effective and safe treatment combinations for multimorbidity. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1315\u20131324."},{"key":"e_1_3_2_92_2","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1145\/3397271.3401170","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Zhao Dongyang","year":"2020","unstructured":"Dongyang Zhao, Liang Zhang, Bo Zhang, Lizhou Zheng, Yongjun Bao, and Weipeng Yan. 2020. MaHRL: Multi-goals abstraction based deep hierarchical reinforcement learning for recommendations. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 871\u2013880."},{"issue":"11","key":"e_1_3_2_93_2","doi-asserted-by":"crossref","first-page":"4680","DOI":"10.1109\/TCYB.2019.2896766","article-title":"Leveraging long and short-term information in content-aware movie recommendation via adversarial training","volume":"50","author":"Zhao Wei","year":"2019","unstructured":"Wei Zhao, Benyou Wang, Min Yang, Jianbo Ye, Zhou Zhao, Xiaojun Chen, and Ying Shen. 2019. Leveraging long and short-term information in content-aware movie recommendation via adversarial training. IEEE Transactions on Cybernetics 50, 11 (2019), 4680\u20134693.","journal-title":"IEEE Transactions on Cybernetics"},{"key":"e_1_3_2_94_2","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1145\/3240323.3240374","volume-title":"Proceedings of the 12th ACM Conference on Recommender Systems","author":"Zhao Xiangyu","year":"2018","unstructured":"Xiangyu Zhao, Long Xia, Liang Zhang, Zhuoye Ding, Dawei Yin, and Jiliang Tang. 2018. Deep reinforcement learning for page-wise recommendations. In Proceedings of the 12th ACM Conference on Recommender Systems. ACM, 95\u2013103."},{"key":"e_1_3_2_95_2","doi-asserted-by":"crossref","first-page":"1883","DOI":"10.1145\/3340531.3412044","volume-title":"Proceedings of the 29th ACM International Conference on Information & Knowledge Management","author":"Zhao Xiangyu","year":"2020","unstructured":"Xiangyu Zhao, Long Xia, Lixin Zou, Hui Liu, Dawei Yin, and Jiliang Tang. 2020. Whole-chain recommendations. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 1883\u20131891."},{"key":"e_1_3_2_96_2","first-page":"167","volume-title":"Proceedings of the 2018 World Wide Web Conference on World Wide Web","author":"Zheng Guanjie","year":"2018","unstructured":"Guanjie Zheng, Fuzheng Zhang, Zihan Zheng, Yang Xiang, Nicholas Jing Yuan, Xing Xie, and Zhenhui Li. 2018. DRN: A deep reinforcement learning framework for news recommendation. In Proceedings of the 2018 World Wide Web Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 167\u2013176."},{"key":"e_1_3_2_97_2","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1145\/3397271.3401174","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Zhou Sijin","year":"2020","unstructured":"Sijin Zhou, Xinyi Dai, Haokun Chen, Weinan Zhang, Kan Ren, Ruiming Tang, Xiuqiang He, and Yong Yu. 2020. Interactive recommender system via knowledge graph-enhanced reinforcement learning. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 179\u2013188."},{"issue":"4","key":"e_1_3_2_98_2","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1109\/TKDE.2019.2891530","article-title":"Addressing the item cold-start problem by attribute-driven active learning","volume":"32","author":"Zhu Yu","year":"2019","unstructured":"Yu Zhu, Jinghao Lin, Shibi He, Beidou Wang, Ziyu Guan, Haifeng Liu, and Deng Cai. 2019. Addressing the item cold-start problem by attribute-driven active learning. IEEE Transactions on Knowledge and Data Engineering 32, 4 (2019), 631\u2013644.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_99_2","first-page":"2810","volume-title":"Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","author":"Zou Lixin","year":"2019","unstructured":"Lixin Zou, Long Xia, Zhuoye Ding, Jiaxing Song, Weidong Liu, and Dawei Yin. 2019. Reinforcement learning to optimize long-term user engagement in recommender systems. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2810\u20132818."},{"key":"e_1_3_2_100_2","first-page":"816","volume-title":"Proceedings of the 13th International Conference on Web Search and Data Mining","author":"Zou Lixin","year":"2020","unstructured":"Lixin Zou, Long Xia, Pan Du, Zhuo Zhang, Ting Bai, Weidong Liu, Jian-Yun Nie, and Dawei Yin. 2020. Pseudo Dyna-Q: A reinforcement learning framework for interactive recommendation. In Proceedings of the 13th International Conference on Web Search and Data Mining. 816\u2013824."}],"container-title":["ACM Transactions on the Web"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580510","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3580510","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:35Z","timestamp":1750178795000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580510"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,22]]},"references-count":99,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,8,31]]}},"alternative-id":["10.1145\/3580510"],"URL":"https:\/\/doi.org\/10.1145\/3580510","relation":{},"ISSN":["1559-1131","1559-114X"],"issn-type":[{"value":"1559-1131","type":"print"},{"value":"1559-114X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,22]]},"assertion":[{"value":"2022-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-10-20","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}