{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T21:08:43Z","timestamp":1784668123611,"version":"3.55.0"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,3,28]],"date-time":"2024-03-28T00:00:00Z","timestamp":1711584000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science and Technology Council, Taiwan","award":["MOST 111-2221-E-A49-125-MY3 and NSTC 112-2634-F-004-001-MBK"],"award-info":[{"award-number":["MOST 111-2221-E-A49-125-MY3 and NSTC 112-2634-F-004-001-MBK"]}]},{"name":"Financial Technology (FinTech) Innovation Research Center"},{"name":"National Yang Ming Chiao Tung University"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2024,4,30]]},"abstract":"<jats:p>The growing number of publications in the field of artificial intelligence highlights the need for researchers to enhance their efficiency in searching for relevant articles. Most paper recommendation models either rely on simplistic citation relationships among papers or focus on content-based approaches, both of which overlook interactions within academic networks. To address the aforementioned problem, knowledge graph embedding (KGE) methods have been used for citation recommendations because recent research proves that graph representations can effectively improve recommendation model accuracy. However, academic networks are dynamic, leading to changes in the representations of users and items over time. The majority of KGE-based citation recommendations are primarily designed for static graphs, thus failing to capture the evolution of dynamic knowledge graph (DKG) structures. To address these challenges, we introduced the evolving knowledge graph embedding (EKGE) method. In this methodology, evolving knowledge graphs are input into time-series models to learn the patterns of structural evolution. The model has the capability to generate embeddings for each entity at various time points, thereby overcoming limitation of static models that require retraining to acquire embeddings at each specific time point. To enhance the efficiency of feature extraction, we employed a multiple attention strategy. This helped the model find recommendation lists that are closely related to a user\u2019s needs, leading to improved recommendation accuracy. Various experiments conducted on a citation recommendation dataset revealed that the EKGE model exhibits a 1.13% increase in prediction accuracy compared to other KGE methods. Moreover, the model\u2019s accuracy can be further increased by an additional 0.84% through the incorporation of an attention mechanism.<\/jats:p>","DOI":"10.1145\/3635273","type":"journal-article","created":{"date-parts":[[2024,1,13]],"date-time":"2024-01-13T13:36:20Z","timestamp":1705152980000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Evolving Knowledge Graph Representation Learning with Multiple Attention Strategies for Citation Recommendation System"],"prefix":"10.1145","volume":"15","author":[{"given":"Jhih-Chen","family":"Liu","sequence":"first","affiliation":[{"name":"Institute of Information Management, National Yang Ming Chiao Tung University, Hsinchu, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chiao-Ting","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chi","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Information Management and Finance, National Yang Ming Chiao Tung University, Hsinchu, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Szu-Hao","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Information Management and Finance, National Yang Ming Chiao Tung University, Hsinchu, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,3,28]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-021-06135-y"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3106426.3106479"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2890388"},{"key":"e_1_3_1_5_2","article-title":"Content-based citation recommendation","author":"Bhagavatula Chandra","year":"2018","unstructured":"Chandra Bhagavatula, Sergey Feldman, Russell Power, and Waleed Ammar. 2018. Content-based citation recommendation. arXiv preprint arXiv:1802.08301 (2018).","journal-title":"arXiv preprint arXiv:1802.08301"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-013-5363-6"},{"key":"e_1_3_1_7_2","first-page":"2787","volume-title":"Advances in Neural Information Processing Systems","author":"Bordes Antoine","year":"2013","unstructured":"Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In Advances in Neural Information Processing Systems. 2787\u20132795."},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1150"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186070"},{"key":"e_1_3_1_10_2","doi-asserted-by":"crossref","unstructured":"Haochen Chen Bryan Perozzi Yifan Hu and Steven Skiena. 2018. HARP: Hierarchical representation learning for networks. In Thirty-Second AAAI Conference on Artificial Intelligence. 2127\u20132134.","DOI":"10.1609\/aaai.v32i1.11849"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5815"},{"key":"e_1_3_1_12_2","first-page":"2782","volume-title":"IJCAI","author":"Gong Yuyun","year":"2016","unstructured":"Yuyun Gong and Qi Zhang. 2016. Hashtag recommendation using attention-based convolutional neural network. In IJCAI. 2782\u20132788."},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052569"},{"key":"e_1_3_1_14_2","first-page":"1","article-title":"Explainable mutual fund recommendation system developed based on knowledge graph embeddings","author":"Hsu Pei-Ying","year":"2022","unstructured":"Pei-Ying Hsu, Chiao-Ting Chen, Chin Chou, and Szu-Hao Huang. 2022. Explainable mutual fund recommendation system developed based on knowledge graph embeddings. Applied Intelligence (2022), 1\u201326.","journal-title":"Applied Intelligence"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2022.10.006"},{"key":"e_1_3_1_16_2","first-page":"1715","volume-title":"Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers","author":"Jiang Tingsong","year":"2016","unstructured":"Tingsong Jiang, Tianyu Liu, Tao Ge, Lei Sha, Baobao Chang, Sujian Li, and Zhifang Sui. 2016. Towards time-aware knowledge graph completion. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. 1715\u20131724."},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/WAINA.2010.35"},{"issue":"70","key":"e_1_3_1_18_2","first-page":"1","article-title":"Representation learning for dynamic graphs: A survey.","volume":"21","author":"Kazemi Seyed Mehran","year":"2020","unstructured":"Seyed Mehran Kazemi, Rishab Goel, Kshitij Jain, Ivan Kobyzev, Akshay Sethi, Peter Forsyth, and Pascal Poupart. 2020. Representation learning for dynamic graphs: A survey. Journal of Machine Learning Research 21, 70 (2020), 1\u201373.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_1_19_2","first-page":"2","volume-title":"Proceedings of NAACL-HLT","volume":"1","author":"Kenton Jacob Devlin, Ming-Wei Chang,","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, KentonLee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT, Vol. 1. 2."},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3132919"},{"key":"e_1_3_1_21_2","article-title":"Effective approaches to attention-based neural machine translation","author":"Luong Minh-Thang","year":"2015","unstructured":"Minh-Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:1508.04025 (2015).","journal-title":"arXiv preprint arXiv:1508.04025"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271733"},{"key":"e_1_3_1_23_2","first-page":"3111","volume-title":"Advances in Neural Information Processing Systems","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems. 3111\u20133119."},{"key":"e_1_3_1_24_2","volume-title":"NeurIPS","author":"Palm Rasmus Berg","year":"2017","unstructured":"Rasmus Berg Palm, Ulrich Paquet, and Ole Winther. 2017. Recurrent relational networks. In NeurIPS."},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5984"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3133005"},{"key":"e_1_3_1_27_2","unstructured":"Alec Radford Karthik Narasimhan Tim Salimans and Ilya Sutskever. 2018. Improving language understanding by generative pre-training. OpenAI Blog (2018) 12."},{"key":"e_1_3_1_28_2","volume-title":"ICML","author":"Sanchez-Gonzalez Alvaro","year":"2018","unstructured":"Alvaro Sanchez-Gonzalez, Nicolas Manfred Otto Heess, Jost Tobias Springenberg, Josh Merel, Martin A. Riedmiller, Raia Hadsell, and Peter W. Battaglia. 2018. Graph networks as learnable physics engines for inference and control. In ICML."},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93417-4_38"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3109859.3109890"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2018.2833443"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2598561"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1402008"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220086"},{"key":"e_1_3_1_35_2","volume-title":"International Conference on Learning Representations","author":"Trivedi Rakshit","year":"2019","unstructured":"Rakshit Trivedi, Mehrdad Farajtabar, Prasenjeet Biswal, and Hongyuan Zha. 2019. DyRep: Learning representations over dynamic graphs. In International Conference on Learning Representations."},{"key":"e_1_3_1_36_2","first-page":"5998","volume-title":"Advances in Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems. 5998\u20136008."},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020480"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11872"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-15-7984-4_1"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3071306"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441739"},{"issue":"1","key":"e_1_3_1_42_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3532192","article-title":"Modeling cross-session information with multi-interest graph neural networks for the next-item recommendation","volume":"17","author":"Wang Ting-Yun","year":"2023","unstructured":"Ting-Yun Wang, Chiao-Ting Chen, Ju-Chun Huang, and Szu-Hao Huang. 2023. Modeling cross-session information with multi-interest graph neural networks for the next-item recommendation. ACM Transactions on Knowledge Discovery from Data 17, 1 (2023), 1\u201328.","journal-title":"ACM Transactions on Knowledge Discovery from Data"},{"issue":"1","key":"e_1_3_1_43_2","first-page":"1","article-title":"Venue topic model\u2013enhanced joint graph modelling for citation recommendation in scholarly big data","volume":"20","author":"Wang Wei","year":"2020","unstructured":"Wei Wang, Zhiguo Gong, Jing Ren, Feng Xia, Zhihan Lv, and Wei Wei. 2020. Venue topic model\u2013enhanced joint graph modelling for citation recommendation in scholarly big data. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 20, 1 (2020), 1\u201315.","journal-title":"ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098096"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i10.21397"},{"key":"e_1_3_1_46_2","first-page":"1","article-title":"Poisoning attacks against knowledge graph-based recommendation systems using deep reinforcement learning","author":"Wu Zih-Wun","year":"2022","unstructured":"Zih-Wun Wu, Chiao-Ting Chen, and Szu-Hao Huang. 2022. Poisoning attacks against knowledge graph-based recommendation systems using deep reinforcement learning. Neural Computing and Applications (2022), 1\u201319.","journal-title":"Neural Computing and Applications"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.120806"},{"key":"e_1_3_1_48_2","article-title":"Temporal knowledge graph embedding model based on additive time series decomposition","author":"Xu Chengjin","year":"2019","unstructured":"Chengjin Xu, Mojtaba Nayyeri, Fouad Alkhoury, Hamed Shariat Yazdi, and Jens Lehmann. 2019. Temporal knowledge graph embedding model based on additive time series decomposition. arXiv preprint arXiv:1911.07893 (2019).","journal-title":"arXiv preprint arXiv:1911.07893"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3582562"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASONAM.2014.6921643"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3635273","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3635273","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:21Z","timestamp":1750178181000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3635273"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,28]]},"references-count":49,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4,30]]}},"alternative-id":["10.1145\/3635273"],"URL":"https:\/\/doi.org\/10.1145\/3635273","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,28]]},"assertion":[{"value":"2021-09-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-10","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}