{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:33:53Z","timestamp":1760150033180,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,9,30]],"date-time":"2023-09-30T00:00:00Z","timestamp":1696032000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Temporal knowledge graphs play an increasingly prominent role in scenarios such as social networks, finance, and smart cities. As such, research on temporal knowledge graphs continues to deepen. In particular, research on temporal knowledge graph reasoning holds great significance, as it can provide abundant knowledge for downstream tasks such as question answering and recommendation systems. Current reasoning research focuses primarily on interpolation and extrapolation. Extrapolation research aims to predict the likelihood of events occurring in future timestamps. Historical events are crucial for predicting future events. However, existing models struggle to fully capture the evolutionary characteristics of historical knowledge graphs. This paper proposes a multi-scale evolutionary network (MSEN) model that leverages Hierarchical Transfer aware Graph Neural Network (HT-GNN) in a local memory encoder to aggregate rich structural semantics from each timestamp\u2019s knowledge graph. It also utilizes Time Related Graph Neural Network (TR-GNN) in a global memory encoder to model temporal-semantic dependencies of entities across the global knowledge graph, mining global evolutionary patterns. The model integrates information from both encoders to generate entity embeddings for predicting future events. The proposed MSEN model demonstrates strong performance compared to several baselines on typical benchmark datasets. Results show MSEN achieves the highest prediction accuracy.<\/jats:p>","DOI":"10.3390\/fi15100327","type":"journal-article","created":{"date-parts":[[2023,10,2]],"date-time":"2023-10-02T04:17:19Z","timestamp":1696220239000},"page":"327","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["MSEN: A Multi-Scale Evolutionary Network for Modeling the Evolution of Temporal Knowledge Graphs"],"prefix":"10.3390","volume":"15","author":[{"given":"Yong","family":"Yu","sequence":"first","affiliation":[{"name":"Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100191, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shudong","family":"Chen","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100191, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rong","family":"Du","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Da","family":"Tong","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100191, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hao","family":"Xu","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100191, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuai","family":"Chen","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100191, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,30]]},"reference":[{"key":"ref_1","unstructured":"Yang, B., Yih, W.T., He, X., Gao, J., and Deng, L. (2015, January 7\u20139). Embedding Entities and Relations for Learning and Inference in Knowledge Bases. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_2","unstructured":"Trouillon, T., Welbl, J., Riedel, S., Gaussier, \u00c9., and Bouchard, G. (2016, January 19\u201324). Complex Embeddings for Simple Link Prediction. Proceedings of the 33rd International Conference on Machine Learning, New York City, NY, USA."},{"key":"ref_3","unstructured":"Schlichtkrull, M., Kipf, T.N., Bloem, P., Van Den Berg, R., Titov, I., and Welling, M. (2018). Proceedings of the Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, 3\u20137 June 2018, Proceedings 15, Springer International Publishing."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Dettmers, T., Minervini, P., Stenetorp, P., and Riedel, S. (2018, January 2\u20137). Convolutional 2D Knowledge Graph Embeddings. Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI-18), New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11573"},{"key":"ref_5","unstructured":"Sun, Z., Deng, Z.H., Nie, J.Y., and Tang, J. (2019, January 6\u20139). RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. Proceedings of the 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Jin, W., Qu, M., Jin, X., and Ren, X. (2020, January 16\u201320). Recurrent Event Network: Autoregressive Structure Inference over Temporal Knowledge Graphs. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.","DOI":"10.18653\/v1\/2020.emnlp-main.541"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Li, Z., Guan, S., Jin, X., Peng, W., Lyu, Y., Zhu, Y., Bai, L., Li, W., Guo, J., and Cheng, X. (2022). Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoning. arXiv.","DOI":"10.18653\/v1\/2022.acl-short.32"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhu, C., Chen, M., Fan, C., Cheng, G., and Zhang, Y. (2020). Learning from History: Modeling Temporal Knowledge Graphs with Sequential Copy-Generation Networks. arXiv.","DOI":"10.1609\/aaai.v35i5.16604"},{"key":"ref_9","unstructured":"Han, Z., Chen, P., Ma, Y., and Tresp, V. (2021, January 3\u20137). Explainable Subgraph Reasoning for Forecasting on Temporal Knowledge Graphs. Proceedings of the International Conference on Learning Representations, Virtual Event, Austria."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sun, H., Zhong, J., Ma, Y., Han, Z., and He, K. (2021). TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph Forecasting. arXiv.","DOI":"10.18653\/v1\/2021.emnlp-main.655"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Xu, Y., Ou, J., Xu, H., and Fu, L. (2023, January 7\u201314). Temporal knowledge graph reasoning with historical contrastive learning. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.","DOI":"10.1609\/aaai.v37i4.25601"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Li, Z., Jin, X., Li, W., Guan, S., Guo, J., Shen, H., Wang, Y., and Cheng, X. (2021, January 11\u201315). Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learning. Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Montreal, QC, Canada.","DOI":"10.1145\/3404835.3462963"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Han, Z., Ding, Z., Ma, Y., Gu, Y., and Tresp, V. (2021, January 7\u201311). Learning Neural Ordinary Equations for Forecasting Future Links on Temporal Knowledge Graphs. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Online and Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2021.emnlp-main.658"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, Y., Sun, S., and Zhao, J. (2022, January 23\u201329). TiRGN: Time-guided recurrent graph network with local-global historical patterns for temporal knowledge graph reasoning. Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI 2022, Vienna, Austria.","DOI":"10.24963\/ijcai.2022\/299"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, M., Xia, Y., Liu, Q., Wu, S., and Wang, L. (2023, January 9\u201314). Learning Latent Relations for Temporal Knowledge Graph Reasoning. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, Toronto, ON, Canada.","DOI":"10.18653\/v1\/2023.acl-long.705"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Leblay, J., and Chekol, M.W. (2018, January 23\u201327). Deriving Validity Time in Knowledge Graph. Proceedings of the Companion of the the Web Conference, Lyon, France.","DOI":"10.1145\/3184558.3191639"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-Dur\u00e1n, A., Duman\u010di\u0107, S., and Niepert, M. (November, January 31). Learning Sequence Encoders for Temporal Knowledge Graph Completion. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1516"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Dasgupta, S.S., Ray, S.N., and Talukdar, P. (November, January 31). HyTE: Hyperplane-based Temporally aware Knowledge Graph Embedding. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1225"},{"key":"ref_19","unstructured":"Lacroix, T., Obozinski, G., and Usunier, N. (2020). Tensor Decompositions for Temporal Knowledge Base Completion. arXiv."},{"key":"ref_20","unstructured":"Goel, R., Kazemi, S.M., Brubaker, M., and Poupart, P. (2020, January 7\u201312). Diachronic Embedding for Temporal Knowledge Graph Completion. Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, New York, NY, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sadeghian, A., Armandpour, M., Colas, A., and Wang, D.Z. (2021). ChronoR: Rotation Based Temporal Knowledge Graph Embedding. arXiv.","DOI":"10.1609\/aaai.v35i7.16802"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fu, G., Meng, Z., Han, Z., Ding, Z., Ma, Y., Schubert, M., Tresp, V., and Wattenhofer, R. (2022, January 27). TempCaps: A Capsule Network-based Embedding Model for Temporal Knowledge Graph Completion. Proceedings of the Sixth Workshop on Structured Prediction for NLP, SPNLP@ACL 2022, Dublin, Ireland.","DOI":"10.18653\/v1\/2022.spnlp-1.3"},{"key":"ref_23","unstructured":"Linhai, Z., and Deyu, Z. (2022, January 12\u201317). Temporal Knowledge Graph Completion with Approximated Gaussian Process Embedding. Proceedings of the 29th International Conference on Computational Linguistics, Gyeongju, Republic of Korea."},{"key":"ref_24","unstructured":"Han, Z., Wang, Y., Ma, Y., G\u00fcnnemann, S., and Tresp, V. (2020). Graph Hawkes Network for Reasoning on Temporal Knowledge Graphs. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Li, Z., Jin, X., Guan, S., Li, W., Guo, J., Wang, Y., and Cheng, X. (2021). Search from History and Reason for Future: Two-stage Reasoning on Temporal Knowledge Graphs. arXiv.","DOI":"10.18653\/v1\/2021.acl-long.365"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Deng, S., Rangwala, H., and Ning, Y. (2020, January 6\u201310). Dynamic Knowledge Graph based Multi-Event Forecasting. Proceedings of the KDD \u201920: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. ACM, Virtual Event, CA, USA.","DOI":"10.1145\/3394486.3403209"},{"key":"ref_27","unstructured":"Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., and Yakhnenko, O. (2013, January 5\u20138). Translating Embeddings for Modeling Multi-relational Data. Proceedings of the Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_28","unstructured":"Zhang, M., Xia, Y., Liu, Q., Wu, S., and Wang, L. (May, January 30). Learning long-and short-term representations for temporal knowledge graph reasoning. Proceedings of the ACM Web Conference, Austin, TX, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hu, L., Yang, T., Zhang, L., Zhong, W., Tang, D., Shi, C., Duan, N., and Zhou, M. (2021, January 1\u20136). Compare to The Knowledge: Graph Neural Fake News Detection with External Knowledge. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Virtual.","DOI":"10.18653\/v1\/2021.acl-long.62"},{"key":"ref_30","unstructured":"Boschee, E., Lautenschlager, J., O\u2019Brien, S., Shellman, S., Starz, J., Ward, M., Natarajan, D., Bagozzi, B., Berger, D., and Carley, K.M. (2023, September 27). ICEWS Coded Event Data. Harvard Dataverse 2015. Available online: https:\/\/dataverse.harvard.edu\/dataset.xhtml?persistentId=doi:10.7910\/DVN\/28075."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Nathani, D., Chauhan, J., Sharma, C., and Kaul, M. (2019). Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs. arXiv.","DOI":"10.18653\/v1\/P19-1466"},{"key":"ref_32","unstructured":"Vashishth, S., Sanyal, S., Nitin, V., and Talukdar, P. (2020, January 30). Composition-based Multi-Relational Graph Convolutional Networks. Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/15\/10\/327\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:03:11Z","timestamp":1760130191000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/15\/10\/327"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,30]]},"references-count":32,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["fi15100327"],"URL":"https:\/\/doi.org\/10.3390\/fi15100327","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2023,9,30]]}}}