{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T16:23:40Z","timestamp":1781108620229,"version":"3.54.1"},"reference-count":66,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2022,8,21]],"date-time":"2022-08-21T00:00:00Z","timestamp":1661040000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Information extraction methods proved to be effective at triple extraction from structured or unstructured data. The organization of such triples in the form of (head entity, relation, tail entity) is called the construction of Knowledge Graphs (KGs). Most of the current knowledge graphs are incomplete. In order to use KGs in downstream tasks, it is desirable to predict missing links in KGs. Different approaches have been recently proposed for representation learning of KGs by embedding both entities and relations into a low-dimensional vector space aiming to predict unknown triples based on previously visited triples. According to how the triples will be treated independently or dependently, we divided the task of knowledge graph completion into conventional and graph neural network representation learning and we discuss them in more detail. In conventional approaches, each triple will be processed independently and in GNN-based approaches, triples also consider their local neighborhood.<\/jats:p>","DOI":"10.3390\/info13080396","type":"journal-article","created":{"date-parts":[[2022,8,21]],"date-time":"2022-08-21T23:51:01Z","timestamp":1661125861000},"page":"396","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":88,"title":["A Review of Knowledge Graph Completion"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5070-6007","authenticated-orcid":false,"given":"Mohamad","family":"Zamini","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of North Dakota, Grand Forks, ND 58202, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7593-9624","authenticated-orcid":false,"given":"Hassan","family":"Reza","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of North Dakota, Grand Forks, ND 58202, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7133-3388","authenticated-orcid":false,"given":"Minou","family":"Rabiei","sequence":"additional","affiliation":[{"name":"Department of Petroleum Engineering, University of North Dakota, Grand Forks, ND 58202, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Stokman, F.N., and Vries, P.H.D. (1988). Structuring knowledge in a graph. Human-Computer Interaction, Springer.","DOI":"10.1007\/978-3-642-73402-1_12"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1145\/3329781.3332266","article-title":"Industry-scale Knowledge Graphs: Lessons and Challenges: Five diverse technology companies show how it\u2019s done","volume":"17","author":"Noy","year":"2019","journal-title":"Queue"},{"key":"ref_3","first-page":"4152","article-title":"Building large knowledge-based systems: Representation and inference in the CYC project","volume":"61","author":"Lenat","year":"1993","journal-title":"Artif. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., and Ives, Z. (2007). Dbpedia: A nucleus for a web of open data. The Semantic Web, Springer.","DOI":"10.1007\/978-3-540-76298-0_52"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bollacker, K., Evans, C., Paritosh, P., Sturge, T., and Taylor, J. (2008, January 10\u201312). Freebase: A collaboratively created graph database for structuring human knowledge. Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, Vancouver, BC, Canada.","DOI":"10.1145\/1376616.1376746"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Suchanek, F.M., Kasneci, G., and Weikum, G. (2007, January 8\u201312). Yago: A core of semantic knowledge. Proceedings of the 16th International Conference on World Wide Web, Banff, AB, Canada.","DOI":"10.1145\/1242572.1242667"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1145\/2629489","article-title":"Wikidata: A free collaborative knowledgebase","volume":"57","year":"2014","journal-title":"Commun. ACM"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"136951","DOI":"10.1109\/ACCESS.2019.2942338","article-title":"Decentralized construction of knowledge graphs for deep recommender systems based on blockchain-powered smart contracts","volume":"7","author":"Wang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_9","unstructured":"Antoine, B., Usunier, N., Garcia-Duran, A., Weston, J., and Yakhnenko, O. (2013, January 5\u20138). Translating embeddings for modeling multi-relational data. Proceedings of the 27th Annual Conference on Neural Information Processing Systems 2013, Lake Tahoe, NV, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014, January 27\u201331). Knowledge graph embedding by translating on hyperplanes. Proceedings of the AAAI Conference on Artificial Intelligence, Quebec City, QC, Canada.","DOI":"10.1609\/aaai.v28i1.8870"},{"key":"ref_11","unstructured":"Yang, B., Yih, W.-t., He, X., Gao, J., and Deng, L. (2014). Embedding entities and relations for learning and inference in knowledge bases. arXiv."},{"key":"ref_12","unstructured":"Trouillon, T., Welbl, J., Riedel, S., Gaussier, \u00c9., and Bouchard, G. (2016, January 19\u201324). Complex embeddings for simple link prediction. Proceedings of the International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_13","unstructured":"Sun, Z., Deng, Z.-H., Nie, J.-Y., and Tang, J. (2019). Rotate: Knowledge graph embedding by relational rotation in complex space. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yu, D., Yang, Y., Zhang, R., and Wu, Y. (2021, January 19\u201323). Knowledge embedding based graph convolutional network. Proceedings of the Web Conference 2021, Ljubljana, Slovenia.","DOI":"10.1145\/3442381.3449925"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Schlichtkrull, M., Kipf, T.N., Bloem, P., van den Berg, R., Titov, I., and Welling, M. (2018). Modeling relational data with graph convolutional networks. European Semantic Web Conference, Springer.","DOI":"10.1007\/978-3-319-93417-4_38"},{"key":"ref_16","unstructured":"Vashishth, S., Sanyal, S., Nitin, V., and Talukdar, P. (2019). Composition-based multi-relational graph convolutional networks. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Cai, L., Yan, B., Mai, G., Janowicz, K., and Zhu, R. (2019, January 19\u201321). TransGCN: Coupling transformation assumptions with graph convolutional networks for link prediction. Proceedings of the 10th International Conference on Knowledge Capture, Marina Del Rey, CA, USA.","DOI":"10.1145\/3360901.3364441"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Nathani, D., Chauhan, J., Sharma, C., and Kaul, M. (2019). Learning attention-based embeddings for relation prediction in knowledge graphs. arXiv.","DOI":"10.18653\/v1\/P19-1466"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lin, Y., Liu, Z., Sun, M., Liu, Y., and Zhu, X. (2015, January 25\u201330). Learning entity and relation embeddings for knowledge graph completion. Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9491"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ji, G., He, S., Xu, L., Liu, K., and Zhao, J. (2015, January 26\u201331). Knowledge graph embedding via dynamic mapping matrix. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China.","DOI":"10.3115\/v1\/P15-1067"},{"key":"ref_21","unstructured":"Fan, M., Zhou, Q., Chang, E., and Zheng, F. (2014, January 12\u201314). Transition-based knowledge graph embedding with relational mapping properties. Proceedings of the 28th Pacific Asia Conference on Language, Information and Computing, Phuket, Thailand."},{"key":"ref_22","unstructured":"Ma, L., Sun, P., Lin, Z., and Wang, H. (2019). Composing knowledge graph embeddings via word embeddings. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Cai, J., Zhang, Y., and Wang, J. (2020, January 7\u201312). Learning hierarchy-aware knowledge graph embeddings for link prediction. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i03.5701"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-031-01918-0","article-title":"Knowledge graphs","volume":"Volume 12","author":"Hogan","year":"2021","journal-title":"Synthesis Lectures on Data, Semantics, and Knowledge"},{"key":"ref_25","unstructured":"Nickel, M., Tresp, V., and Kriegel, H.-P. (July, January 28). A three-way model for collective learning on multi-relational data. Proceedings of the 28th International Conference on Machine Learning, Bellevue, WA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2724","DOI":"10.1109\/TKDE.2017.2754499","article-title":"Knowledge graph embedding: A survey of approaches and applications","volume":"29","author":"Wang","year":"2017","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1007\/s10994-013-5363-6","article-title":"A semantic matching energy function for learning with multi-relational data","volume":"94","author":"Bordes","year":"2014","journal-title":"Mach. Learn."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Dettmers, T., Minervini, P., Stenetorp, P., and Riedel, S. (2018, January 2\u20137). Convolutional 2d knowledge graph embeddings. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11573"},{"key":"ref_29","unstructured":"Zhang, S., Tay, Y., Yao, L., and Liu, Q. (2019, January 8\u201314). Quaternion knowledge graph embeddings. Proceedings of the Annual Conference on Neural Information Processing Systems 2019, Vancouver, BC, Canada."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Cao, Z., Xu, Q., Yang, Z., Cao, X., and Huang, Q. (2021, January 2\u20139). Dual quaternion knowledge graph embeddings. Proceedings of the AAAI Conference on Artificial Intelligence, Online.","DOI":"10.1609\/aaai.v35i8.16850"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Bala\u017eevi\u0107, I., Allen, C., and Hospedales, T.M. (2019). Tucker: Tensor factorization for knowledge graph completion. arXiv.","DOI":"10.18653\/v1\/D19-1522"},{"key":"ref_32","unstructured":"Wang, Q., Wang, B., and Guo, L. (2015, January 25\u201331). Knowledge base completion using embeddings and rules. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Guo, S., Wang, Q., Wang, B., Wang, L., and Guo, L. (2015, January 26\u201331). Semantically smooth knowledge graph embedding. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China.","DOI":"10.3115\/v1\/P15-1009"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lin, Y., Liu, Z., Luan, H., Sun, M., Rao, S., and Liu, S. (2015). Modeling relation paths for representation learning of knowledge bases. arXiv.","DOI":"10.18653\/v1\/D15-1082"},{"key":"ref_35","unstructured":"Socher, R., Chen, D., Manning, C.D., and Ng, A. (2013, January 5\u20138). Reasoning with neural tensor networks for knowledge base completion. Proceedings of the 27th Annual Conference on Neural Information Processing Systems 2013, Lake Tahoe, NV, USA."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Bala\u017eevi\u0107, I., Allen, C., and Hospedales, T.M. (2019, January 17\u201319). Hypernetwork knowledge graph embeddings. Proceedings of the International Conference on Artificial Neural Networks, Munich, Germany.","DOI":"10.1007\/978-3-030-30493-5_52"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Vashishth, S., Sanyal, S., Nitin, V., Agrawal, N., and Talukdar, P. (2020, January 7\u201312). Interacte: Improving convolution-based knowledge graph embeddings by increasing feature interactions. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i03.5694"},{"key":"ref_38","unstructured":"Yu, D., Zhu, C., Yang, Y., and Zeng, M. (2020). Jaket: Joint pre-training of knowledge graph and language understanding. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Nguyen, D.Q., Nguyen, T.D., Nguyen, D.Q., and Phung, D. (2017). A novel embedding model for knowledge base completion based on convolutional neural network. arXiv.","DOI":"10.18653\/v1\/N18-2053"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Demir, C., and Ngomo, A.-C.N. (2021). Convolutional complex knowledge graph embeddings. European Semantic Web Conference, Springer.","DOI":"10.1007\/978-3-030-77385-4_24"},{"key":"ref_41","first-page":"24695","article-title":"Rot-pro: Modeling transitivity by projection in knowledge graph embedding","volume":"34","author":"Song","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_42","unstructured":"Li, Y., Tarlow, D., Brockschmidt, M., and Zemel, R. (2015). Gated graph sequence neural networks. arXiv."},{"key":"ref_43","unstructured":"Guo, L., Wang, W., Sun, Z., Liu, C., and Hu, W. (2020). Decentralized Knowledge Graph Representation Learning. arXiv."},{"key":"ref_44","first-page":"71","article-title":"Knowledge Graphs","volume":"54","author":"Hogan","year":"2021","journal-title":"ACM Comput. Surv."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"714","DOI":"10.1109\/72.572108","article-title":"Supervised neural networks for the classification of structures","volume":"8","author":"Sperduti","year":"1997","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_46","unstructured":"Gori, M., Monfardini, G., and Scarselli, F. (August, January 31). A new model for learning in graph domains. Proceedings of the 2005 IEEE International Joint Conference on Neural Networks, Montreal, QC, Canada."},{"key":"ref_47","unstructured":"Hamilton, W., Ying, Z., and Leskovec, J. (2017, January 4\u20139). Inductive representation learning on large graphs. Proceedings of the Annual Conference on Neural Information Processing Systems 2017, Long Beach, CA, USA."},{"key":"ref_48","first-page":"9649","article-title":"Boxe: A box embedding model for knowledge base completion","volume":"33","author":"Abboud","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_49","unstructured":"Veli\u010dkovi\u0107, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., and Bengio, Y. (2017). Graph attention networks. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Marcheggiani, D., and Titov, I. (2017). Encoding sentences with graph convolutional networks for semantic role labeling. arXiv.","DOI":"10.18653\/v1\/D17-1159"},{"key":"ref_51","unstructured":"Shang, C., Tang, Y., Huang, J., Bi, J., He, X., and Zhou, B. (February, January 27). End-to-end structure-aware convolutional networks for knowledge base completion. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Li, J., Shomer, H., Ding, J., Wang, Y., Ma, Y., Shah, N., Tang, J., and Yin, D. (2022). Are Graph Neural Networks Really Helpful for Knowledge Graph Completion?. arXiv.","DOI":"10.18653\/v1\/2023.acl-long.597"},{"key":"ref_53","unstructured":"Kazemi, S.M., and Poole, D. (2018, January 3\u20138). Simple embedding for link prediction in knowledge graphs. Proceedings of the Thirty-Second Annual Conference on Neural Information Processing Systems, Montr\u00e9al, QC, Canada."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Tian, A., Zhang, C., Rang, M., Yang, X., and Zhan, Z. (2020, January 15\u201317). RA-GCN: Relational aggregation graph convolutional network for knowledge graph completion. Proceedings of the 2020 12th International Conference on Machine Learning and Computing, Shenzhen, China.","DOI":"10.1145\/3383972.3384067"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W.L., and Leskovec, J. (2018, January 19\u201323). Graph convolutional neural networks for web-scale recommender systems. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK.","DOI":"10.1145\/3219819.3219890"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"20840","DOI":"10.1109\/ACCESS.2021.3055529","article-title":"RAGAT: Relation aware graph attention network for knowledge graph completion","volume":"9","author":"Liu","year":"2021","journal-title":"IEEE Access"},{"key":"ref_57","unstructured":"Chen, M., Zhang, Y., Kou, X., Li, Y., and Zhang, Y. (2021). r-GAT: Relational Graph Attention Network for Multi-Relational Graphs. arXiv."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"224860","DOI":"10.1109\/ACCESS.2020.3044343","article-title":"Graph attention networks with local structure awareness for knowledge graph completion","volume":"8","author":"Ji","year":"2020","journal-title":"IEEE Access"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Wu, J., Shi, W., Cao, X., Chen, J., Lei, W., Zhang, F., Wu, W., and He, X. (2021, January 1\u20135). DisenKGAT: Knowledge Graph Embedding with Disentangled Graph Attention Network. Proceedings of the 30th ACM International Conference on Information & Knowledge Management, Gold Coast, Australia.","DOI":"10.1145\/3459637.3482424"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"3961","DOI":"10.1109\/TNNLS.2021.3055147","article-title":"Learning knowledge graph embedding with heterogeneous relation attention networks","volume":"33","author":"Li","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_61","unstructured":"Yao, L., Mao, C., and Luo, Y. (2019). KG-BERT: BERT for knowledge graph completion. arXiv."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1162\/tacl_a_00360","article-title":"KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation","volume":"9","author":"Wang","year":"2021","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Petroni, F., Rockt\u00e4schel, T., Lewis, P., Bakhtin, A., Wu, Y., Miller, A.H., and Riedel, S. (2019). Language models as knowledge bases?. arXiv.","DOI":"10.18653\/v1\/D19-1250"},{"key":"ref_64","unstructured":"Wang, C., Liu, X., and Song, D. (2020). Language models are open knowledge graphs. arXiv."},{"key":"ref_65","unstructured":"Talukdar, P.P. (2021). OKGIT: Open Knowledge Graph Link Prediction with Implicit Types. arXiv."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Chen, S., Wang, J., Jiang, F., and Lin, C.-Y. (2020, January 7\u201312). Improving entity linking by modeling latent entity type information. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i05.6251"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/8\/396\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:13:08Z","timestamp":1760141588000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/8\/396"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,21]]},"references-count":66,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["info13080396"],"URL":"https:\/\/doi.org\/10.3390\/info13080396","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,21]]}}}