{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T06:20:23Z","timestamp":1772000423316,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T00:00:00Z","timestamp":1771200000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Project of State Grid Hebei Information and Telecommunication Branch","award":["kj2024-018"],"award-info":[{"award-number":["kj2024-018"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Real-world Knowledge Graphs (KGs) are inherently incomplete, which hinders effective downstream reasoning. While Large Language Models (LLMs) possess powerful semantic capabilities, directly applying them to Knowledge Graph Completion (KGC) often leads to hallucinations and a lack of structural awareness. To address these challenges, we propose Embedding-Guided Instruction Tuning (EGIT), a novel framework that synergizes the structural precision of embedding models with the semantic reasoning of LLMs. Our approach operates in three key stages: (1) utilizing pre-trained embedding models to automatically synthesize high-quality, annotation-free instruction data; (2) fine-tuning the LLM with these structure-aware instructions to adapt it to the KGC task; and (3) employing a joint inference mechanism where the embedding model retrieves candidates and the fine-tuned LLM performs the final selection, thereby significantly reducing hallucinations. In extensive experiments, the best variant of EGIT achieves 7.0% and 2.5% improvements in Hits@1 on the FB15k-237 and WN18RR datasets, respectively.<\/jats:p>","DOI":"10.3390\/info17020207","type":"journal-article","created":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T12:37:28Z","timestamp":1771245448000},"page":"207","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Mitigating Hallucinations in Knowledge Graph Completion via Embedding-Guided Instruction Tuning"],"prefix":"10.3390","volume":"17","author":[{"given":"Pengfei","family":"Zhang","sequence":"first","affiliation":[{"name":"State Grid Hebei Information and Telecommunication Branch, Shijiazhuang 050011, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4564-470X","authenticated-orcid":false,"given":"Xing","family":"Xu","sequence":"additional","affiliation":[{"name":"State Grid Hebei Information and Telecommunication Branch, Shijiazhuang 050011, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junying","family":"Wu","sequence":"additional","affiliation":[{"name":"State Grid Hebei Information and Telecommunication Branch, Shijiazhuang 050011, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xin","family":"Lu","sequence":"additional","affiliation":[{"name":"State Grid Hebei Information and Telecommunication Branch, Shijiazhuang 050011, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiahao","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaodong","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dezhi","family":"Cui","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiuxian","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0560-2935","authenticated-orcid":false,"given":"Sihao","family":"He","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ping","family":"Zong","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0707-2176","authenticated-orcid":false,"given":"Guoxin","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6769-3177","authenticated-orcid":false,"given":"Zhonghong","family":"Ou","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6626-9932","authenticated-orcid":false,"given":"Meina","family":"Song","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7695-1633","authenticated-orcid":false,"given":"Yifan","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,2,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Yani, M., and Krisnadhi, A.A. (2021). Challenges, techniques, and trends of simple knowledge graph question answering: A survey. Information, 12.","DOI":"10.3390\/info12070271"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3549","DOI":"10.1109\/TKDE.2020.3028705","article-title":"A survey on knowledge graph-based recommender systems","volume":"34","author":"Guo","year":"2020","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"10001","DOI":"10.1021\/acs.chemrev.5c00461","article-title":"Graph Neural Networks in Modern AI-Aided Drug Discovery","volume":"125","author":"Zhang","year":"2025","journal-title":"Chem. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1016\/j.neucom.2021.04.039","article-title":"Molecular generative graph neural networks for drug discovery","volume":"450","author":"Bongini","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bollacker, K., Evans, C., Paritosh, P., Sturge, T., and Taylor, J. (2008, January 9\u201312). Freebase: A collaboratively created graph database for structuring human knowledge. Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, Vancouver, BC, Canada.","DOI":"10.1145\/1376616.1376746"},{"key":"ref_6","unstructured":"Bian, H. (2025). LLM-empowered knowledge graph construction: A survey. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1109\/TNNLS.2021.3070843","article-title":"A survey on knowledge graphs: Representation, acquisition, and applications","volume":"33","author":"Ji","year":"2021","journal-title":"IEEE Trans. Neural Networks Learn. Syst."},{"key":"ref_8","first-page":"1","article-title":"PyKEEN 1.0: A python library for training and evaluating knowledge graph embeddings","volume":"22","author":"Ali","year":"2021","journal-title":"J. Mach. Learn. Res."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yao, L., Peng, J., Mao, C., and Luo, Y. (2025). Exploring large language models for knowledge graph completion. Proceedings of the ICASSP 2025\u20142025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Hyderabad, India, 6\u201311 April 2025, IEEE.","DOI":"10.1109\/ICASSP49660.2025.10889242"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3571730","article-title":"Survey of hallucination in natural language generation","volume":"55","author":"Ji","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1162\/COLI.a.16","article-title":"Siren\u2019s Song in the AI Ocean: A Survey on Hallucination in Large Language Models","volume":"51","author":"Zhang","year":"2025","journal-title":"Comput. Linguist."},{"key":"ref_12","unstructured":"Wagner, R., Kitzelmann, E., and Boersch, I. (August, January 27). Mitigating hallucination by integrating knowledge graphs into LLM inference\u2013a systematic literature review. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics, Vienna, Austria."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wei, Y., Huang, Q., Zhang, Y., and Kwok, J. (2023, January 6\u201310). Kicgpt: Large language model with knowledge in context for knowledge graph completion. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore.","DOI":"10.18653\/v1\/2023.findings-emnlp.580"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Dong, Q., Li, L., Dai, D., Zheng, C., Ma, J., Li, R., Xia, H., Xu, J., Wu, Z., and Chang, B. (2024, January 12\u201316). A survey on in-context learning. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Miami, FL, USA.","DOI":"10.18653\/v1\/2024.emnlp-main.64"},{"key":"ref_15","unstructured":"Zhang, Y., Chen, Z., Guo, L., Xu, Y., Zhang, W., and Chen, H. (November, January 28). Making large language models perform better in knowledge graph completion. Proceedings of the 32nd ACM International Conference on Multimedia, Melbourne, Australia."},{"key":"ref_16","first-page":"3","article-title":"Lora: Low-rank adaptation of large language models","volume":"1","author":"Hu","year":"2022","journal-title":"ICLR"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, Y., Cao, Y., Lin, X., Shang, Y., Wang, S., and Pan, S. (2025, January 4\u20139). Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuning. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, Suzhou, China.","DOI":"10.18653\/v1\/2025.emnlp-main.1061"},{"key":"ref_18","first-page":"2787","article-title":"Translating embeddings for modeling multi-relational data","volume":"26","author":"Bordes","year":"2013","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014, January 27\u201331). Knowledge graph embedding by translating on hyperplanes. Proceedings of the AAAI Conference on Artificial Intelligence, Qu\u00e9bec, QC, Canada.","DOI":"10.1609\/aaai.v28i1.8870"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lin, Y., Liu, Z., Sun, M., Liu, Y., and Zhu, X. (2015, January 25\u201330). Learning entity and relation embeddings for knowledge graph completion. Proceedings of the AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9491"},{"key":"ref_21","unstructured":"Sun, Z., Deng, Z.H., Nie, J.Y., and Tang, J. (2019, January 6\u20139). Rotate: Knowledge graph embedding by relational rotation in complex space. Proceedings of the International Conference on Learning Representations (ICLR), New Orleans, LA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Cai, J., Zhang, Y., and Wang, J. (2020, January 7\u201312). Learning hierarchy-aware knowledge graph embeddings for link prediction. Proceedings of the AAAI conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i03.5701"},{"key":"ref_23","unstructured":"Yang, B., Yih, W.T., He, X., Gao, J., and Deng, L. (2015, January 7\u20139). Embedding entities and relations for learning and inference in knowledge bases. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_24","unstructured":"Trouillon, T., Welbl, J., Riedel, S., Gaussier, \u00c9., and Bouchard, G. (2016, January 20\u201322). Complex embeddings for simple link prediction. Proceedings of the International Conference on Machine Learning. PMLR, New York, NY, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bala\u017eevi\u0107, I., Allen, C., and Hospedales, T. (2019, January 3\u20137). Tucker: Tensor factorization for knowledge graph completion. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1522"},{"key":"ref_26","unstructured":"Kazemi, S.M., and Poole, D. (2018, January 3\u20138). SimplE Embedding for Link Prediction in Knowledge Graphs. Proceedings of the Advances in Neural Information Processing Systems, Montr\u00e9al, QC, Canada."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Dettmers, T., Minervini, P., Stenetorp, P., and Riedel, S. (2018, January 2\u20137). Convolutional 2d knowledge graph embeddings. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11573"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Nguyen, T.D., Nguyen, D.Q., and Phung, D. (2018, January 1\u20136). A novel embedding model for knowledge base completion based on convolutional neural network. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, New Orleans, LA, USA.","DOI":"10.18653\/v1\/N18-2053"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Schlichtkrull, M., Kipf, T.N., Bloem, P., Van Den Berg, R., Titov, I., and Welling, M. (2018). Modeling relational data with graph convolutional networks. Proceedings of the European Semantic Web Conference, Springer.","DOI":"10.1007\/978-3-319-93417-4_38"},{"key":"ref_30","unstructured":"Vashishth, S., Sanyal, S., Nitin, V., and Talukdar, P. (2020, January 26\u201330). Composition-based multi-relational graph convolutional networks. Proceedings of the International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia."},{"key":"ref_31","unstructured":"Zhu, Z., Zhang, Z., Xhonneux, L.P., and Tang, J. (2021, January 6\u201314). Neural bellman-ford networks: A general graph neural network framework for link prediction. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Online."},{"key":"ref_32","unstructured":"Zhang, Y., and Yao, Q. (30\u20134, January 30). Knowledge graph reasoning with relational digraph. Proceedings of the Web Conference (WWW), Austin, TX, USA."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Xiao, H., Huang, M., Meng, L., and Zhu, X. (2017, January 4\u20139). SSP: Semantic space projection for knowledge graph embedding with text descriptions. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.10952"},{"key":"ref_34","unstructured":"Yao, L., Mao, C., and Luo, Y. (2019). KG-BERT: BERT for knowledge graph completion. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, B., Shen, T., Long, G., Zhou, T., Wang, Y., and Chang, Y. (2021, January 19\u201323). Structure-augmented text representation learning for efficient knowledge graph completion. Proceedings of the Web Conference 2021, Ljubljana, Slovenia.","DOI":"10.1145\/3442381.3450043"},{"key":"ref_36","unstructured":"Wang, W., Bi, B., Yan, M., Wu, C., Bao, Z., Xia, J., Peng, L., and Si, L. (2019, January 6\u20139). Structbert: Incorporating language structures into pre-training for deep language understanding. Proceedings of the International Conference on Learning Representations (ICLR), New Orleans, LA, USA."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, L., Zhao, W., Wei, Z., and Liu, J. (2022). SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland, 22\u201327 May 2022, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.acl-long.295"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Saxena, A., Kochsiek, A., and Gemulla, R. (2022). Sequence-to-Sequence Knowledge Graph Completion and Question Answering. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland, 22\u201327 May 2022, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.acl-long.201"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Xie, X., Zhang, N., Li, Z., Deng, S., Chen, H., Xiong, F., Chen, M., and Chen, H. (2022, January 25\u201329). From discrimination to generation: Knowledge graph completion with generative transformer. Proceedings of the Companion Proceedings of the Web Conference 2022, Lyon, France.","DOI":"10.1145\/3487553.3524238"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Chen, B., and Bertozzi, A.L. (2023). AutoKG: Efficient automated knowledge graph generation for language models. Proceedings of the 2023 IEEE International Conference on Big Data (BigData), Sorrento, Italy, 15\u201318 December 2023, IEEE.","DOI":"10.1109\/BigData59044.2023.10386454"},{"key":"ref_41","unstructured":"Chen, J., Ma, L., Li, X., Thakurdesai, N., Xu, J., Cho, J.H., Nag, K., Korpeoglu, E., Kumar, S., and Achan, K. (2023). Knowledge graph completion models are few-shot learners: An empirical study of relation labeling in e-commerce with llms. arXiv."},{"key":"ref_42","first-page":"9459","article-title":"Retrieval-augmented generation for knowledge-intensive nlp tasks","volume":"33","author":"Lewis","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_43","unstructured":"Galkin, M., Yuan, X., Mostafa, H., Tang, J., and Zhu, Z. (2023, January 15). Towards Foundation Models for Knowledge Graph Reasoning. Proceedings of the NeurIPS 2023 Workshop: New Frontiers in Graph Learning, New Orleans, LA, USA."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Guan, X., Liu, Y., Lin, H., Lu, Y., He, B., Han, X., and Sun, L. (2024, January 20\u201327). Mitigating large language model hallucinations via autonomous knowledge graph-based retrofitting. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.","DOI":"10.1609\/aaai.v38i16.29770"},{"key":"ref_45","first-page":"10088","article-title":"Qlora: Efficient finetuning of quantized llms","volume":"36","author":"Dettmers","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_46","unstructured":"Nickel, M., Tresp, V., and Kriegel, H.P. (July, January 28). A three-way model for collective learning on multi-relational data. Proceedings of the International Conference on Machine Learning, Bellevue, WA, USA."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zhou, Z., Yao, Q., and Li, Y. (2022). KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learning. arXiv.","DOI":"10.18653\/v1\/2022.acl-long.194"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Shomer, H., Jin, W., Wang, W., and Tang, J. (May, January 30). Toward Degree Bias in Embedding-Based Knowledge Graph Completion. Proceedings of the ACM Web Conference 2023, New York, NY, USA.","DOI":"10.1145\/3543507.3583544"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Liu, Y., Cao, Z., Gao, X., Zhang, J., and Yan, R. (2024, January 13\u201317). Bridging the Space Gap: Unifying Geometry Knowledge Graph Embedding with Optimal Transport. Proceedings of the ACM Web Conference 2024, New York, NY, USA.","DOI":"10.1145\/3589334.3645565"},{"key":"ref_50","unstructured":"Rogers, A., Boyd-Graber, J., and Okazaki, N. (2023). Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Prompting. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, Association for Computational Linguistics."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/17\/2\/207\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T05:20:39Z","timestamp":1771996839000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/17\/2\/207"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,16]]},"references-count":50,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2026,2]]}},"alternative-id":["info17020207"],"URL":"https:\/\/doi.org\/10.3390\/info17020207","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,16]]}}}