{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T15:46:20Z","timestamp":1792856780149,"version":"4.5.0"},"reference-count":81,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,1,4]],"date-time":"2021-01-04T00:00:00Z","timestamp":1609718400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2021,4,30]]},"abstract":"<jats:p>\n                    Knowledge Graphs (KGs) have found many applications in industrial and in academic settings, which in turn, have motivated considerable research efforts towards large-scale information extraction from a variety of sources. Despite such efforts, it is well known that even the largest KGs suffer from incompleteness; Link Prediction (LP) techniques address this issue by identifying missing facts among entities already in the KG. Among the recent LP techniques, those based on\n                    <jats:italic>KG embeddings<\/jats:italic>\n                    have achieved very promising performance in some benchmarks. Despite the fast-growing literature on the subject, insufficient attention has been paid to the effect of the design choices in those methods. Moreover, the standard practice in this area is to report accuracy by aggregating over a large number of test facts in which some entities are vastly more represented than others; this allows LP methods to exhibit good results by just attending to structural properties that include such entities, while ignoring the remaining majority of the KG. This analysis provides a comprehensive comparison of embedding-based LP methods, extending the dimensions of analysis beyond what is commonly available in the literature. We experimentally compare the effectiveness and efficiency of 18 state-of-the-art methods, consider a rule-based baseline, and report detailed analysis over the most popular benchmarks in the literature.\n                  <\/jats:p>","DOI":"10.1145\/3424672","type":"journal-article","created":{"date-parts":[[2021,1,4]],"date-time":"2021-01-04T09:34:22Z","timestamp":1609752862000},"page":"1-49","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":481,"title":["Knowledge Graph Embedding for Link Prediction"],"prefix":"10.1145","volume":"15","author":[{"given":"Andrea","family":"Rossi","sequence":"first","affiliation":[{"name":"Roma Tre University, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Denilson","family":"Barbosa","sequence":"additional","affiliation":[{"name":"University of Alberta, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Donatella","family":"Firmani","sequence":"additional","affiliation":[{"name":"Roma Tre University, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonio","family":"Matinata","sequence":"additional","affiliation":[{"name":"Roma Tre University, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paolo","family":"Merialdo","sequence":"additional","affiliation":[{"name":"Roma Tre University, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,1,4]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3371315"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3269266"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1068"},{"key":"e_1_2_1_4_1","volume-title":"Dbpedia: A nucleus for a web of open data. In The Semantic Web","author":"Auer S\u00f6ren","year":"2007"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing.","author":"Balazevic Ivana"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376746"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 26th International Conference on Neural Information Processing Systems.","author":"Bordes Antoine","year":"2013"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2018.2807452"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics.","author":"Sharma Aditya"},{"key":"e_1_2_1_10_1","volume-title":"Rory McGrath, Nicholas McCarthy, and Pedro Tabacof.","author":"Costabello Luca","year":"2019"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 32nd AAAI Conference on Artificial Intelligence.","author":"Dettmers Tim","year":"2018"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623623"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 2018 AAAI Conference on Artificial Intelligence.","author":"Ebisu Takuma","year":"2018"},{"key":"e_1_2_1_14_1","volume-title":"Tibshirani","author":"Efron Bradley","year":"1994"},{"key":"e_1_2_1_15_1","volume-title":"Retrieved","author":"Research Facebook","year":"2019"},{"key":"e_1_2_1_16_1","volume-title":"Retrieved","author":"Fatemi Bahare","year":"2019"},{"key":"e_1_2_1_17_1","volume-title":"Knowledge hypergraphs: Extending knowledge graphs beyond binary relations. CoRR abs\/1906.00137","author":"Fatemi Bahare","year":"2019"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488425"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-015-0394-1"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 2019 Workshop on Deep Learning for Knowledge Graphs.","author":"Gesese Genet Asefa","year":"2019"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 2019 International Conference on Machine Learning.","author":"Guo Lingbing","year":"2019"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 2018 AAAI Conference on Artificial Intelligence.","author":"Guo Shu","year":"2018"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 2018 International Conference on Principles of Knowledge Representation and Reasoning.","author":"Guti\u00e9rrez-Basulto V\u00edctor","year":"2018"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-2088"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1002\/sapm192761164"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.79.8.2554"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2012.10.002"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3358036"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1103"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-2609"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 2018 International Conference on Neural Information Processing Systems.","author":"Kazemi Seyed Mehran","year":"2018"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1137\/07070111X"},{"key":"e_1_2_1_33_1","volume-title":"Recurrent Neural Networks with Python Quick Start Guide: Sequential Learning and Language Modeling with TensorFlow","author":"Kostadinov Simeon"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 2018 International Conference on Machine Learning.","author":"Lacroix Timoth\u00e9e","year":"2018"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-010-5205-8"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing.","author":"Lao Ni"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1082"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the 2017 International Conference on Machine Learning.","author":"Liu Hanxiao","year":"2017"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 7th Biennial Conference on Innovative Data Systems Research.","author":"Mahdisoltani Farzaneh"},{"key":"e_1_2_1_41_1","volume-title":"Introduction to Information Retrieval","author":"Manning Christopher D."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-00671-6_1"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/435"},{"key":"e_1_2_1_44_1","volume-title":"Manuel Fink, and Heiner Stuckenschmidt.","author":"Meilicke Christian","year":"2020"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 2013 International Conference on Learning Representations.","author":"Mikolov Tomas","year":"2013"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the 2019 Workshop on Deep Learning for Knowledge Graphs.","author":"Mohamed Sameh K.","year":"2019"},{"key":"e_1_2_1_47_1","volume-title":"An overview of embedding models of entities and relationships for knowledge base completion. CoRR abs\/1703.08098","author":"Nguyen Dat Quoc","year":"2017"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1054"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.","author":"Nguyen Dai Quoc"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.","author":"Nguyen Dai Quoc"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the 2011 International Conference on Machine Learning.","author":"Nickel Maximilian","year":"2011"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2483592"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the 2016 AAAI Conference on Artificial Intelligence.","author":"Nickel Maximilian"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.3233\/SW-160218"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1359"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1337"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the EDBT\/ICDT 2020 Joint Conference.","author":"Rossi Andrea","year":"2020"},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the 2017 International Conference on Neural Information Processing Systems.","author":"Sabour Sara"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242667"},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Sun Zhiqing","year":"2019"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4007"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1174"},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the EDBT\/ICDT 2019 Joint Conference.","author":"Tran Hung Nghiep","year":"2019"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.3301297"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1024"},{"key":"e_1_2_1_66_1","volume-title":"Complex and holographic embeddings of knowledge graphs: A comparison. CoRR abs\/1707.01475","author":"Trouillon Th\u00e9o","year":"2017"},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of the 2016 International Conference on Machine Learning.","author":"Trouillon Th\u00e9o","year":"2016"},{"key":"e_1_2_1_68_1","volume-title":"Data and Web Science Group. [n.d.]. AnyBURL. Retrieved","author":"University Mannheim","year":"2019"},{"key":"e_1_2_1_69_1","volume-title":"Proceedings of the 2020 AAAI Conference on Artificial Intelligence.","author":"Vashishth Shikhar"},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the Text REtrieval Conference.","author":"Voorhees Ellen M.","year":"1999"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629489"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2017.2754499"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-4313"},{"key":"e_1_2_1_74_1","volume-title":"Proceedings of the 2016 International Joint Conference on Artificial Intelligence.","author":"Wang Zhigang","year":"2016"},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the 2014 AAAI Conference on Artificial Intelligence.","author":"Wang Zhen","year":"2014"},{"key":"e_1_2_1_76_1","volume-title":"Proceedings of the 2016 International Joint Conference on Artificial Intelligence.","author":"Wen Jianfeng","year":"2016"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/2566486.2568032"},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the 2015 International Conference on Learning Representations.","author":"Yang Bishan","year":"2015"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3291014"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00044"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i03.5701"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3424672","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3424672","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:23:31Z","timestamp":1750188211000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3424672"}},"subtitle":["A Comparative Analysis"],"short-title":[],"issued":{"date-parts":[[2021,1,4]]},"references-count":81,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,4,30]]}},"alternative-id":["10.1145\/3424672"],"URL":"https:\/\/doi.org\/10.1145\/3424672","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,4]]},"assertion":[{"value":"2020-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-01-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}