{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T07:44:36Z","timestamp":1758267876720,"version":"3.41.0"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2020,9,2]],"date-time":"2020-09-02T00:00:00Z","timestamp":1599004800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012659","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61772059"],"award-info":[{"award-number":["61772059"]}],"id":[{"id":"10.13039\/501100012659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2020,10,31]]},"abstract":"<jats:p>Real-world knowledge bases such as DBPedia, Yago, and Freebase contain sparse linkage connectivity, which poses a severe challenge to link prediction between entities. To cope with such data scarcity issues, recent models have focused on learning interactions between entity pairs by means of relations that exist between them. However promising, some relations are associated with very few tail entities or head entities, resulting in poor estimation of the relation interaction between entities. In this article, we break the sole dependency of modeling relation interactions between entity pairs by associating a triple with pairwise embeddings, i.e., distributed vector representations for pairs of word-based entities and relation of a triple. We capture the interactions that exist between pairwise embeddings by means of a Pairwise Factorization Model that employs a factorization machine with relation attention. This approach allows parameters for related interactions to be estimated efficiently, ensuring that the pairwise embeddings are discriminative, providing strong supervisory signals for the decoding task of link prediction. The Pairwise Factorization Model we propose exploits a neural bag-of-words model as the encoder, which effectively encodes word-based entities into distributed vector representations for the decoder. The proposed model is simple and enjoys efficiency and capability, showing superior link prediction performance over state-of-the-art complex models on benchmark datasets DBPedia50K and FB15K-237.<\/jats:p>","DOI":"10.1145\/3406116","type":"journal-article","created":{"date-parts":[[2020,9,2]],"date-time":"2020-09-02T16:12:36Z","timestamp":1599063156000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Pairwise Link Prediction Model for Out of Vocabulary Knowledge Base Entities"],"prefix":"10.1145","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1207-0300","authenticated-orcid":false,"given":"Richong","family":"Zhang","sequence":"first","affiliation":[{"name":"Beijing Advanced Innovation Center for Big Data and Brain Computing, School of Computer Science and Engineering, Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Samuel","family":"Mensah","sequence":"additional","affiliation":[{"name":"Beijing Advanced Innovation Center for Big Data and Brain Computing, School of Computer Science and Engineering, Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fanshuang","family":"Kong","sequence":"additional","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhiyuan","family":"Hu","sequence":"additional","affiliation":[{"name":"Beijing Advanced Innovation Center for Big Data and Brain Computing, School of Computer Science and Engineering, Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongyi","family":"Mao","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xudong","family":"Liu","sequence":"additional","affiliation":[{"name":"Beijing Advanced Innovation Center for Big Data and Brain Computing, School of Computer Science and Engineering, Beihang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,9,2]]},"reference":[{"volume-title":"Proceedings of the 6th International Semantic Web and 2nd Asian Conference on Asian Semantic Web Conference (ISWC\u201907\/ASWC\u201907)","author":"Auer S\u00f6ren","key":"e_1_2_1_1_1","unstructured":"S\u00f6ren Auer , Christian Bizer , Georgi Kobilarov , Jens Lehmann , Richard Cyganiak , and Zachary G. Ives . 2007. DBpedia: A nucleus for a web of open data . In Proceedings of the 6th International Semantic Web and 2nd Asian Conference on Asian Semantic Web Conference (ISWC\u201907\/ASWC\u201907) . 722--735. S\u00f6ren Auer, Christian Bizer, Georgi Kobilarov, Jens Lehmann, Richard Cyganiak, and Zachary G. Ives. 2007. DBpedia: A nucleus for a web of open data. In Proceedings of the 6th International Semantic Web and 2nd Asian Conference on Asian Semantic Web Conference (ISWC\u201907\/ASWC\u201907). 722--735."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376746"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 26th International Conference on Advances in Neural Information Processing Systems. 2787--2795","author":"Bordes Antoine","year":"2013","unstructured":"Antoine Bordes , Nicolas Usunier , Alberto Garcia-Dur\u00e1n , Jason Weston , and Oksana Yakhnenko . 2013 . Translating embeddings for modeling multi-relational data . In Proceedings of the 26th International Conference on Advances in Neural Information Processing Systems. 2787--2795 . Antoine Bordes, Nicolas Usunier, Alberto Garcia-Dur\u00e1n, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In Proceedings of the 26th International Conference on Advances in Neural Information Processing Systems. 2787--2795."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907)","author":"Cucerzan Silviu","year":"2007","unstructured":"Silviu Cucerzan . 2007 . Large-scale named entity disambiguation based on Wikipedia data . In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907) . 708--716. Silviu Cucerzan. 2007. Large-scale named entity disambiguation based on Wikipedia data. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907). 708--716."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609628"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v31i3.2303"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1034"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/250"},{"key":"e_1_2_1_9_1","volume-title":"Inductive representation learning on large graphs. arXiv preprint arXiv:1706.02216","author":"Hamilton William L.","year":"2017","unstructured":"William L. Hamilton , Rex Ying , and Jure Leskovec . 2017. Inductive representation learning on large graphs. arXiv preprint arXiv:1706.02216 ( 2017 ). William L. Hamilton, Rex Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. arXiv preprint arXiv:1706.02216 (2017)."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the International Conference on Advances in Neural Information Processing Systems. 1135--1143","author":"Han Song","year":"2015","unstructured":"Song Han , Jeff Pool , John Tran , and William Dally . 2015 . Learning both weights and connections for efficient neural network . In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 1135--1143 . Song Han, Jeff Pool, John Tran, and William Dally. 2015. Learning both weights and connections for efficient neural network. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 1135--1143."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806502"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080777"},{"volume-title":"Proceedings of the 6th ACM International Conference on Web Search and Data Mining. 557--566","author":"Hong Liangjie","key":"e_1_2_1_13_1","unstructured":"Liangjie Hong , Aziz S. Doumith , and Brian D. Davison . 2013. Co-factorization machines: Modeling user interests and predicting individual decisions in Twitter . In Proceedings of the 6th ACM International Conference on Web Search and Data Mining. 557--566 . Liangjie Hong, Aziz S. Doumith, and Brian D. Davison. 2013. Co-factorization machines: Modeling user interests and predicting individual decisions in Twitter. In Proceedings of the 6th ACM International Conference on Web Search and Data Mining. 557--566."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3233771"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959134"},{"volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Thomas","key":"e_1_2_1_16_1","unstructured":"Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks . In Proceedings of the International Conference on Learning Representations. Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313550"},{"key":"e_1_2_1_18_1","volume-title":"Modeling relation paths for representation learning of knowledge bases. arXiv preprint arXiv:1506.00379","author":"Lin Yankai","year":"2015","unstructured":"Yankai Lin , Zhiyuan Liu , Huanbo Luan , Maosong Sun , Siwei Rao , and Song Liu . 2015. Modeling relation paths for representation learning of knowledge bases. arXiv preprint arXiv:1506.00379 ( 2015 ). Yankai Lin, Zhiyuan Liu, Huanbo Luan, Maosong Sun, Siwei Rao, and Song Liu. 2015. Modeling relation paths for representation learning of knowledge bases. arXiv preprint arXiv:1506.00379 (2015)."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI\u201915)","author":"Lin Yankai","year":"2015","unstructured":"Yankai Lin , Zhiyuan Liu , Maosong Sun , Yang Liu , and Xuan Zhu . 2015 . Learning entity and relation embeddings for knowledge graph completion . In Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI\u201915) . 2181--2187. Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning entity and relation embeddings for knowledge graph completion. In Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI\u201915). 2181--2187."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201915)","author":"Lin Yankai","year":"2015","unstructured":"Yankai Lin , Zhiyuan Liu , Maosong Sun , Yang Liu , and Xuan Zhu . 2015 . Learning entity and relation embeddings for knowledge graph completion . In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201915) . 2181--2187. Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning entity and relation embeddings for knowledge graph completion. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201915). 2181--2187."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the International Conference on Machine Learning. 2168--2178","author":"Liu Hanxiao","year":"2017","unstructured":"Hanxiao Liu , Yuexin Wu , and Yiming Yang . 2017 . Analogical inference for multi-relational embeddings . In Proceedings of the International Conference on Machine Learning. 2168--2178 . Hanxiao Liu, Yuexin Wu, and Yiming Yang. 2017. Analogical inference for multi-relational embeddings. In Proceedings of the International Conference on Machine Learning. 2168--2178."},{"key":"e_1_2_1_22_1","volume-title":"STransE: A novel embedding model of entities and relationships in knowledge bases. arXiv preprint arXiv:1606.08140","author":"Nguyen Dat Quoc","year":"2016","unstructured":"Dat Quoc Nguyen , Kairit Sirts , Lizhen Qu , and Mark Johnson . 2016. STransE: A novel embedding model of entities and relationships in knowledge bases. arXiv preprint arXiv:1606.08140 ( 2016 ). Dat Quoc Nguyen, Kairit Sirts, Lizhen Qu, and Mark Johnson. 2016. STransE: A novel embedding model of entities and relationships in knowledge bases. arXiv preprint arXiv:1606.08140 (2016)."},{"volume-title":"Proceedings of the National Conference on Artificial Intelligence. 1955--1961","author":"Nickel Maximilian","key":"e_1_2_1_23_1","unstructured":"Maximilian Nickel , Lorenzo Rosasco , and Tomaso A. Poggio . 2016. Holographic embeddings of knowledge graphs . In Proceedings of the National Conference on Artificial Intelligence. 1955--1961 . Maximilian Nickel, Lorenzo Rosasco, and Tomaso A. Poggio. 2016. Holographic embeddings of knowledge graphs. In Proceedings of the National Conference on Artificial Intelligence. 1955--1961."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556195.2556240"},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201914)","author":"Pennington Jeffrey","key":"e_1_2_1_25_1","unstructured":"Jeffrey Pennington , Richard Socher , and Christopher D. Manning . 2014. GloVe: Global vectors for word representation . In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201914) . 1532--1543. Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global vectors for word representation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201914). 1532--1543."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1204"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2010.127"},{"volume-title":"Proceedings of the Extended Semantic Web Conference. 593--607","author":"Schlichtkrull Michael Sejr","key":"e_1_2_1_28_1","unstructured":"Michael Sejr Schlichtkrull , Thomas N. Kipf , Peter Bloem , Rianne van den Berg, Ivan Titov, and Max Welling. 2018. Modeling relational data with graph convolutional networks . In Proceedings of the Extended Semantic Web Conference. 593--607 . Michael Sejr Schlichtkrull, Thomas N. Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, and Max Welling. 2018. Modeling relational data with graph convolutional networks. In Proceedings of the Extended Semantic Web Conference. 593--607."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33013044"},{"key":"e_1_2_1_30_1","volume-title":"ProjE: Embedding projection for knowledge graph completion. arXiv preprint arXiv:1611.05425 1","author":"Shi Baoxu","year":"2016","unstructured":"Baoxu Shi and Tim Weninger . 2016. ProjE: Embedding projection for knowledge graph completion. arXiv preprint arXiv:1611.05425 1 ( 2016 ). Baoxu Shi and Tim Weninger. 2016. ProjE: Embedding projection for knowledge graph completion. arXiv preprint arXiv:1611.05425 1 (2016)."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the National Conference on Artificial Intelligence.","author":"Shi Baoxu","year":"2018","unstructured":"Baoxu Shi and Tim Weninger . 2018 . Open-world knowledge graph completion . In Proceedings of the National Conference on Artificial Intelligence. Baoxu Shi and Tim Weninger. 2018. Open-world knowledge graph completion. In Proceedings of the National Conference on Artificial Intelligence."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242667"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 33rd International Conference on International Conference on Machine Learning. 2071--2080","author":"Trouillon Th\u00e9o","year":"2016","unstructured":"Th\u00e9o Trouillon , Johannes Welbl , Sebastian Riedel , \u00c3ric Gaussier , and Guillaume Bouchard . 2016 . Complex embeddings for simple link prediction . In Proceedings of the 33rd International Conference on International Conference on Machine Learning. 2071--2080 . Th\u00e9o Trouillon, Johannes Welbl, Sebastian Riedel, \u00c3ric Gaussier, and Guillaume Bouchard. 2016. Complex embeddings for simple link prediction. In Proceedings of the 33rd International Conference on International Conference on Machine Learning. 2071--2080."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 28th AAAI Conference on Artificial Intelligence (AAAI\u201914)","author":"Wang Zhen","year":"2014","unstructured":"Zhen Wang , Jianwen Zhang , Jianlin Feng , and Zheng Chen . 2014 . Knowledge graph embedding by translating on hyperplanes . In Proceedings of the 28th AAAI Conference on Artificial Intelligence (AAAI\u201914) . 1112--1119. Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. Knowledge graph embedding by translating on hyperplanes. In Proceedings of the 28th AAAI Conference on Artificial Intelligence (AAAI\u201914). 1112--1119."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-1319"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI\u201916)","author":"Xie Ruobing","year":"2016","unstructured":"Ruobing Xie , Zhiyuan Liu , Jia Jia , Huanbo Luan , and Maosong Sun . 2016 . Representation learning of knowledge graphs with entity descriptions . In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI\u201916) . 2659--2665. Ruobing Xie, Zhiyuan Liu, Jia Jia, Huanbo Luan, and Maosong Sun. 2016. Representation learning of knowledge graphs with entity descriptions. In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI\u201916). 2659--2665."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052558"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","volume":"1","author":"Yang Bishan","unstructured":"Bishan Yang and Tom M. Mitchell . 2017. Leveraging knowledge bases in LSTMs for improving machine reading . In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , Vol. 1 . 1436--1446. Bishan Yang and Tom M. Mitchell. 2017. Leveraging knowledge bases in LSTMs for improving machine reading. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vol. 1. 1436--1446."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Yang Bishan","year":"2015","unstructured":"Bishan Yang , Wen-tau Yih, Xiaodong He , Jianfeng Gao , and Li Deng . 2015 . Embedding entities and relations for learning and inference in knowledge bases . In Proceedings of the International Conference on Learning Representations. Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2015. Embedding entities and relations for learning and inference in knowledge bases. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_2_1_40_1","volume-title":"gSMat: A scalable sparse matrix-based join for SPARQL query processing. arXiv preprint arXiv:1807.07691","author":"Zhang Xiaowang","year":"2018","unstructured":"Xiaowang Zhang , Mingyue Zhang , Peng Peng , Jiaming Song , Zhiyong Feng , and Lei Zou . 2018. gSMat: A scalable sparse matrix-based join for SPARQL query processing. arXiv preprint arXiv:1807.07691 ( 2018 ). Xiaowang Zhang, Mingyue Zhang, Peng Peng, Jiaming Song, Zhiyong Feng, and Lei Zou. 2018. gSMat: A scalable sparse matrix-based join for SPARQL query processing. arXiv preprint arXiv:1807.07691 (2018)."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3091995"},{"key":"e_1_2_1_42_1","first-page":"258814","article-title":"Modeling polypharmacy side effects with graph convolutional networks","volume":"34","author":"Zitnik Marinka","year":"2018","unstructured":"Marinka Zitnik , Monica Agrawal , and Jure Leskovec . 2018 . Modeling polypharmacy side effects with graph convolutional networks . Intell. Syst. Molec. Biol. 34 , 13 (2018), 258814 . Marinka Zitnik, Monica Agrawal, and Jure Leskovec. 2018. Modeling polypharmacy side effects with graph convolutional networks. Intell. Syst. Molec. Biol. 34, 13 (2018), 258814.","journal-title":"Intell. Syst. Molec. Biol."}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3406116","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3406116","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:52Z","timestamp":1750195912000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3406116"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,2]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,10,31]]}},"alternative-id":["10.1145\/3406116"],"URL":"https:\/\/doi.org\/10.1145\/3406116","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"type":"print","value":"1046-8188"},{"type":"electronic","value":"1558-2868"}],"subject":[],"published":{"date-parts":[[2020,9,2]]},"assertion":[{"value":"2019-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-09-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}