{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:19:07Z","timestamp":1750220347966,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":19,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,12,6]],"date-time":"2021-12-06T00:00:00Z","timestamp":1638748800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,12,6]]},"DOI":"10.1145\/3502223.3502244","type":"proceedings-article","created":{"date-parts":[[2022,1,24]],"date-time":"2022-01-24T23:50:34Z","timestamp":1643068234000},"page":"151-155","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Improving Knowledge Graph Representation Learning by Structure Contextual Pre-training"],"prefix":"10.1145","author":[{"given":"Ganqiang","family":"Ye","sequence":"first","affiliation":[{"name":"Zhejiang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wen","family":"Zhang","sequence":"additional","affiliation":[{"name":"Zhejiang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhen","family":"Bi","sequence":"additional","affiliation":[{"name":"Zhejiang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chi Man","family":"Wong","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chen","family":"Hui","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huajun","family":"Chen","sequence":"additional","affiliation":[{"name":"Zhejiang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,1,24]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-1133"},{"key":"e_1_3_2_1_2_1","volume-title":"Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems","author":"Bordes Antoine","year":"2013","unstructured":"Antoine Bordes , Nicolas Usunier , Alberto Garc\u00eda-Dur\u00e1n , Jason Weston , and Oksana Yakhnenko . 2013. Translating Embeddings for Modeling Multi-relational Data . In Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013 . Proceedings of a meeting held December 5-8, 2013, Lake Tahoe, Nevada, United States, Christopher J.\u00a0C. Burges, L\u00e9on Bottou, Zoubin Ghahramani, and Kilian\u00a0Q. Weinberger (Eds .). 2787\u20132795. https:\/\/proceedings.neurips.cc\/paper\/2013\/hash\/1cecc7a77928ca8133fa24680a88d2f9-Abstract.html Antoine Bordes, Nicolas Usunier, Alberto Garc\u00eda-Dur\u00e1n, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-relational Data. In Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held December 5-8, 2013, Lake Tahoe, Nevada, United States, Christopher J.\u00a0C. Burges, L\u00e9on Bottou, Zoubin Ghahramani, and Kilian\u00a0Q. Weinberger (Eds.). 2787\u20132795. https:\/\/proceedings.neurips.cc\/paper\/2013\/hash\/1cecc7a77928ca8133fa24680a88d2f9-Abstract.html"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806512"},{"key":"e_1_3_2_1_4_1","volume-title":"Graz","author":"Daiber Joachim","year":"2013","unstructured":"Joachim Daiber , Max Jakob , Chris Hokamp , and Pablo\u00a0 N. Mendes . 2013 . Improving efficiency and accuracy in multilingual entity extraction. In I-SEMANTICS 2013 - 9th International Conference on Semantic Systems, ISEM \u201913 , Graz , Austria, September 4-6, 2013, Marta Sabou, Eva Blomqvist, Tommaso\u00a0Di Noia, Harald Sack, and Tassilo Pellegrini (Eds.). ACM, 121\u2013124. https:\/\/doi.org\/10.1145\/2506182.2506198 10.1145\/2506182.2506198 Joachim Daiber, Max Jakob, Chris Hokamp, and Pablo\u00a0N. Mendes. 2013. Improving efficiency and accuracy in multilingual entity extraction. In I-SEMANTICS 2013 - 9th International Conference on Semantic Systems, ISEM \u201913, Graz, Austria, September 4-6, 2013, Marta Sabou, Eva Blomqvist, Tommaso\u00a0Di Noia, Harald Sack, and Tassilo Pellegrini (Eds.). ACM, 121\u2013124. https:\/\/doi.org\/10.1145\/2506182.2506198"},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019 , Minneapolis, MN, USA , June 2-7, 2019, Volume 1 (Long and Short Papers), Jill Burstein, Christy Doran, and Thamar Solorio (Eds.). Association for Computational Linguistics, 4171\u20134186. https:\/\/doi.org\/10.18653\/v1\/n19-1423 10.18653\/v1 Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers), Jill Burstein, Christy Doran, and Thamar Solorio (Eds.). Association for Computational Linguistics, 4171\u20134186. https:\/\/doi.org\/10.18653\/v1\/n19-1423"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3184558.3191541"},{"key":"e_1_3_2_1_7_1","first-page":"52","article-title":"Representation Learning on Graphs","volume":"40","author":"Hamilton L.","year":"2017","unstructured":"William\u00a0 L. Hamilton , Rex Ying , and Jure Leskovec . 2017 . Representation Learning on Graphs : Methods and Applications. IEEE Data Eng. Bull. 40 , 3 (2017), 52 \u2013 74 . http:\/\/sites.computer.org\/debull\/A17sept\/p52.pdf William\u00a0L. Hamilton, Rex Ying, and Jure Leskovec. 2017. Representation Learning on Graphs: Methods and Applications. IEEE Data Eng. Bull. 40, 3 (2017), 52\u201374. http:\/\/sites.computer.org\/debull\/A17sept\/p52.pdf","journal-title":"Methods and Applications. IEEE Data Eng. Bull."},{"key":"e_1_3_2_1_8_1","volume-title":"SimplE Embedding for Link Prediction in Knowledge Graphs. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018","author":"Kazemi Seyed\u00a0Mehran","year":"2018","unstructured":"Seyed\u00a0Mehran Kazemi and David Poole . 2018 . SimplE Embedding for Link Prediction in Knowledge Graphs. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018 , NeurIPS 2018, December 3-8, 2018, Montr\u00e9al, Canada, Samy Bengio, Hanna\u00a0M. Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds.). 4289\u20134300. https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/b2ab001909a8a6f04b51920306046ce5-Abstract.html Seyed\u00a0Mehran Kazemi and David Poole. 2018. SimplE Embedding for Link Prediction in Knowledge Graphs. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8, 2018, Montr\u00e9al, Canada, Samy Bengio, Hanna\u00a0M. Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds.). 4289\u20134300. https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/b2ab001909a8a6f04b51920306046ce5-Abstract.html"},{"key":"e_1_3_2_1_9_1","volume-title":"KG-BERT: BERT for Knowledge Graph Completion. arXiv:1909.03193","author":"Liang\u00a0Yao Yuan\u00a0Luo","year":"2019","unstructured":"Yuan\u00a0Luo Liang\u00a0Yao , Chengsheng\u00a0Mao. 2019. KG-BERT: BERT for Knowledge Graph Completion. arXiv:1909.03193 ( 2019 ). Yuan\u00a0Luo Liang\u00a0Yao, Chengsheng\u00a0Mao. 2019. KG-BERT: BERT for Knowledge Graph Completion. arXiv:1909.03193 (2019)."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/2886521.2886624"},{"key":"e_1_3_2_1_11_1","volume-title":"K-BERT: Enabling Language Representation with Knowledge Graph. arXiv:1909.07606","author":"Liu Weijie","year":"2019","unstructured":"Weijie Liu , Peng Zhou , Zhe Zhao , Zhiruo Wang , Qi Ju , Haotang Deng , and Ping Wang . 2019. K-BERT: Enabling Language Representation with Knowledge Graph. arXiv:1909.07606 ( 2019 ). Weijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang, Qi Ju, Haotang Deng, and Ping Wang. 2019. K-BERT: Enabling Language Representation with Knowledge Graph. arXiv:1909.07606 (2019)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Matthew\u00a0E Peters Mark Neumann IV Logan L Robert Roy Schwartz Vidur Joshi Sameer Singh and Noah\u00a0A Smith. 2019. Knowledge Enhanced Contextual Word Representations. arXiv preprint arXiv:1909.04164(2019).  Matthew\u00a0E Peters Mark Neumann IV Logan L Robert Roy Schwartz Vidur Joshi Sameer Singh and Noah\u00a0A Smith. 2019. Knowledge Enhanced Contextual Word Representations. arXiv preprint arXiv:1909.04164(2019).","DOI":"10.18653\/v1\/D19-1005"},{"key":"e_1_3_2_1_13_1","volume-title":"Rotate: Knowledge graph embedding by relational rotation in complex space. arXiv preprint arXiv:1902.10197(2019).","author":"Sun Zhiqing","year":"2019","unstructured":"Zhiqing Sun , Zhi-Hong Deng , Jian-Yun Nie , and Jian Tang . 2019 . Rotate: Knowledge graph embedding by relational rotation in complex space. arXiv preprint arXiv:1902.10197(2019). Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang. 2019. Rotate: Knowledge graph embedding by relational rotation in complex space. arXiv preprint arXiv:1902.10197(2019)."},{"key":"e_1_3_2_1_14_1","volume-title":"International Conference on Machine Learning (ICML).","author":"Trouillon Th\u00e9o","year":"2016","unstructured":"Th\u00e9o Trouillon , Johannes Welbl , Sebastian Riedel , \u00c9ric Gaussier , and Guillaume Bouchard . 2016 . Complex embeddings for simple link prediction . International Conference on Machine Learning (ICML). Th\u00e9o Trouillon, Johannes Welbl, Sebastian Riedel, \u00c9ric Gaussier, and Guillaume Bouchard. 2016. Complex embeddings for simple link prediction. International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_15_1","volume-title":"Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan\u00a0 N. Gomez , Lukasz Kaiser , and Illia Polosukhin . 2017 . Attention is All you Need . In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017 , December 4-9, 2017, Long Beach, CA, USA, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna\u00a0M. Wallach, Rob Fergus, S.\u00a0V.\u00a0N. Vishwanathan, and Roman Garnett (Eds.). 5998\u20136008. https:\/\/proceedings.neurips.cc\/paper\/ 2017\/hash\/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan\u00a0N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna\u00a0M. Wallach, Rob Fergus, S.\u00a0V.\u00a0N. Vishwanathan, and Roman Garnett (Eds.). 5998\u20136008. https:\/\/proceedings.neurips.cc\/paper\/2017\/hash\/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/2893873.2894046"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1083"},{"key":"e_1_3_2_1_18_1","volume-title":"ERNIE: Enhanced Language Representation with Informative Entities. arXiv preprint arXiv:1905.07129(2019).","author":"Zhang Zhengyan","year":"2019","unstructured":"Zhengyan Zhang , Xu Han , Zhiyuan Liu , Xin Jiang , Maosong Sun , and Qun Liu . 2019 . ERNIE: Enhanced Language Representation with Informative Entities. arXiv preprint arXiv:1905.07129(2019). Zhengyan Zhang, Xu Han, Zhiyuan Liu, Xin Jiang, Maosong Sun, and Qun Liu. 2019. ERNIE: Enhanced Language Representation with Informative Entities. arXiv preprint arXiv:1905.07129(2019)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/595"}],"event":{"name":"IJCKG'21: The 10th International Joint Conference on Knowledge Graphs","acronym":"IJCKG'21","location":"Virtual Event Thailand"},"container-title":["Proceedings of the 10th International Joint Conference on Knowledge Graphs"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3502223.3502244","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3502223.3502244","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:05Z","timestamp":1750191425000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3502223.3502244"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,6]]},"references-count":19,"alternative-id":["10.1145\/3502223.3502244","10.1145\/3502223"],"URL":"https:\/\/doi.org\/10.1145\/3502223.3502244","relation":{},"subject":[],"published":{"date-parts":[[2021,12,6]]},"assertion":[{"value":"2022-01-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}