{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T06:47:05Z","timestamp":1792824425742,"version":"4.5.0"},"reference-count":53,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T00:00:00Z","timestamp":1623801600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T00:00:00Z","timestamp":1623801600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"SIRIUS Centre for Scalable Data Access","award":["237889"],"award-info":[{"award-number":["237889"]}]},{"name":"Samsung Research UK"},{"name":"EPSRC project AnaLOG","award":["EP\/P025943\/1"],"award-info":[{"award-number":["EP\/P025943\/1"]}]},{"name":"EPSRC project OASIS","award":["EP\/S032347\/1"],"award-info":[{"award-number":["EP\/S032347\/1"]}]},{"name":"EPSRC project UK FIRES","award":["EP\/S019111\/1"],"award-info":[{"award-number":["EP\/S019111\/1"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Semantic embedding of knowledge graphs has been widely studied and used for prediction and statistical analysis tasks across various domains such as Natural Language Processing and the Semantic Web. However, less attention has been paid to developing robust methods for embedding OWL (Web Ontology Language) ontologies, which contain richer semantic information than plain knowledge graphs, and have been widely adopted in domains such as bioinformatics. In this paper, we propose a random walk and word embedding based ontology embedding method named , which encodes the semantics of an OWL ontology by taking into account its graph structure, lexical information and logical constructors. Our empirical evaluation with three real world datasets suggests that   benefits from these three different aspects of an ontology in class membership prediction and class subsumption prediction tasks. Furthermore,   often significantly outperforms the state-of-the-art methods in our experiments.<\/jats:p>","DOI":"10.1007\/s10994-021-05997-6","type":"journal-article","created":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T22:02:51Z","timestamp":1623880971000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":135,"title":["OWL2Vec*: embedding of OWL ontologies"],"prefix":"10.1007","author":[{"given":"Jiaoyan","family":"Chen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pan","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ernesto","family":"Jimenez-Ruiz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ole Magnus","family":"Holter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Denvar","family":"Antonyrajah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ian","family":"Horrocks","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,6,16]]},"reference":[{"key":"5997_CR1","unstructured":"Alshargi, F., Shekarpour, S., Soru, T., Sheth, A.P. (2018). Metrics for evaluating quality of embeddings for ontological concepts."},{"key":"5997_CR2","unstructured":"Arora, S., Liang, Y., Ma, T. (2019). A simple but tough-to-beat baseline for sentence embeddings. In: ICLR."},{"key":"5997_CR3","doi-asserted-by":"publisher","first-page":"722","DOI":"10.1007\/978-3-540-76298-0_52","volume-title":"The semantic web","author":"S Auer","year":"2007","unstructured":"Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., & Ives, Z. (2007). DBpedia: A Nucleus for a web of open data. The semantic web (pp. 722\u2013735). Springer."},{"key":"5997_CR4","doi-asserted-by":"publisher","DOI":"10.1017\/9781139025355","volume-title":"Introduction to Description Logic","author":"F Baader","year":"2017","unstructured":"Baader, F., Horrocks, I., Lutz, C., & Sattler, U. (2017). Introduction to Description Logic. Cambridge University Press."},{"key":"5997_CR5","unstructured":"Bechhofer, S., Van\u00a0Harmelen, F., Hendler, J., Horrocks, I., McGuinness, D.L., Patel-Schneider, P.F., Stein, L.A., et al., (2004). OWL web ontology language reference. W3C recommendation 10(02)"},{"issue":"8","key":"5997_CR6","doi-asserted-by":"publisher","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","volume":"35","author":"Y Bengio","year":"2013","unstructured":"Bengio, Y., Courville, A., & Vincent, P. (2013). Representation learning: A review and new perspectives. IEEE transactions on pattern analysis and machine intelligence, 35(8), 1798\u20131828.","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"key":"5997_CR7","unstructured":"Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O. (2013). Translating embeddings for modeling multi-relational data. In: NeurIPS. pp. 2787\u20132795."},{"key":"5997_CR8","first-page":"1537","volume":"2020","author":"J Chen","year":"2020","unstructured":"Chen, J., Chen, X., Horrocks, I., Myklebust, B., & Jimenez-Ruiz, E. (2020). Correcting knowledge base assertions. Proceedings of The Web Conference, 2020, 1537\u20131547.","journal-title":"Proceedings of The Web Conference"},{"key":"5997_CR9","first-page":"110","volume-title":"International semantic web conference","author":"J Chen","year":"2019","unstructured":"Chen, J., Jim\u00e9nez-Ruiz, E., & Horrocks, I. (2019). Canonicalizing knowledge base literals. International semantic web conference (pp. 110\u2013127). Springer."},{"key":"5997_CR10","doi-asserted-by":"crossref","unstructured":"Chen, J., Jimenez-Ruiz, E., Horrocks, I., Antonyrajah, D., Hadian, A., Lee, J. (2020). Augmenting ontology alignment by semantic embedding and distant supervision. In: European semantic web conference (ESWC).","DOI":"10.1007\/978-3-030-77385-4_23"},{"key":"5997_CR11","doi-asserted-by":"crossref","unstructured":"Chen, J., Lecue, F., Geng, Y., Pan, J.Z., Chen, H. (2020). Ontology-guided Semantic Composition for Zero-Shot Learning. In: KR.","DOI":"10.24963\/kr.2020\/87"},{"key":"5997_CR12","doi-asserted-by":"crossref","unstructured":"G. O. & Consortium. (2008). The gene ontology project in 2008. Nucleic Acids Research, 36(Supp 1), D440\u2013D444.","DOI":"10.1093\/nar\/gkm883"},{"key":"5997_CR13","unstructured":"Devlin, J., Chang, M.W., Lee, K., Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In: NAACL. pp. 4171\u20134186."},{"issue":"1","key":"5997_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41538-018-0032-6","volume":"2","author":"DM Dooley","year":"2018","unstructured":"Dooley, D. M., Griffiths, E. J., Gosal, G. S., Buttigieg, P. L., Hoehndorf, R., Lange, M. C., et al., (2018). FoodOn: A harmonized food ontology to increase global food traceability, quality control and data integration. npj Science of Food, 2(1), 1\u201310.","journal-title":"npj Science of Food"},{"key":"5997_CR15","first-page":"53","volume-title":"International semantic web conference","author":"M Dragoni","year":"2018","unstructured":"Dragoni, M., Bailoni, T., Maimone, R., & Eccher, C. (2018). HeLis: An ontology for supporting healthy lifestyles. International semantic web conference (pp. 53\u201369). Berlin: Springer."},{"key":"5997_CR16","unstructured":"Garg, D., Ikbal, S., Srivastava, S.K., Vishwakarma, H., Karanam, H., Subramaniam, L.V. (2019). Quantum embedding of knowledge for reasoning. In: NeurIPS. pp. 5595\u20135605."},{"issue":"3","key":"5997_CR17","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1007\/s10817-014-9305-1","volume":"53","author":"B Glimm","year":"2014","unstructured":"Glimm, B., Horrocks, I., Motik, B., Stoilos, G., & Wang, Z. (2014). HermiT: An OWL 2 reasoner. Journal of Automated Reasoning, 53(3), 245\u2013269.","journal-title":"Journal of Automated Reasoning"},{"key":"5997_CR18","doi-asserted-by":"crossref","unstructured":"Grover, A., Leskovec, J. (2016). node2vec: Scalable feature learning for networks. In: KDD. pp. 855\u2013864.","DOI":"10.1145\/2939672.2939754"},{"key":"5997_CR19","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.knosys.2018.10.008","volume":"164","author":"N Guan","year":"2019","unstructured":"Guan, N., Song, D., & Liao, L. (2019). Knowledge graph embedding with concepts. Knowledge-Based Systems, 164, 38\u201344.","journal-title":"Knowledge-Based Systems"},{"key":"5997_CR20","doi-asserted-by":"crossref","unstructured":"Hao, B., Zhu, H., Paschalidis, I. (2020). Enhancing clinical bert embedding using a biomedical knowledge base. In: Proceedings of the 28th international conference on computational linguistics. pp. 657\u2013661","DOI":"10.18653\/v1\/2020.coling-main.57"},{"key":"5997_CR21","doi-asserted-by":"crossref","unstructured":"Hao, J., Chen, M., Yu, W., Sun, Y., Wang, W. (2019). Universal representation learning of knowledge bases by jointly embedding instances and ontological concepts. In: KDD","DOI":"10.1145\/3292500.3330838"},{"key":"5997_CR22","unstructured":"Hogan, A., Blomqvist, E., Cochez, M., d\u2019Amato, C., de\u00a0Melo, G., Gutierrez, C., Gayo, J.E.L., Kirrane, S., Neumaier, S., Polleres, A., et al., (2020). Knowledge graphs. arXiv preprint arXiv:2003.02320"},{"key":"5997_CR23","unstructured":"Holter, O.M., Myklebust, E.B., Chen, J., Jimenez-Ruiz, E. (2019). Embedding OWL ontologies with OWL2Vec*. In: International semantic web conference (Posters and Demos)."},{"issue":"12","key":"5997_CR24","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1145\/1409360.1409377","volume":"51","author":"I Horrocks","year":"2008","unstructured":"Horrocks, I. (2008). Ontologies and the Semantic Web. Communications ACM, 51(12), 58\u201367.","journal-title":"Communications ACM"},{"key":"5997_CR25","unstructured":"Horrocks, I., Chen, J., Jaehun, L. (2020). Tool support for ontology design and quality assurance. In: ICBO 2020 integrated food ontology workshop (IFOW)."},{"key":"5997_CR26","doi-asserted-by":"crossref","unstructured":"Kulmanov, M., Liu-Wei, W., Yan, Y., Hoehndorf, R. (2019). EL Embeddings: Geometric construction of models for the description logic EL++. In: IJCAI.","DOI":"10.24963\/ijcai.2019\/845"},{"key":"5997_CR27","doi-asserted-by":"crossref","unstructured":"Kulmanov, M., Smaili, F. Z., Gao, X., & Hoehndorf, R. (2020). Semantic similarity and machine learning with ontologies. Briefings in. (bioinformatics).","DOI":"10.1093\/bib\/bbaa199"},{"key":"5997_CR28","unstructured":"Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X. (2015). Learning entity and relation embeddings for knowledge graph completion. In: AAAI."},{"key":"5997_CR29","first-page":"2579","volume":"9","author":"L Maaten","year":"2008","unstructured":"Maaten, L., & Hinton, G. (2008). Visualizing data using t-SNE. Journal of Machine Learning Research, 9, 2579\u20132605.","journal-title":"Journal of Machine Learning Research"},{"key":"5997_CR30","doi-asserted-by":"crossref","unstructured":"Miaschi, A., Dell\u2019Orletta, F. (2020). Contextual and non-contextual word embeddings: an in-depth linguistic investigation. In Proceedings of the 5th workshop on representation learning for NLP. pp. 110\u2013119.","DOI":"10.18653\/v1\/2020.repl4nlp-1.15"},{"key":"5997_CR31","unstructured":"Mikolov, T., Chen, K., Corrado, G., Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781."},{"key":"5997_CR32","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In: NeurIPS. pp. 3111\u20133119."},{"key":"5997_CR33","doi-asserted-by":"crossref","unstructured":"Moon, C., Jones, P., Samatova, N.F. (2017). Learning entity type embeddings for knowledge graph completion. In: CIKM. pp. 2215\u20132218.","DOI":"10.1145\/3132847.3133095"},{"key":"5997_CR34","first-page":"490","volume-title":"ISWC","author":"EB Myklebust","year":"2019","unstructured":"Myklebust, E. B., Jimenez-Ruiz, E., Chen, J., Wolf, R., & Tollefsen, K. E. (2019). Knowledge graph embedding for ecotoxicological effect prediction. ISWC (pp. 490\u2013506). Springer."},{"key":"5997_CR35","first-page":"180","volume-title":"International semantic web conference","author":"H Paulheim","year":"2015","unstructured":"Paulheim, H., & Gangemi, A. (2015). Serving DBpedia with DOLCE-more than just adding a cherry on top. International semantic web conference (pp. 180\u2013196). Springer."},{"key":"5997_CR36","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al., (2011). Scikit-learn: Machine learning in python. The Journal of machine Learning research, 12, 2825\u20132830.","journal-title":"The Journal of machine Learning research"},{"key":"5997_CR37","doi-asserted-by":"crossref","unstructured":"Peters, M.E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., Zettlemoyer, L. (2018). Deep contextualized word representations. In Proceedings of NAACL-HLT. pp. 2227\u20132237.","DOI":"10.18653\/v1\/N18-1202"},{"key":"5997_CR38","doi-asserted-by":"publisher","unstructured":"Rajaraman, A., Ullman, J.D. (2011). Data mining, p. 1\u201317. Cambridge University Press https:\/\/doi.org\/10.1017\/CBO9781139058452.002","DOI":"10.1017\/CBO9781139058452.002"},{"key":"5997_CR39","first-page":"498","volume-title":"ISWC","author":"P Ristoski","year":"2016","unstructured":"Ristoski, P., & Paulheim, H. (2016). RDF2Vec: RDF graph embeddings for data mining. ISWC (pp. 498\u2013514). Springer."},{"issue":"4","key":"5997_CR40","doi-asserted-by":"publisher","first-page":"721","DOI":"10.3233\/SW-180317","volume":"10","author":"P Ristoski","year":"2019","unstructured":"Ristoski, P., Rosati, J., Di Noia, T., De Leone, R., & Paulheim, H. (2019). RDF2Vec: RDF graph embeddings and their applications. Semantic Web, 10(4), 721\u2013752.","journal-title":"Semantic Web"},{"key":"5997_CR41","unstructured":"Ritchie, A., Chen, J., Castro, L.J., Rebholz-Schuhmann, D., Jim\u00e9nez-Ruiz, E. (2021). Ontology Clustering with OWL2Vec**. In: ESWC workshop DeepOntoNLP."},{"key":"5997_CR42","unstructured":"Rossi, A., Firmani, D., Matinata, A., Merialdo, P., Barbosa, D. (2020). Knowledge graph embedding for link prediction: A comparative analysis. arXiv preprint arXiv:2002.00819."},{"key":"5997_CR43","unstructured":"Shervashidze, N., Schweitzer, P., Van Leeuwen, E. J., Mehlhorn, K., & Borgwardt, K. M. (2011). Weisfeiler-lehman graph kernels. Journal of Machine Learning Research, 12(9)."},{"issue":"13","key":"5997_CR44","doi-asserted-by":"publisher","first-page":"i52","DOI":"10.1093\/bioinformatics\/bty259","volume":"34","author":"FZ Smaili","year":"2018","unstructured":"Smaili, F. Z., Gao, X., & Hoehndorf, R. (2018). Onto2vec: joint vector-based representation of biological entities and their ontology-based annotations. Bioinformatics, 34(13), i52\u2013i60.","journal-title":"Bioinformatics"},{"key":"5997_CR45","doi-asserted-by":"crossref","unstructured":"Smaili, F. Z., Gao, X., & Hoehndorf, R. (2018). OPA2Vec: combining formal and informal content of biomedical ontologies to improve similarity-based prediction. Bioinformatics, 35(12).","DOI":"10.1093\/bioinformatics\/bty933"},{"issue":"5","key":"5997_CR46","doi-asserted-by":"publisher","first-page":"627","DOI":"10.3233\/SW-180293","volume":"9","author":"A Soylu","year":"2018","unstructured":"Soylu, A., Kharlamov, E., Zheleznyakov, D., Jim\u00e9nez-Ruiz, E., Giese, M., Skj\u00e6veland, M. G., et al., (2018). OptiqueVQS: A visual query system over ontologies for industry. Semantic Web, 9(5), 627\u2013660.","journal-title":"Semantic Web"},{"key":"5997_CR47","doi-asserted-by":"crossref","unstructured":"Sun, Z., Zhang, Q., Hu, W., Wang, C., Chen, M., Akrami, F., Li, C. (2020). A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphs. arXiv preprint.","DOI":"10.14778\/3407790.3407828"},{"key":"5997_CR48","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., Polosukhin, I. (2017). Attention is all you need. In: Advances in neural information processing systems. pp. 5998\u20136008"},{"key":"5997_CR49","first-page":"664","volume-title":"International semantic web conference","author":"C Wang","year":"2019","unstructured":"Wang, C., Yan, M., Yi, C., & Sha, Y. (2019). Capturing semantic and syntactic information for link prediction in knowledge graphs. International semantic web conference (pp. 664\u2013679). Springer."},{"issue":"12","key":"5997_CR50","doi-asserted-by":"publisher","first-page":"2724","DOI":"10.1109\/TKDE.2017.2754499","volume":"29","author":"Q Wang","year":"2017","unstructured":"Wang, Q., Mao, Z., Wang, B., & Guo, L. (2017). Knowledge graph embedding: A survey of approaches and applications. IEEE Transactions on Knowledge and Data Engineering, 29(12), 2724\u20132743.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"5997_CR51","doi-asserted-by":"crossref","unstructured":"Wang, X., Ye, Y., Gupta, A. (2018). Zero-shot recognition via semantic embeddings and knowledge graphs. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 6857\u20136866.","DOI":"10.1109\/CVPR.2018.00717"},{"key":"5997_CR52","doi-asserted-by":"crossref","unstructured":"Yanardag, P., Vishwanathan, S. (2015). Deep graph kernels. In: 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. pp. 1365\u20131374.","DOI":"10.1145\/2783258.2783417"},{"key":"5997_CR53","unstructured":"Yang, B., Yih, W.t., He, X., Gao, J., Deng, L. (2014). Embedding entities and relations for learning and inference in knowledge bases. arXiv preprint arXiv:1412.6575"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-05997-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-021-05997-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-05997-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T22:04:07Z","timestamp":1623881047000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-021-05997-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,16]]},"references-count":53,"alternative-id":["5997"],"URL":"https:\/\/doi.org\/10.1007\/s10994-021-05997-6","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,16]]},"assertion":[{"value":"31 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 January 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 May 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 June 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}