{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,10]],"date-time":"2026-05-10T10:08:00Z","timestamp":1778407680280,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T00:00:00Z","timestamp":1697846400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,21]]},"DOI":"10.1145\/3583780.3615241","type":"proceedings-article","created":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T07:45:42Z","timestamp":1697874342000},"page":"3938-3942","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["KGrEaT: A Framework to Evaluate Knowledge Graphs via Downstream Tasks"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4354-9138","authenticated-orcid":false,"given":"Nicolas","family":"Heist","sequence":"first","affiliation":[{"name":"University of Mannheim, Mannheim, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0333-5888","authenticated-orcid":false,"given":"Sven","family":"Hertling","sequence":"additional","affiliation":[{"name":"University of Mannheim, Mannheim, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4386-8195","authenticated-orcid":false,"given":"Heiko","family":"Paulheim","sequence":"additional","affiliation":[{"name":"University of Mannheim, Mannheim, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,21]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3380599"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2021.3124805"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76298-0_52"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3186033"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-77385-4_37"},{"key":"e_1_3_2_1_6_1","volume-title":"Translating embeddings for modeling multi-relational data. Advances in neural information processing systems","author":"Bordes Antoine","year":"2013","unstructured":"Antoine Bordes , Nicolas Usunier , Alberto Garcia-Duran , Jason Weston , and Oksana Yakhnenko . 2013. Translating embeddings for modeling multi-relational data. Advances in neural information processing systems , Vol. 26 ( 2013 ). Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. Advances in neural information processing systems , Vol. 26 (2013)."},{"key":"e_1_3_2_1_7_1","volume-title":"Which knowledge graph is best for me? arXiv preprint arXiv:1809.11099","author":"Achim Rettinger Michael","year":"2018","unstructured":"Michael F\"arber and Achim Rettinger . 2018. Which knowledge graph is best for me? arXiv preprint arXiv:1809.11099 ( 2018 ). Michael F\"arber and Achim Rettinger. 2018. Which knowledge graph is best for me? arXiv preprint arXiv:1809.11099 (2018)."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.14778\/3342263.3342642"},{"key":"e_1_3_2_1_9_1","volume-title":"The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis)","author":"Maxwell Harper F","year":"2015","unstructured":"F Maxwell Harper and Joseph A Konstan . 2015. The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis) , Vol. 5 , 4 ( 2015 ), 1--19. F Maxwell Harper and Joseph A Konstan. 2015. The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis), Vol. 5, 4 (2015), 1--19."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.3390\/info9040075"},{"key":"e_1_3_2_1_11_1","volume-title":"Knowledge Graphs on the Web-An Overview. Knowledge Graphs for eXplainable Artificial Intelligence","author":"Heist Nicolas","year":"2020","unstructured":"Nicolas Heist , Sven Hertling , Daniel Ringler , and Heiko Paulheim . 2020. Knowledge Graphs on the Web-An Overview. Knowledge Graphs for eXplainable Artificial Intelligence ( 2020 ), 3--22. Nicolas Heist, Sven Hertling, Daniel Ringler, and Heiko Paulheim. 2020. Knowledge Graphs on the Web-An Overview. Knowledge Graphs for eXplainable Artificial Intelligence (2020), 3--22."},{"key":"e_1_3_2_1_12_1","volume-title":"Uncovering the Semantics of Wikipedia Categories. In International Semantic Web Conference. Springer, 219--236","author":"Heist Nicolas","year":"2019","unstructured":"Nicolas Heist and Heiko Paulheim . 2019 . Uncovering the Semantics of Wikipedia Categories. In International Semantic Web Conference. Springer, 219--236 . Nicolas Heist and Heiko Paulheim. 2019. Uncovering the Semantics of Wikipedia Categories. In International Semantic Web Conference. Springer, 219--236."},{"key":"e_1_3_2_1_13_1","volume-title":"The CaLiGraph ontology as a challenge for OWL reasoners. arXiv preprint arXiv:2110.05028","author":"Heist Nicolas","year":"2021","unstructured":"Nicolas Heist and Heiko Paulheim . 2021. The CaLiGraph ontology as a challenge for OWL reasoners. arXiv preprint arXiv:2110.05028 ( 2021 ). Nicolas Heist and Heiko Paulheim. 2021. The CaLiGraph ontology as a challenge for OWL reasoners. arXiv preprint arXiv:2110.05028 (2021)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-33455-9_11"},{"key":"e_1_3_2_1_15_1","volume-title":"KGSWC 2022, Madrid, Spain, November 21--23, 2022, Proceedings (Communications in Computer and Information Science","volume":"15","author":"Hertling Sven","year":"2022","unstructured":"Sven Hertling and Heiko Paulheim . 2022 . DBkWik- Multi Source Matching of Knowledge Graphs. In Knowledge Graphs and Semantic Web - 4th Iberoamerican Conference and third Indo-American Conference , KGSWC 2022, Madrid, Spain, November 21--23, 2022, Proceedings (Communications in Computer and Information Science , Vol. 1686). Springer, 1-- 15 . https:\/\/doi.org\/10.1007\/978--3-031--21422--6_1 10.1007\/978--3-031--21422--6_1 Sven Hertling and Heiko Paulheim. 2022. DBkWik- Multi Source Matching of Knowledge Graphs. In Knowledge Graphs and Semantic Web - 4th Iberoamerican Conference and third Indo-American Conference, KGSWC 2022, Madrid, Spain, November 21--23, 2022, Proceedings (Communications in Computer and Information Science, Vol. 1686). Springer, 1--15. https:\/\/doi.org\/10.1007\/978--3-031--21422--6_1"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-91305-2_4"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v29i1.9491"},{"key":"e_1_3_2_1_18_1","volume-title":"CIDR Conference.","author":"Mahdisoltani Farzaneh","year":"2014","unstructured":"Farzaneh Mahdisoltani , Joanna Biega , and Fabian Suchanek . 2014 . Yago3: A knowledge base from multilingual wikipedias. In 7th biennial conference on innovative data systems research . CIDR Conference. Farzaneh Mahdisoltani, Joanna Biega, and Fabian Suchanek. 2014. Yago3: A knowledge base from multilingual wikipedias. In 7th biennial conference on innovative data systems research. CIDR Conference."},{"key":"e_1_3_2_1_19_1","volume-title":"Efficient and robust approximate nearest neighbor search using hierarchical navigable small world graphs","author":"Malkov Yu A","year":"2018","unstructured":"Yu A Malkov and Dmitry A Yashunin . 2018. Efficient and robust approximate nearest neighbor search using hierarchical navigable small world graphs . IEEE transactions on pattern analysis and machine intelligence, Vol. 42 , 4 ( 2018 ), 824--836. Yu A Malkov and Dmitry A Yashunin. 2018. Efficient and robust approximate nearest neighbor search using hierarchical navigable small world graphs. IEEE transactions on pattern analysis and machine intelligence, Vol. 42, 4 (2018), 824--836."},{"key":"e_1_3_2_1_20_1","volume-title":"Proceedings of the 28th International Conference on Machine Learning (ICML)","volume":"11","author":"Nickel Maximilian","year":"2011","unstructured":"Maximilian Nickel , Volker Tresp , Hans-Peter Kriegel , 2011 . A three-way model for collective learning on multi-relational data .. In Proceedings of the 28th International Conference on Machine Learning (ICML) , Vol. 11 . 3104482--3104584. Maximilian Nickel, Volker Tresp, Hans-Peter Kriegel, et al. 2011. A three-way model for collective learning on multi-relational data.. In Proceedings of the 28th International Conference on Machine Learning (ICML), Vol. 11. 3104482--3104584."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2899005"},{"key":"e_1_3_2_1_22_1","volume-title":"Knowledge graph refinement: A survey of approaches and evaluation methods. Semantic web","author":"Paulheim Heiko","year":"2017","unstructured":"Heiko Paulheim . 2017. Knowledge graph refinement: A survey of approaches and evaluation methods. Semantic web , Vol. 8 , 3 ( 2017 ), 489--508. Heiko Paulheim. 2017. Knowledge graph refinement: A survey of approaches and evaluation methods. Semantic web, Vol. 8, 3 (2017), 489--508."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-49461-2_33"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2874809"},{"key":"e_1_3_2_1_25_1","volume-title":"RDF2Vec Light--A Lightweight Approach for Knowledge Graph Embeddings. arXiv preprint arXiv:2009.07659","author":"Portisch Jan","year":"2020","unstructured":"Jan Portisch , Michael Hladik , and Heiko Paulheim . 2020. RDF2Vec Light--A Lightweight Approach for Knowledge Graph Embeddings. arXiv preprint arXiv:2009.07659 ( 2020 ). Jan Portisch, Michael Hladik, and Heiko Paulheim. 2020. RDF2Vec Light--A Lightweight Approach for Knowledge Graph Embeddings. arXiv preprint arXiv:2009.07659 (2020)."},{"key":"e_1_3_2_1_26_1","volume-title":"Proceedings of the 17th International Workshop on Ontology Matching (OM 2022) (CEUR Workshop Proceedings","volume":"128","author":"Nikooie Pour Mina Abd","year":"2022","unstructured":"Mina Abd Nikooie Pour , Alsayed Algergawy , Patrice Buche , Leyla Jael Castro , Jiaoyan Chen , Hang Dong , Omaima Fallatah , Daniel Faria , Irini Fundulaki , Sven Hertling , Yuan He , Ian Horrocks , Martin Huschka , Liliana Ibanescu , Ernesto Jim\u00e9 nez- Ruiz , Naouel Karam , Amir Laadhar , Patrick Lambrix , Huanyu Li , Ying Li , Franck Michel , Engy Nasr , Heiko Paulheim , Catia Pesquita , Tzanina Saveta , Pavel Shvaiko , C\u00e1 ssia Trojahn , Chantelle Verhey , Mingfang Wu , Beyza Yaman , Ondrej Zamazal , and Lu Zhou . 2022 . Results of the Ontology Alignment Evaluation Initiative 2022 . In Proceedings of the 17th International Workshop on Ontology Matching (OM 2022) (CEUR Workshop Proceedings , Vol. 3324). CEUR-WS.org, 84-- 128 . https:\/\/ceur-ws.org\/Vol-3324\/oaei22_paper0.pdf Mina Abd Nikooie Pour, Alsayed Algergawy, Patrice Buche, Leyla Jael Castro, Jiaoyan Chen, Hang Dong, Omaima Fallatah, Daniel Faria, Irini Fundulaki, Sven Hertling, Yuan He, Ian Horrocks, Martin Huschka, Liliana Ibanescu, Ernesto Jim\u00e9 nez-Ruiz, Naouel Karam, Amir Laadhar, Patrick Lambrix, Huanyu Li, Ying Li, Franck Michel, Engy Nasr, Heiko Paulheim, Catia Pesquita, Tzanina Saveta, Pavel Shvaiko, C\u00e1 ssia Trojahn, Chantelle Verhey, Mingfang Wu, Beyza Yaman, Ondrej Zamazal, and Lu Zhou. 2022. Results of the Ontology Alignment Evaluation Initiative 2022. In Proceedings of the 17th International Workshop on Ontology Matching (OM 2022) (CEUR Workshop Proceedings, Vol. 3324). CEUR-WS.org, 84--128. https:\/\/ceur-ws.org\/Vol-3324\/oaei22_paper0.pdf"},{"key":"e_1_3_2_1_27_1","volume-title":"Gerben Klaas Dirk De Vries, and Heiko Paulheim","author":"Ristoski Petar","year":"2016","unstructured":"Petar Ristoski , Gerben Klaas Dirk De Vries, and Heiko Paulheim . 2016 . A collection of benchmark datasets for systematic evaluations of machine learning on the semantic web. In The Semantic Web--ISWC 2016: 15th International Semantic Web Conference, Kobe, Japan, October 17--21, 2016, Proceedings, Part II 15. Springer , 186--194. Petar Ristoski, Gerben Klaas Dirk De Vries, and Heiko Paulheim. 2016. A collection of benchmark datasets for systematic evaluations of machine learning on the semantic web. In The Semantic Web--ISWC 2016: 15th International Semantic Web Conference, Kobe, Japan, October 17--21, 2016, Proceedings, Part II 15. Springer, 186--194."},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings, Part I 15","author":"Ristoski Petar","year":"2016","unstructured":"Petar Ristoski and Heiko Paulheim . 2016 a. Rdf2vec: Rdf graph embeddings for data mining. In The Semantic Web--ISWC 2016: 15th International Semantic Web Conference, Kobe, Japan, October 17--21, 2016 , Proceedings, Part I 15 . Springer, 498--514. Petar Ristoski and Heiko Paulheim. 2016a. Rdf2vec: Rdf graph embeddings for data mining. In The Semantic Web--ISWC 2016: 15th International Semantic Web Conference, Kobe, Japan, October 17--21, 2016, Proceedings, Part I 15. Springer, 498--514."},{"key":"e_1_3_2_1_29_1","volume-title":"Proceedings, Part I 15","author":"Ristoski Petar","year":"2016","unstructured":"Petar Ristoski and Heiko Paulheim . 2016 b. Rdf2vec: Rdf graph embeddings for data mining. In The Semantic Web--ISWC 2016: 15th International Semantic Web Conference, Kobe, Japan, October 17--21, 2016 , Proceedings, Part I 15 . Springer, 498--514. Petar Ristoski and Heiko Paulheim. 2016b. Rdf2vec: Rdf graph embeddings for data mining. In The Semantic Web--ISWC 2016: 15th International Semantic Web Conference, Kobe, Japan, October 17--21, 2016, Proceedings, Part I 15. Springer, 498--514."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13740-021-00128-9"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68288-4_41"},{"key":"e_1_3_2_1_32_1","volume-title":"International conference on machine learning. PMLR","author":"Trouillon Th\u00e9o","year":"2016","unstructured":"Th\u00e9o Trouillon , Johannes Welbl , Sebastian Riedel , \u00c9ric Gaussier , and Guillaume Bouchard . 2016 . Complex embeddings for simple link prediction . In International conference on machine learning. PMLR , 2071--2080. Th\u00e9o Trouillon, Johannes Welbl, Sebastian Riedel, \u00c9ric Gaussier, and Guillaume Bouchard. 2016. Complex embeddings for simple link prediction. In International conference on machine learning. PMLR, 2071--2080."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.fmre.2021.09.003"},{"key":"e_1_3_2_1_34_1","volume-title":"3rd International Conference on Learning Representations, ICLR","author":"Yang Bishan","year":"2015","unstructured":"Bishan Yang , Wen-tau Yih, Xiaodong He , Jianfeng Gao , and Li Deng . 2015. Embedding Entities and Relations for Learning and Inference in Knowledge Bases . In 3rd International Conference on Learning Representations, ICLR 2015 , San Diego, CA , USA, May 7--9, 2015, Conference Track Proceedings, , Yoshua Bengio and Yann LeCun (Eds .). http:\/\/arxiv.org\/abs\/1412.6575 Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2015. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings, , Yoshua Bengio and Yann LeCun (Eds.). http:\/\/arxiv.org\/abs\/1412.6575"},{"key":"e_1_3_2_1_35_1","first-page":"1","article-title":"Quality assessment for linked open data: A survey","volume":"1","author":"Zaveri Amrapali","year":"2012","unstructured":"Amrapali Zaveri , Anisa Rula , Andrea Maurino , Ricardo Pietrobon , Jens Lehmann , and S\u00f6ren Auer . 2012 . Quality assessment for linked open data: A survey . Sem. Web , Vol. 1 (2012), 1 -- 5 . Amrapali Zaveri, Anisa Rula, Andrea Maurino, Ricardo Pietrobon, Jens Lehmann, and S\u00f6ren Auer. 2012. Quality assessment for linked open data: A survey. Sem. Web , Vol. 1 (2012), 1--5.","journal-title":"Sem. Web"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806511"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401172"}],"event":{"name":"CIKM '23: The 32nd ACM International Conference on Information and Knowledge Management","location":"Birmingham United Kingdom","acronym":"CIKM '23","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 32nd ACM International Conference on Information and Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3583780.3615241","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3583780.3615241","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:58Z","timestamp":1750178218000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3583780.3615241"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,21]]},"references-count":37,"alternative-id":["10.1145\/3583780.3615241","10.1145\/3583780"],"URL":"https:\/\/doi.org\/10.1145\/3583780.3615241","relation":{},"subject":[],"published":{"date-parts":[[2023,10,21]]},"assertion":[{"value":"2023-10-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}