{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T10:19:23Z","timestamp":1777889963025,"version":"3.51.4"},"reference-count":19,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SW"],"published-print":{"date-parts":[[2020,11,19]]},"abstract":"<jats:p>Matching entities between datasets is a crucial step for combining multiple datasets on the semantic web. A rich literature exists on different approaches to this entity resolution problem. However, much less work has been done on how to assess the quality of such entity links once they have been generated. Evaluation methods for link quality are typically limited to either comparison with a ground truth dataset (which is often not available), manual work (which is cumbersome and prone to error), or crowd sourcing (which is not always feasible, especially if expert knowledge is required). Furthermore, the problem of link evaluation is greatly exacerbated for links between more than two datasets, because the number of possible links grows rapidly with the number of datasets. In this paper, we propose a method to estimate the quality of entity links between multiple datasets. We exploit the fact that the links between entities from multiple datasets form a network, and we show how simple metrics on this network can reliably predict their quality. We verify our results in a large experimental study using six datasets from the domain of science, technology and innovation studies, for which we created a gold standard. This gold standard, available online, is an additional contribution of this paper. In addition, we evaluate our metric on a recently published gold standard to confirm our findings.<\/jats:p>","DOI":"10.3233\/sw-200410","type":"journal-article","created":{"date-parts":[[2020,10,23]],"date-time":"2020-10-23T14:09:02Z","timestamp":1603462142000},"page":"21-40","source":"Crossref","is-referenced-by-count":2,"title":["Network metrics for assessing the quality of entity resolution between multiple datasets1"],"prefix":"10.1177","volume":"12","author":[{"given":"Al","family":"Idrissou","sequence":"first","affiliation":[{"name":"Department of Computer Science, Vrije Universiteit Amsterdam, The Netherlands. E-mails:\u00a0o.a.k.idrissou@vu.nl,\u00a0frank.van.harmelen@vu.nl"},{"name":"Department of Organization Sciences, Vrije Universiteit Amsterdam, The Netherlands. E-mail:\u00a0p.a.a.vanden.besselaar@vu.nl"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Frank","family":"van Harmelen","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Vrije Universiteit Amsterdam, The Netherlands. E-mails:\u00a0o.a.k.idrissou@vu.nl,\u00a0frank.van.harmelen@vu.nl"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"van den Besselaar","sequence":"additional","affiliation":[{"name":"Department of Organization Sciences, Vrije Universiteit Amsterdam, The Netherlands. E-mail:\u00a0p.a.a.vanden.besselaar@vu.nl"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/SW-200410_ref1","doi-asserted-by":"publisher","DOI":"10.3115\/1613715.1613754"},{"key":"10.3233\/SW-200410_ref2","unstructured":"S.\u00a0Cucerzan, Large-scale named entity disambiguation based on Wikipedia data, in: Proc. of the 2007 Joint Conf. on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), Association for Computational Linguistics, Prague, Czech Republic, 2007, pp.\u00a0708\u2013716."},{"key":"10.3233\/SW-200410_ref3","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88564-1_16"},{"key":"10.3233\/SW-200410_ref4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-17746-0_9"},{"key":"10.3233\/SW-200410_ref5","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38721-0"},{"key":"10.3233\/SW-200410_ref6","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30284-8_13"},{"key":"10.3233\/SW-200410_ref7","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646084"},{"issue":"2","key":"10.3233\/SW-200410_ref8","doi-asserted-by":"publisher","first-page":"1590","DOI":"10.14778\/1687553.1687599","article-title":"Linkage query writer","volume":"2","author":"Hassanzadeh","year":"2009","journal-title":"Proceedings of the VLDB Endowment"},{"key":"10.3233\/SW-200410_ref9","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-03667-6_10"},{"key":"10.3233\/SW-200410_ref10","doi-asserted-by":"publisher","DOI":"10.3233\/WEB-180371"},{"key":"10.3233\/SW-200410_ref11","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45810-7_24"},{"issue":"1\u20132","key":"10.3233\/SW-200410_ref12","doi-asserted-by":"publisher","first-page":"208","DOI":"10.14778\/1920841.1920871","article-title":"Evaluating entity resolution results","volume":"3","author":"Menestrina","year":"2010","journal-title":"Proceedings of the VLDB Endowment"},{"key":"10.3233\/SW-200410_ref13","doi-asserted-by":"publisher","DOI":"10.5591\/978-1-57735-516-8\/IJCAI11-385"},{"key":"10.3233\/SW-200410_ref14","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93417-4_37"},{"key":"10.3233\/SW-200410_ref15","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-58068-5_5"},{"issue":"7","key":"10.3233\/SW-200410_ref16","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/j.ipl.2013.01.016","article-title":"A simple test on 2-vertex- and 2-edge-connectivity","volume":"113","author":"Schmidt","year":"2013","journal-title":"Information Processing Letters"},{"key":"10.3233\/SW-200410_ref17","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11964-9_29"},{"key":"10.3233\/SW-200410_ref18","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04930-9_41"},{"key":"10.3233\/SW-200410_ref19","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72667-8_23"}],"container-title":["Semantic Web"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/SW-200410","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T05:25:08Z","timestamp":1777613108000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/SW-200410"}},"subtitle":[],"editor":[{"given":"Catherine Faron","family":"Zucker","sequence":"additional","affiliation":[{"name":"University of Nice Sophia Antipolis, France"}],"role":[{"role":"editor","vocabulary":"crossref"}]},{"given":"Chiara","family":"Ghidini","sequence":"additional","affiliation":[{"name":"Fondazione Bruno Kessler, Italy"}],"role":[{"role":"editor","vocabulary":"crossref"}]},{"given":"Catherina","family":"Faron","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]},{"given":"Chiara","family":"Ghidini","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2020,11,19]]},"references-count":19,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/sw-200410","relation":{},"ISSN":["2210-4968","1570-0844"],"issn-type":[{"value":"2210-4968","type":"electronic"},{"value":"1570-0844","type":"print"}],"subject":[],"published":{"date-parts":[[2020,11,19]]}}}