{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T18:28:38Z","timestamp":1767637718572,"version":"3.48.0"},"reference-count":47,"publisher":"Maximum Academic Press","license":[{"start":{"date-parts":[[2020,5,29]],"date-time":"2020-05-29T00:00:00Z","timestamp":1590710400000},"content-version":"unspecified","delay-in-days":149,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The Knowledge Engineering Review"],"published-print":{"date-parts":[[2020]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The development of semi-automated and automated ontology alignment techniques is an important part of realizing the potential of the Semantic Web. Until very recently, most existing work in this area was focused on finding simple (1:1) equivalence correspondences between two ontologies. However, many real-world ontology pairs involve correspondences that contain multiple entities from each ontology. These \u2018complex\u2019 alignments pose a challenge for existing evaluation approaches, which hinders the development of new systems capable of finding such correspondences. This position paper surveys and analyzes the requirements for effective evaluation of complex ontology alignments and assesses the degree to which these requirements are met by existing approaches. It also provides a roadmap for future work on this topic taking into consideration emerging community initiatives and major challenges that need to be addressed.<\/jats:p>","DOI":"10.1017\/s0269888920000168","type":"journal-article","created":{"date-parts":[[2020,5,29]],"date-time":"2020-05-29T08:36:14Z","timestamp":1590741374000},"source":"Crossref","is-referenced-by-count":5,"title":["Towards evaluating complex ontology alignments"],"prefix":"10.48130","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0453-9965","authenticated-orcid":false,"given":"Lu","family":"Zhou","sequence":"first","affiliation":[]},{"given":"Elodie","family":"Thi\u00e9blin","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8457-6300","authenticated-orcid":false,"given":"Michelle","family":"Cheatham","sequence":"additional","affiliation":[]},{"given":"Daniel","family":"Faria","sequence":"additional","affiliation":[]},{"given":"Catia","family":"Pesquita","sequence":"additional","affiliation":[]},{"given":"Cassia","family":"Trojahn","sequence":"additional","affiliation":[]},{"given":"Ond\u0159ej","family":"Zamazal","sequence":"additional","affiliation":[]}],"member":"27968","published-online":{"date-parts":[[2020,5,29]]},"reference":[{"key":"S0269888920000168_ref46","unstructured":"Zhou, L. , Cheatham, M. , Krisnadhi, A. & Hitzler, P. 2018. A complex alignment benchmark: geolink dataset. In The Semantic Web - ISWC 2018 - 17th International Semantic Web Conference, Monterey, CA, USA, October 8\u201312, 2018, Proceedings, Part II, 273\u2013288."},{"key":"S0269888920000168_ref43","doi-asserted-by":"publisher","DOI":"10.4018\/IJSWIS.2016040102"},{"key":"S0269888920000168_ref44","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2018\/777"},{"key":"S0269888920000168_ref41","unstructured":"Van Hage, W. R. , Isaac, A. & Aleksovski, Z. 2007. Sample evaluation of ontology-matching systems. In EON, 2007, 41\u201350."},{"key":"S0269888920000168_ref37","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-70863-8_3"},{"key":"S0269888920000168_ref36","unstructured":"Thi\u00e9blin, E. , Amarger, F. , Haemmerl\u00e9, O. , Hernandez, N. & dos Santos, C. T. (2016). Rewriting SELECT SPARQL queries from 1:n complex correspondences. In Proceedings of the 11th International Workshop on Ontology Matching Co-Located with the 15th International Semantic Web Conference (ISWC 2016), Kobe, Japan, October 18, 2016, 49\u201360."},{"key":"S0269888920000168_ref35","unstructured":"\u0160v\u00e1b, O. , Sv\u00e1tek, V. , Berka, P. , Rak, D. & Tom\u00e1\u0161ek, P. 2005. Ontofarm: towards an experimental collection of parallel ontologies. In Poster Track of ISWC, 2005."},{"key":"S0269888920000168_ref34","unstructured":"Solimando, A. , Jimenez-Ruiz, E. & Pinkel, C. 2014. Evaluating ontology alignment systems in query answering tasks. In Proceedings of the 2014 International Conference on Posters & Demonstrations Track, 1272, 301\u2013304. CEUR-WS.org."},{"key":"S0269888920000168_ref33","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-016-0983-3"},{"key":"S0269888920000168_ref32","doi-asserted-by":"publisher","DOI":"10.4018\/jwp.2011070101"},{"key":"S0269888920000168_ref31","doi-asserted-by":"publisher","DOI":"10.1007\/s13740-012-0011-z"},{"key":"S0269888920000168_ref30","unstructured":"Scharffe, F. 2009. Correspondence Patterns Representation . PhD thesis, Faculty of Mathematics, Computer Science and University of Innsbruck."},{"key":"S0269888920000168_ref29","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-017-0489-y"},{"key":"S0269888920000168_ref28","unstructured":"Ritze, D. , V\u00f6lker, J. , Meilicke, C. & \u0160v\u00e1b Zamazal, O. 2010. Linguistic analysis for complex ontology matching. In 5th Workshop on Ontology Matching, 1\u201312."},{"key":"S0269888920000168_ref6","unstructured":"Ehrig, M. & Euzenat, J. 2005. Relaxed precision and recall for ontology matching. In Integrating Ontologies\u201905, Proceedings of the K-CAP 2005 Workshop on Integrating Ontologies, Banff, Canada, October 2, 2005."},{"key":"S0269888920000168_ref5","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35176-1_4"},{"key":"S0269888920000168_ref10","unstructured":"Euzenat, J. , Scharffe, F. & Zimmermann, A. 2007. Expressive alignment language and implementation. https:\/\/hal.inria.fr\/file\/index\/docid\/822892\/filename\/kweb-2210.pdf"},{"key":"S0269888920000168_ref39","unstructured":"Thi\u00e9blin, E. , Haemmerl\u00e9, O. , Hernandez, N. & Trojahn, C. 2018. Task-oriented complex ontology alignment: two alignment evaluation sets. In The Semantic Web - 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3\u20137, 2018, Proceedings, 655\u2013670."},{"key":"S0269888920000168_ref9","unstructured":"Euzenat, J. , Polleres, A. & Scharffe, F. 2008. Processing ontology alignments with SPARQL. In 2008 International Conference on Complex, Intelligent and Software Intensive Systems, 913\u2013917."},{"key":"S0269888920000168_ref7","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30475-3_48"},{"key":"S0269888920000168_ref2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11915-1_3"},{"key":"S0269888920000168_ref8","unstructured":"Euzenat, J. 2007. Semantic precision and recall for ontology alignment evaluation. In IJCAI 2007, Proceedings of the 20th International Joint Conference on Artificial Intelligence, Hyderabad, India, January 6\u201312, 2007, 348\u2013353."},{"key":"S0269888920000168_ref3","unstructured":"David, J. , Euzenat, J. , Genev\u00e8s, P. & Layada, N. 2018. Evaluation of query transformations without data: short paper. In Companion of the The Web Conference 2018 on The Web Conference 2018, WWW 2018, Lyon, France, April 23\u201327, 2018, 1599\u20131602."},{"key":"S0269888920000168_ref26","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76848-7_56"},{"key":"S0269888920000168_ref12","unstructured":"Hollink, L. , Van Assem, M. , Wang, S. , Isaac, A. & Schreiber, G. 2008. Two variations on ontology alignment evaluation: methodological issues. In 5th European Semantic Web Conference, 388\u2013401."},{"key":"S0269888920000168_ref14","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76298-0_19"},{"key":"S0269888920000168_ref4","doi-asserted-by":"publisher","DOI":"10.3233\/SW-2011-0028"},{"key":"S0269888920000168_ref22","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-17746-0_38"},{"key":"S0269888920000168_ref11","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38721-0"},{"key":"S0269888920000168_ref23","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35176-1_27"},{"key":"S0269888920000168_ref15","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-53455-7_4"},{"key":"S0269888920000168_ref13","unstructured":"Isaac, A. , Matthezing, H. , van der Meij, L. , Schlobach, S. , Wang, S. & Zinn, C. 2008. Putting ontology alignment in context: usage scenarios, deployment and evaluation in a library case. In 5th European Semantic Web Conference, 402\u2013417."},{"key":"S0269888920000168_ref16","doi-asserted-by":"publisher","DOI":"10.1186\/2041-1480-2-S1-S2"},{"key":"S0269888920000168_ref17","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-73255-6_15"},{"key":"S0269888920000168_ref45","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2017.01.001"},{"key":"#cr-split#-S0269888920000168_ref42.1","unstructured":"Visser, P. R. , Jones, D. M. , Bench-Capon, T. J. & Shave, M. 1997. An analysis of ontology mismatches"},{"key":"#cr-split#-S0269888920000168_ref42.2","unstructured":"heterogeneity versus interoperability. In AAAI 1997 Spring Symposium on Ontological Engineering, Stanford CA, USA, 164-72."},{"key":"S0269888920000168_ref18","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45810-7_23"},{"key":"S0269888920000168_ref40","unstructured":"Thi\u00e9blin, E. , Haemmerl\u00e9, O. & Trojahn, C. 2018b. Complex matching based on competency questions for alignment: a first sketch. In OM 2018 - 13th ISWC Workshop on Ontology Matching."},{"key":"S0269888920000168_ref24","unstructured":"Pesquita, C. , Faria, D. , Santos, E. & Couto, F. M. 2013. To repair or not to repair: reconciling correctness and coherence in ontology reference alignments. In OM, 13\u201324."},{"key":"S0269888920000168_ref1","first-page":"71","article-title":"Means: une approche s\u00e9mantique pour la recherche de r\u00e9ponses aux questions m\u00e9dicales","volume":"55","author":"Abacha","year":"2014","journal-title":"TAL"},{"key":"S0269888920000168_ref20","unstructured":"Meilicke, C. & Stuckenschmidt, H. 2008. Incoherence as a basis for measuring the quality of ontology mappings. In 3rd International Conference on Ontology Matching, 431, 1\u201312."},{"key":"S0269888920000168_ref38","unstructured":"Thi\u00e9blin, E. , Cheatham, M. , Trojahn, C. , Zamazal, O. & Zhou, L. 2018a. The first version of the OAEI complex alignment benchmark. In ISWC Posters and Demos. Springer."},{"key":"S0269888920000168_ref27","unstructured":"Ritze, D. , Meilicke, C. , \u0160v\u00e1b Zamazal, O. & Stuckenschmidt, H. 2009. A pattern-based ontology matching approach for detecting complex correspondences. In 4th ISWC Workshop on Ontology Matching, 25\u201336."},{"key":"S0269888920000168_ref25","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76298-0_28"},{"key":"S0269888920000168_ref19","doi-asserted-by":"publisher","DOI":"10.1145\/2247596.2247678"},{"key":"S0269888920000168_ref21","unstructured":"Nunes, B. P. , Mera, A. , Casanova, M. A. , Breitman, K. K. & Leme, L. A. P. 2011. Complex matching of RDF datatype properties. In Proceedings of the 6th International Conference on Ontology Matching, 814, 254\u2013255. CEUR-WS.org."}],"container-title":["The Knowledge Engineering Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0269888920000168","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T14:42:17Z","timestamp":1767624137000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0269888920000168\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"references-count":47,"alternative-id":["S0269888920000168"],"URL":"https:\/\/doi.org\/10.1017\/s0269888920000168","relation":{},"ISSN":["0269-8889","1469-8005"],"issn-type":[{"type":"print","value":"0269-8889"},{"type":"electronic","value":"1469-8005"}],"subject":[],"published":{"date-parts":[[2020]]},"article-number":"e21"}}