{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T00:22:20Z","timestamp":1787876540552,"version":"build-2784847793"},"reference-count":101,"publisher":"Maximum Academic Press","license":[{"start":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T00:00:00Z","timestamp":1573689600000},"content-version":"unspecified","delay-in-days":317,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The Knowledge Engineering Review"],"published-print":{"date-parts":[[2019]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>User validation is one of the challenges facing the ontology alignment community, as there are limits to the quality of the alignments produced by automated alignment algorithms. In this paper, we present a broad study on user validation of ontology alignments that encompasses three distinct but inter-related aspects: the profile of the user, the services of the alignment system, and its user interface. We discuss key issues pertaining to the alignment validation process under each of these aspects and provide an overview of how current systems address them. Finally, we use experiments from the Interactive Matching track of the Ontology Alignment Evaluation Initiative 2015\u20132018 to assess the impact of errors in alignment validation, and how systems cope with them as function of their services.<\/jats:p>","DOI":"10.1017\/s0269888919000080","type":"journal-article","created":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T02:23:16Z","timestamp":1573698196000},"source":"Crossref","is-referenced-by-count":20,"title":["User validation in ontology alignment: functional assessment and impact"],"prefix":"10.48130","volume":"34","author":[{"given":"Huanyu","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zlatan","family":"Dragisic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Faria","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentina","family":"Ivanova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ernesto","family":"Jim\u00e9nez-Ruiz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9084-0470","authenticated-orcid":false,"given":"Patrick","family":"Lambrix","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catia","family":"Pesquita","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"27968","published-online":{"date-parts":[[2019,11,14]]},"reference":[{"key":"S0269888919000080_ref100","unstructured":"Wang, P. , Zhou, Y. & Xu, B. 2011. Matching large ontologies based on reduction anchors. 22nd International Joint Conference on Artificial Intelligence, 2343\u20132348."},{"key":"S0269888919000080_ref99","unstructured":"Wang, P. & Xu, B. 2009. An effective similarity propagation method for matching ontologies without sufficient or regular linguistic information. In The Semantic Web. Fourth Asian Conference, ASWC 2009, Shanghai, China, December 6\u20139, 2009. Proceedings, LNCS 5926, 105\u2013119."},{"key":"S0269888919000080_ref98","first-page":"21","article-title":"Debugging ontology mappings: a static approach","volume":"27","author":"Wang","year":"2008","journal-title":"Computing and Informatics"},{"key":"S0269888919000080_ref97","unstructured":"Tan, H. & Lambrix, P. 2007. A method for recommending ontology alignment strategies. The Semantic Web. 6th International Semantic Web Conference, 2nd Asian Semantic Web Conference, ISWC 2007 + ASWC 2007, Busan, Korea, November 11\u201315, 2007. Proceedings, LNCS 4825, 494\u2013507."},{"key":"S0269888919000080_ref44","unstructured":"Ivanova, V. , Lambrix, P. & \u00c5berg, J. 2015. Requirements for and evaluation of user support for large-scale ontology alignment. In The Semantic Web. Latest Advances and New Domains \u2013 12th European Semantic Web Conference, ESWC 2015, Portoroz, Slovenia, May 31\u2013June 4, 2015. Proceedings, LNCS 9088, 3\u201320."},{"key":"S0269888919000080_ref43","unstructured":"Ivanova, V. & Lambrix, P. 2013. A unified approach for aligning taxonomies and debugging taxonomies and their alignments. In The Semantic Web: Semantics and Big Data \u2013 10th International Conference, ESWC 2013, Montpellier, France, May 26-30, 2013. Proceedings, LNCS 7882, 1\u201315."},{"key":"S0269888919000080_ref41","unstructured":"Ivanova, V. , Bach, B. , Pietriga, E. & Lambrix, P. 2017. Alignment cubes: towards interactive visual exploration and evaluation of multiple ontology alignments. The Semantic Web \u2013 ISWC 2017 \u2013 16th International Semantic Web Conference, Vienna, Austria, October 21\u201325, 2017, Proceedings, Part I, LNCS 10587, 400\u2013417."},{"key":"S0269888919000080_ref15","doi-asserted-by":"publisher","DOI":"10.1186\/2041-1480-5-44"},{"key":"S0269888919000080_ref39","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2008.02.006"},{"key":"S0269888919000080_ref36","unstructured":"Hamdi, F. , Safar, B. , Niraula, N. & Reynaud, C. 2009. TaxoMap in the OAEI 2009 alignment contest. In 4th International Workshop on Ontology Matching, CEUR 551, 230\u2013237."},{"key":"S0269888919000080_ref35","unstructured":"Guedes, A. , Baiao, F. A. & Revoredo, K. 2014. On the identification and representation of ontology correspondence antipatterns. In 8th International Workshop on Modular Ontologies, CEUR 1248."},{"key":"S0269888919000080_ref34","doi-asserted-by":"publisher","DOI":"10.3390\/fi2030238"},{"key":"S0269888919000080_ref45","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2018.10.001"},{"key":"S0269888919000080_ref23","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-22630-4_6"},{"key":"S0269888919000080_ref13","unstructured":"da Silva, J. , Revoredo, K. , Baiao, F. & Euzenat, J. 2018b. Interactive ontology matching: using expert feedback to select attribute mappings. In 13th International Workshop on Ontology Matching, CEUR 2288, 25\u201336."},{"key":"S0269888919000080_ref72","unstructured":"Massmann, S. , Raunich, S. , Aum\u00fcller, D. , Arnold, P. & Rahm, E. 2011. Evolution of the COMA match system. In 6th International Workshop on Ontology Matching, CEUR 814, 49\u201360."},{"key":"S0269888919000080_ref10","unstructured":"Curino, C. , Orsi, G. & Tanca, L. 2007. X-SOM: A flexible ontology mapper. In 18th International Workshop on Database and Expert Systems Applications, 424\u2013428."},{"key":"S0269888919000080_ref5","unstructured":"Conroy, C. , Brennan, R. , O\u2019Sullivan, D. & Lewis, D. 2009. User evaluation study of a tagging approach to semantic mapping. In The Semantic Web: Research and Applications \u2013 6th European Semantic Web Conference, ESWC 2009, Heraklion, Crete, Greece, May 31\u2013June 4, 2009, Proceedings, LNCS 5554, 623\u2013637."},{"key":"S0269888919000080_ref14","unstructured":"Dhamankar, R. , Lee, Y. , Doan, A. , Halevy, A. & Domingos, P. 2004. iMAP: discovering complex semantic matches between database schemas. In ACM SIGMOD International Conference on Management of Data, 383\u2013394."},{"key":"S0269888919000080_ref9","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvlc.2007.02.005"},{"key":"S0269888919000080_ref29","unstructured":"Falconer, S. & Storey, M.-A. 2007. A cognitive support framework for ontology mapping. In The Semantic Web. 6th International Semantic Web Conference \u2013 2nd Asian Semantic Web Conference, ISWC 2007 + ASWC 2007, Busan, Korea, November 11\u201315, 2007. Proceedings, LNCS 4825, 114\u2013127."},{"key":"S0269888919000080_ref46","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2009.04.001"},{"key":"S0269888919000080_ref47","unstructured":"Jim\u00e9nez-Ruiz, E. , Cuenca Grau, B. , Horrocks, I. & Berlanga, R. 2009. Ontology integration using mappings: towards getting the right logical consequences. The Semantic Web: Research and Applications. ESWC 2009, LNCS 5554, 173\u2013187."},{"key":"S0269888919000080_ref27","unstructured":"Falconer, S. , Noy, N. & Storey, M.-A. 2006. Towards understanding the needs of cognitive support for ontology mapping. In First International Workshop on Ontology Matching, CEUR 225."},{"key":"S0269888919000080_ref42","unstructured":"Ivanova, V. , Bergman, J. L. , Hammerling, U. & Lambrix, P. 2012. Debugging taxonomies and their alignments: the ToxOntology-MeSH use case. In First International Workshop on Debugging Ontologies and Ontology Mappings, 25\u201336."},{"key":"S0269888919000080_ref70","doi-asserted-by":"crossref","first-page":"1218","DOI":"10.1109\/TKDE.2008.202","article-title":"Rimom: A dynamic multistrategy ontology alignment framework","volume":"21","author":"Li","year":"2009","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"S0269888919000080_ref92","unstructured":"Shi, F. , Li, J. , Tang, J. , Xie, G. & Li, H. 2009. Actively Learning Ontology Matching via User Interaction. In The Semantic Web - ISWC 2009, 8th International Semantic Web Conference, ISWC 2009, Chantilly, VA, USA, October 25\u201329, 2009. Proceedings, LNCS 5823, 585\u2013600."},{"key":"S0269888919000080_ref54","unstructured":"Kachroudi, M. , Diallo, G. & Ben Yahia, S. 2017. OAEI 2017 results of KEPLER. In 12th International Workshop on Ontology Matching, CEUR 2032, 138\u2013145."},{"key":"S0269888919000080_ref86","unstructured":"Quix, C. , Geisler, S. , Kensche, D. & Li, X. 2008. Results of GeRoMeSuite for OAEI 2008. 3rd International Workshop on Ontology Matching, CEUR 431, 160\u2013166."},{"key":"S0269888919000080_ref6","unstructured":"Cruz, I. F. , Antonelli, F. & Stroe, C. 2009. AgreementMaker: efficient matching for large real-world schemas and ontologies. Proceedings of the VLDB Endowment 2(2), 1586\u20131589."},{"key":"S0269888919000080_ref31","unstructured":"Faria, D. , Martins, C. , Nanavaty, A. , Oliveira, D. , Sowkarthiga, B. , Taheri, A. , Pesquita, C. , Couto, F. M. & Cruz, I. F. 2015. AML results for OAEI 2015. In 10th International Workshop on Ontology Matching, CEUR 1545, 116\u2013123."},{"key":"S0269888919000080_ref16","unstructured":"Djeddi, W. E. , Ben Yahia, S. & Khadir, M. T. 2018. XMap: Results for OAEI 2018. In 13th International Workshop on Ontology Matching, CEUR 2288, 210\u2013215."},{"key":"S0269888919000080_ref68","first-page":"1036","article-title":"Ontology visualization: tools and techniques for visual representation of semi-structured meta-data","volume":"16","author":"Lanzenberger","year":"2010","journal-title":"Journal of Universal Computer Science"},{"key":"S0269888919000080_ref28","unstructured":"Falconer, S. , Noy, N. & Storey, M.-A. 2007. Ontology mapping \u2013 a user survey. In 2nd International Workshop on Ontology Matching, CEUR 304, 49\u201360."},{"key":"S0269888919000080_ref17","unstructured":"Djeddi, W. E. & Khadir, M. T. 2014. A novel approach using context-based measure for matching large scale ontologies. In 16th International Conference on Data Warehousing and Knowledge Discovery, LNCS 8646, 320\u2013331."},{"key":"S0269888919000080_ref57","unstructured":"Kheder, N. & Diallo, G. 2015. ServOMBI at OAEI 2015. In 10th International Workshop on Ontology Matching, CEUR 1545, 200\u2013207."},{"key":"S0269888919000080_ref87","unstructured":"Reul, Q. & Pan, J. Z. 2010. KOSIMap: Use of description logic reasoning to align heterogeneous ontologies. In 23rd International Workshop on Description Logics, CEUR 573, 497\u2013508."},{"key":"S0269888919000080_ref7","doi-asserted-by":"publisher","DOI":"10.3233\/SW-150205"},{"key":"S0269888919000080_ref38","doi-asserted-by":"publisher","DOI":"10.1016\/j.drudis.2019.05.020"},{"key":"S0269888919000080_ref53","unstructured":"Jirkovsk\u00fd, V. & Ichise, R. 2013. MAPSOM: user involvement in ontology matching. In Semantic Technology. Third Joint International Conference, JIST 2013, Seoul, South Korea, November 28\u201330, 2013, Revised Selected Papers, LNCS 8388, 348\u2013363."},{"key":"S0269888919000080_ref37","unstructured":"Hamdi, F. , Reynaud, C. & Safar, B. 2010. Pattern-based mapping refinement. In 17th International Conference on Knowledge Engineering and Management, LNCS 6317, 1\u201315."},{"key":"S0269888919000080_ref3","unstructured":"Aurisano, J. , Nanavaty, A. & Cruz, I. F. 2015. Visual Analytics for Ontology Matching Using Multi-linked Views. In International Workshop on Visualizations and User Interfaces for Ontologies and Linked Data, CEUR 1456, 25\u201336."},{"key":"S0269888919000080_ref8","unstructured":"Cruz, I. F. , Stroe, C. & Palmonari, M. 2012. Interactive user feedback in ontology matching using signature vectors. In 28th IEEE International Conference on Data Engineering, 1321\u20131324."},{"key":"S0269888919000080_ref18","unstructured":"Dragisic, Z. , Ivanova, V. , Lambrix, P. , Faria, D. , Jim\u00e9nez-Ruiz, E. & Pesquita, C. 2016. User validation in ontology alignment, The Semantic Web \u2013 ISWC 2016 \u2013 15th International Semantic Web Conference, Kobe, Japan, October 17\u201321, 2016, Proceedings, Part I, LNCS 9981, 200\u2013217."},{"key":"S0269888919000080_ref4","doi-asserted-by":"publisher","DOI":"10.1186\/2041-1480-3-S1-S4"},{"key":"S0269888919000080_ref75","unstructured":"Melnik, S. , Garcia-Molina, H. , & Rahm, E. 2002. Similarity flooding: a versatile graph matching algorithm and its application to schema matching. In Proceedings 18th IEEE International Conference on Data Engineering, 117\u2013128."},{"key":"S0269888919000080_ref51","unstructured":"Jim\u00e9nez-Ruiz, E. , Payne, T. R. , Solimando, A. & Tamma, V. 2016. Limiting logical violations in ontology alignnment through negotiation. In Principles of Knowledge Representation and Reasoning (KR), 217\u2013226."},{"key":"S0269888919000080_ref11","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2011.05.008"},{"key":"S0269888919000080_ref19","doi-asserted-by":"publisher","DOI":"10.1186\/s13326-017-0166-5"},{"key":"S0269888919000080_ref66","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2006.05.003"},{"key":"S0269888919000080_ref96","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-016-0983-3"},{"key":"S0269888919000080_ref12","unstructured":"da Silva, J. , Revoredo, K. & Baiao, F. 2018a. ALIN results for OAEI 2018. In 13th International Workshop on Ontology Matching, CEUR 2288, 117\u2013124."},{"key":"S0269888919000080_ref20","unstructured":"Duan, S. , Fokoue, A. & Srinivas, K. 2010. One size does not fit all: Customizing ontology alignment using user feedback. In The Semantic Web \u2013 ISWC 2010 \u2013 9th International Semantic Web Conference, ISWC 2010, Shanghai, China, November 7-11, 2010, Revised Selected Papers, Part I, LNCS 6496, 177\u2013192."},{"key":"S0269888919000080_ref69","doi-asserted-by":"publisher","DOI":"10.1108\/13673270810913658"},{"key":"S0269888919000080_ref33","doi-asserted-by":"publisher","DOI":"10.1016\/S1071-5819(02)00127-1"},{"key":"S0269888919000080_ref21","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888918000073"},{"key":"S0269888919000080_ref79","unstructured":"Noy, N. F. , Mortensen, J. , Alexander, P. & Musen, M. 2013. Mechanical Turk as an ontology engineer? ACM Web Science, 262\u2013271."},{"key":"S0269888919000080_ref48","doi-asserted-by":"publisher","DOI":"10.1186\/2041-1480-2-S1-S2"},{"key":"S0269888919000080_ref74","unstructured":"Meilicke, C. , Stuckenschmidt, H. & Tamilin, A. 2008. Supporting manual mapping revision using logical reasoning. In 23rd AAAI Conference on Artificial Intelligence, 1213\u20131218."},{"key":"S0269888919000080_ref49","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25073-6_18"},{"key":"S0269888919000080_ref40","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2008.06.003"},{"key":"S0269888919000080_ref50","unstructured":"Jim\u00e9nez-Ruiz, E. , Cuenca Grau, B. , Zhou, Y. & Horrocks, I. 2012. Large-scale interactive ontology matching: algorithms and implementation. In 20th European Conference on Artificial Intelligence (ECAI), 444\u2013449."},{"key":"S0269888919000080_ref24","unstructured":"Euzenat, J. & Shvaiko, P. 2013. User Involvement. Ontology Matching, 353\u2013375."},{"key":"S0269888919000080_ref1","unstructured":"Abu Helou, M. & Palmonari, M. 2017. Multi-user feedback for large-scale cross-lingual ontology matching. In 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, 57\u201366."},{"key":"S0269888919000080_ref82","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2014.03.002"},{"key":"S0269888919000080_ref52","unstructured":"Jim\u00e9nez-Ruiz, E. , Agibetov, A. , Samwald, M. & Cross, V. 2018. Breaking-down the ontology alignment task with a lexical index and neural Embeddings. arXiv1805.12402."},{"key":"S0269888919000080_ref55","doi-asserted-by":"publisher","DOI":"10.1145\/1287620.1287621"},{"key":"S0269888919000080_ref56","unstructured":"Kensche, D. , Quix, C. , Li, X. & Li, Y. 2007. Geromesuite: A system for holistic generic model management. In 33rd International Conference on Very Large Data Bases, 1322\u20131325."},{"key":"S0269888919000080_ref58","doi-asserted-by":"publisher","DOI":"10.1186\/2041-1480-2-6"},{"key":"S0269888919000080_ref2","unstructured":"Aum\u00fcller, D. , Do, H. H. , Ma\u00dfmann, S. & Rahm, E. 2005. Schema and ontology matching with COMA++. In ACM SIGMOD International Conference on Management of Data, 906\u2013908."},{"key":"S0269888919000080_ref78","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-08-052029-2.50007-3"},{"key":"S0269888919000080_ref81","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2014.08.032"},{"key":"S0269888919000080_ref59","unstructured":"Laadhar, A. , Ghozzi, F. , Megdiche, I. , Ravat, F. , Teste, O. & Gargouri, F. 2018. OAEI 2018 results of POMap++. In 13th International Workshop on Ontology Matching, CEUR 2288, 192\u2013196."},{"key":"S0269888919000080_ref32","doi-asserted-by":"publisher","DOI":"10.3233\/SW-140163"},{"key":"S0269888919000080_ref60","unstructured":"Laera, L. , Tamma, V. , Euzenat, J. , Bench-Capon, T. & Payne, T. 2006. Reaching Agreement over Ontology Alignments. In The Semantic Web - ISWC 2006, 5th International Semantic Web Conference, ISWC 2006, Athens, GA, USA, November 5\u20139, 2006, Proceedings, LNCS 4273, 371\u2013384."},{"key":"S0269888919000080_ref77","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2016.09.002"},{"key":"S0269888919000080_ref61","unstructured":"Laera, L. , Blacoe, I. , Tamma, V. , Payne, T. , Euzenat, J. & Bench-Capon, T. 2007. Argumentation over Ontology Correspondences in MAS. In 6th International Joint Conference on Autonomous Agents and Multiagent Systems, 228:1\u2013228:8."},{"key":"S0269888919000080_ref62","unstructured":"Lambrix, P. , Dragisic, Z. & Ivanova, V. 2012. Get my pizza right: Repairing missing is-a relations in ALC ontologies. Semantic Technology. Second Joint International Conference, JIST 2012, Nara, Japan, December 2\u20134, 2012. Proceedings, LNCS 7774, 17\u201332."},{"key":"S0269888919000080_ref90","unstructured":"Schwichtenberg, S. & Engels, G. 2015. RSDL workbench results for OAEI 2015. In 10th International Workshop on Ontology Matching, CEUR 1545, 192\u2013199."},{"key":"S0269888919000080_ref63","unstructured":"Lambrix, P. & Edberg, A. 2003. Evaluation of ontology merging tools in bioinformatics. In Pacific Symposium on Biocomputing, 589\u2013600."},{"key":"S0269888919000080_ref64","doi-asserted-by":"publisher","DOI":"10.3233\/SW-160243"},{"key":"S0269888919000080_ref25","unstructured":"Euzenat, J. 2017. Interaction-based ontology alignment repair with expansion and relaxation. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI), 185\u2013191."},{"key":"S0269888919000080_ref65","unstructured":"Lambrix, P. & Liu, Q. 2009. Using partial reference alignments to align ontologies. In The Semantic Web: Research and Applications, 6th European Semantic Web Conference, ESWC 2009, Heraklion, Crete, Greece, May 31\u2013June 4, 2009, Proceedings, LNCS 5554, 188\u2013202."},{"key":"S0269888919000080_ref67","first-page":"182","article-title":"A tool for evaluating ontology alignment strategies","volume":"VIII","author":"Lambrix","year":"2007","journal-title":"Journal Data Semantics"},{"key":"S0269888919000080_ref71","unstructured":"Li, Y. , Stroe, C. & Cruz, I. F. 2015. Interactive visualization of large ontology matching results. In International Workshop on Visualizations and User Interfaces for Ontologies and Linked Data, CEUR 1456, 37\u201348."},{"key":"S0269888919000080_ref73","unstructured":"McCann, R. , Shen, W. & Doan, A. 2008. Matching schemas in online communities: a web 2.0 approach. In 2008 IEEE 24th International Conference on Data Engineering, 110\u2013119."},{"key":"S0269888919000080_ref101","unstructured":"Wei-Kleiner, F. , Dragisic, Z. & Lambrix, P. 2014. Abduction framework for repairing incomplete ELontologies: complexity results and algorithms. In 28th AAAI Conference on Artificial Intelligence, 1120\u20131127."},{"key":"S0269888919000080_ref94","unstructured":"Shvaiko, P. , Giunchiglia, F. , Da Silva, P. & McGuinness, D. 2005. Web explanations for semantic heterogeneity discovery. In The Semantic Web: Research and Applications, Second European Semantic Web Conference, ESWC 2005, Heraklion, Crete, Greece, May 29\u2013June 1, 2005, Proceedings, LNCS 3532, 303\u2013317."},{"key":"S0269888919000080_ref76","unstructured":"Nagy, M. , Vargas-Vera, M. & Stolarski, P. 2009. DSSim results for OAEI 2009. In 4th International Workshop on Ontology Matching, CEUR 551, 160\u2013169."},{"key":"S0269888919000080_ref80","unstructured":"Noy, N. & Musen, M. 2000. Algorithm & tool for automated ontology merging and alignment. In 17th AAAI Conference on Artificial Intelligence, 450\u2013455."},{"key":"S0269888919000080_ref85","unstructured":"Pesquita, C. , Faria, D. , Santos, E. , Neefs, J. & Couto, F. M. 2014. Towards visualizing the alignment of large biomedical ontologies. In Data Integration in the Life Sciences. 10th International Conference, DILS 2014, Lisbon, Portugal, July 17\u201318, 2014. Proceedings, LNBI 8574, 104\u2013111."},{"key":"S0269888919000080_ref22","unstructured":"Ehrig, M. & Sure, Y. 2005. Foam \u2013 framework for ontology alignment and mapping \u2013 results of the ontology alignment evaluation initiative. In Proceedings of the K-CAP 2005 Workshop on Integrating Ontologies, CEUR 156, 72\u201376."},{"key":"S0269888919000080_ref88","unstructured":"Ritze, D. & Paulheim, H. 2011. Towards an automatic parameterization of ontology matching tools based on example mappings. In 6th International Workshop on Ontology Matching, CEUR 814, 37\u201348."},{"key":"S0269888919000080_ref30","unstructured":"Faria, D. , Pesquita, C. , Santos, E. , Palmonari, M. , Cruz, I. F. & Couto, F. M. 2013. The AgreementMakerLight ontology matching system. In OTM 2013 Conferences, LNCS 8185, 527\u2013541."},{"key":"S0269888919000080_ref89","unstructured":"Sarasua, C. , Simperl, E. & Noy, N. F. 2012. Crowdmap: Crowdsourcing ontology alignment with microtasks. The Semantic Web \u2013 ISWC 2012 \u2013 11th International Semantic Web Conference, Boston, MA, USA, November 11\u201315, 2012, Proceedings, Part I, LNCS 7649, 525\u2013541."},{"key":"S0269888919000080_ref83","unstructured":"Paulheim, H. , Hertling, S. & Ritze, D. 2013. Towards evaluating interactive ontology matching tools. In The Semantic Web: Semantics and Big Data, 10th International Conference, ESWC 2013, Montpellier, France, May 26\u201330, 2013. Proceedings, LNCS 7882, 31\u201345."},{"key":"S0269888919000080_ref91","unstructured":"Shneiderman, B. 1996. The eyes have it: a task by data type taxonomy for information visualizations. IEEE Symposium on Visual Languages, 336\u2013343."},{"key":"S0269888919000080_ref84","unstructured":"Pesquita, C. , Ivanova, V. , Lohmann, S. & Lambrix, P. 2018. A framework to conduct and report on empirical user studies in semantic web contexts. In Knowledge Engineering and Knowledge Management. 21st International Conference, EKAW 2018, Nancy, France, November 12\u201316, 2018, Proceedings, LNCS 11313, 567\u2013583."},{"key":"S0269888919000080_ref26","unstructured":"Falconer, S. & Noy, N. 2011. Interactive techniques to support ontology matching. Schema Matching and Mapping, 29\u201351."},{"key":"S0269888919000080_ref93","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2011.253"},{"key":"S0269888919000080_ref95","volume-title":"Cognitive Psychology: Mind and Brain","author":"Smith","year":"2013"}],"container-title":["The Knowledge Engineering Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0269888919000080","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T14:42:13Z","timestamp":1767624133000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0269888919000080\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019]]},"references-count":101,"alternative-id":["S0269888919000080"],"URL":"https:\/\/doi.org\/10.1017\/s0269888919000080","relation":{},"ISSN":["0269-8889","1469-8005"],"issn-type":[{"value":"0269-8889","type":"print"},{"value":"1469-8005","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019]]},"article-number":"e15"}}