{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T11:04:15Z","timestamp":1778497455933,"version":"3.51.4"},"reference-count":27,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,4,10]],"date-time":"2025-04-10T00:00:00Z","timestamp":1744243200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Data"],"abstract":"<jats:p>This paper introduces a neuro-symbolic approach for relational exploration in cultural heritage knowledge graphs, exploiting Large Language Models (LLMs) for explanation generation and a mathematically grounded model to quantify the interestingness of relationships. We demonstrate the importance of the proposed interestingness measure through a quantitative analysis, highlighting its significant impact on system performance, particularly in terms of precision, recall, and F1-score. Utilizing the Wikidata Cultural Heritage Linked Open Data (WCH-LOD) dataset, our approach achieves a precision of 0.70, recall of 0.68, and an F1-score of 0.69, outperforming both graph-based (precision: 0.28, recall: 0.25, F1-score: 0.26) and knowledge-based (precision: 0.45, recall: 0.42, F1-score: 0.43) baselines. Furthermore, the proposed LLM-powered explanations exhibit better quality, as evidenced by higher BLEU (0.52), ROUGE-L (0.58), and METEOR (0.63) scores compared to baseline approaches. We further demonstrate a strong correlation (0.65) between the interestingness measure and the quality of generated explanations, validating its ability to guide the system towards more relevant discoveries. This system offers more effective exploration by achieving more diverse and human-interpretable relationship explanations compared to purely knowledge-based and graph-based methods, contributing to the knowledge-based systems field by providing a personalized and adaptable relational exploration framework.<\/jats:p>","DOI":"10.3390\/data10040052","type":"journal-article","created":{"date-parts":[[2025,4,10]],"date-time":"2025-04-10T07:41:51Z","timestamp":1744270911000},"page":"52","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Quantifying Relational Exploration in Cultural Heritage Knowledge Graphs with LLMs: A Neuro-Symbolic Approach for Enhanced Knowledge Discovery"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6114-4687","authenticated-orcid":false,"given":"Mohammed","family":"Maree","sequence":"first","affiliation":[{"name":"Faculty of Information Technology, Arab American University, Jenin 00970, Palestine"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"102753","DOI":"10.1016\/j.ipm.2021.102753","article-title":"Research of Chinese intangible cultural heritage knowledge graph construction and attribute value extraction with graph attention network","volume":"59","author":"Fan","year":"2022","journal-title":"Inf. Process. Manag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1145\/3447523","article-title":"Multi-modality Search and Recommendation on Palestinian Cultural Heritage Based on the Holy-Land Ontology and Extrinsic Semantic Resources","volume":"14","author":"Maree","year":"2021","journal-title":"J. Comput. Cult. Herit."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"323","DOI":"10.3233\/SW-223117","article-title":"Move cultural heritage knowledge graphs in everyone\u2019s pocket","volume":"14","author":"Pellegrino","year":"2023","journal-title":"Semant. Web"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Carriero, V.A., Gangemi, A., Mancinelli, M.L., Marinucci, L., Nuzzolese, A.G., Presutti, V., and Veninata, C. (2019, January 26\u201330). ArCo: The Italian cultural heritage knowledge graph. Proceedings of the 18th International Semantic Web Conference (ISWC 2019), Auckland, New Zealand. Proceedings, Part II 18.","DOI":"10.1007\/978-3-030-30796-7_3"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"313","DOI":"10.3233\/SW-200422","article-title":"Pattern-based design applied to cultural heritage knowledge graphs","volume":"12","author":"Carriero","year":"2021","journal-title":"Semant. Web"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Dhaliwal, C.K., and Brar, T.P.S. (2024). Unveiling Cultural Treasures Through Digital Learning, in Digital Cultural Heritage, CRC Press.","DOI":"10.1201\/9781032630564-7"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1080\/14626268.2018.1511602","article-title":"Digital heritage interpretation: A conceptual framework","volume":"29","author":"Rahaman","year":"2018","journal-title":"Digit. Creat."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Shao, S., Ribeiro, P.H., Ramirez, C.M., and Moore, J.H. (2024). A review of feature selection strategies utilizing graph data structures and Knowledge Graphs. Brief. Bioinform., 25.","DOI":"10.1093\/bib\/bbae521"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Capodiferro, C., De Maria, M., Mazzei, M., Spreafico, M., Bik, O.V., Palma, A.L., and Solovyeva, A.V. (2024). Cultural Itineraries Generated by Smart Data on the Web. ISPRS Int. J. Geo-Inf., 13.","DOI":"10.3390\/ijgi13020047"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3690390","article-title":"Efficient and user-friendly visualization of neural relightable images for cultural heritage applications","volume":"17","author":"Righetto","year":"2024","journal-title":"ACM J. Comput. Cult. Herit."},{"key":"ref_11","unstructured":"Tartari, G., and Hogan, A. (2018). WiSP: Weighted Shortest Paths for RDF Graphs, Universidad de Chile."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"187","DOI":"10.3233\/SW-190386","article-title":"Using the Semantic Web in digital humanities: Shift from data publishing to data-analysis and serendipitous knowledge discovery","volume":"11","year":"2020","journal-title":"Semant. Web"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1007\/s10489-023-05244-6","article-title":"Enhancing scenic recommendation and tour route personalization in tourism using ugc text mining","volume":"54","author":"Liang","year":"2024","journal-title":"Appl. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.knosys.2014.10.001","article-title":"Addressing semantic heterogeneity through multiple knowledge base assisted merging of domain-specific ontologies","volume":"73","author":"Maree","year":"2015","journal-title":"Knowl.-Based Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3708326","article-title":"Generating SPARQL Queries over CIDOC-CRM using a Two-Stage Ontology Path Patterns Method in LLM Prompts","volume":"18","author":"Mountantonakis","year":"2025","journal-title":"ACM J. Comput. Cult. Herit."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2388","DOI":"10.1109\/TKDE.2017.2735970","article-title":"An empirical evaluation of techniques for ranking semantic associations","volume":"29","author":"Cheng","year":"2017","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Cheng, G., Zhang, Y., and Qu, Y. (2014, January 19\u201323). Explass: Exploring associations between entities via top-k ontological patterns and facets. Proceedings of the 13th International Semantic Web Conference (ISWC 2014), Riva del Garda, Italy. Proceedings, Part II 13.","DOI":"10.1007\/978-3-319-11915-1_27"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Rantala, H., Leskinen, P., Peura, L., and Hyv\u00f6nen, E. (2024). Representing and searching associations in cultural heritage knowledge graphs using faceted search. Knowledge Graphs in the Age of Language Models and Neuro-Symbolic AI, IOS Press.","DOI":"10.3233\/SSW240033"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ismail, S., and Shaikh, T. (2017, January 10\u201311). EnSense\u2014A commonality checker for Semantic Web. Proceedings of the 2017 International Conference on IoT in Social, Mobile, Analytics and Cloud (I-SMAC), Palladam, India.","DOI":"10.1109\/I-SMAC.2017.8058386"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Li, J., and Bikakis, A. (2023). Towards a Semantics-Based Recommendation System for Cultural Heritage Collections. Appl. Sci., 13.","DOI":"10.3390\/app13158907"},{"key":"ref_21","unstructured":"Bugue\u00f1o, M., Biswas, R., and de Melo, G. (2024). Graph-Based Explainable AI: A Comprehensive Survey, HAL Open Science."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3485844","article-title":"Learning and reasoning for cultural metadata quality: Coupling symbolic AI and machine learning over a semantic web knowledge graph to support museum curators in improving the quality of cultural metadata and information retrieval","volume":"15","author":"Bobasheva","year":"2022","journal-title":"J. Comput. Cult. Herit. JOCCH"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1977","DOI":"10.1108\/LHT-05-2022-0265","article-title":"A framework of genealogy knowledge reasoning and visualization based on a knowledge graph","volume":"42","author":"Wang","year":"2024","journal-title":"Library Hi Tech"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, Y., Liu, J., Wang, W., Chen, J., Yang, X., Sang, L., Wen, Z., and Peng, Q. (2024). Construction of Cultural Heritage Knowledge Graph Based on Graph Attention Neural Network. Appl. Sci., 14.","DOI":"10.3390\/app14188231"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.aiopen.2021.01.001","article-title":"Graph neural networks: A review of methods and applications","volume":"1","author":"Zhou","year":"2020","journal-title":"AI Open"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"D\u00edaz-Rodr\u00edguez, N., and Pisoni, G. (2020, January 12\u201318). Accessible cultural heritage through explainable artificial intelligence. Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization, Genoa, Italy.","DOI":"10.1145\/3386392.3399276"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI","volume":"58","author":"Arrieta","year":"2020","journal-title":"Inf. Fusion"}],"container-title":["Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5729\/10\/4\/52\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:12:03Z","timestamp":1760029923000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5729\/10\/4\/52"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,10]]},"references-count":27,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4]]}},"alternative-id":["data10040052"],"URL":"https:\/\/doi.org\/10.3390\/data10040052","relation":{},"ISSN":["2306-5729"],"issn-type":[{"value":"2306-5729","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,10]]}}}