{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T20:53:21Z","timestamp":1768942401179,"version":"3.49.0"},"reference-count":54,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2025,10,24]],"date-time":"2025-10-24T00:00:00Z","timestamp":1761264000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,10,24]],"date-time":"2025-10-24T00:00:00Z","timestamp":1761264000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100018693","name":"HORIZON EUROPE Framework Programme","doi-asserted-by":"publisher","award":["GA 101137074"],"award-info":[{"award-number":["GA 101137074"]}],"id":[{"id":"10.13039\/100018693","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Digit Libr"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Nanopublishing is a paradigm enabling the representation of scientific claims in a distinctive, identifiable, citable, and reusable format, i.e., as a named graph. This approach can be applied to sentences extracted from scientific publications or triples within a Knowledge Base (KB). This way, one can track the provenance of assertions derived from a specific publication or database. However, nanopublications do not natively support multi-source scientific claims generated by aggregating different bodies of knowledge. This work extends the nanopublication model with\n                    <jats:italic>knowledge provenance<\/jats:italic>\n                    , capturing provenance information for assertions derived by an aggregation algorithm or a truth discovery process , e.g., an information extraction system aggregating several sources of knowledge to populate a Knowledge Base (KB). In these cases, provenance information cannot be attributed to a single source, but it is the result of an ensemble of evidence, that can comprehend supporting and conflicting pieces of evidence and truth values. Knowledge provenance is represented as a named graph following the PROV-K ontology, developed for the case. To show how knowledge provenance applies to a real-world scenario, we serialized gene expression-cancer associations generated by the Collaborative Oriented Relation Extraction (CORE) System. To demonstrate the value of trust relationships, we present a use case leveraging an existing scientific KB to construct a trust network employing three Large Language Model (LLM) agents. We analyzed the ability of LLMs to evaluate trustworthiness, exploiting techniques from KB accuracy estimation. We published 197,\u00a0511 assertions generated by the CORE system in the form of extended nanopublications with knowledge provenance. PROV-K also defines trust relationships between agents or between an agent and a proposition. Starting from these assertions, we leveraged external agents \u2013 namely, multiple LLMs \u2013 to assess their trusted truth value. Based on these values, we defined trust relationships between the agents and the facts, yielding an exemplar trust network comprising over 45,000 facts and four agents. The\n                    <jats:italic>knowledge provenance<\/jats:italic>\n                    graph allows the tracking of provenance for each piece of evidence contributing to the support or refutation of an assertion. To capture the semantics of the newly presented graph, we define the PROV-K ontology, designed to represent provenance information for multi-source assertions. The two use cases serve as a template to show how to serialize extended nanopublications and showcase the trust relationships\u2019 capabilities.\n                  <\/jats:p>","DOI":"10.1007\/s00799-025-00431-x","type":"journal-article","created":{"date-parts":[[2025,10,24]],"date-time":"2025-10-24T20:50:45Z","timestamp":1761339045000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Provenance-driven nanopublications: representing source lineage and trust networks for multi-source assertions"],"prefix":"10.1007","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0676-682X","authenticated-orcid":false,"given":"Laura","family":"Menotti","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0362-5893","authenticated-orcid":false,"given":"Stefano","family":"Marchesin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5015-5498","authenticated-orcid":false,"given":"Fabio","family":"Giachelle","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4970-4554","authenticated-orcid":false,"given":"Gianmaria","family":"Silvello","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,10,24]]},"reference":[{"issue":"2\u20134","key":"431_CR1","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1561\/1900000064","volume":"10","author":"G Weikum","year":"2021","unstructured":"Weikum, G., Dong, X.L., Razniewski, S., Suchanek, F.M.: Machine knowledge: creation and curation of comprehensive knowledge bases. Found. Trends Databases 10(2\u20134), 108\u2013490 (2021). https:\/\/doi.org\/10.1561\/1900000064","journal-title":"Found. Trends Databases"},{"issue":"12","key":"431_CR2","doi-asserted-by":"publisher","first-page":"4130","DOI":"10.14778\/3611540.3611636","volume":"16","author":"XL Dong","year":"2023","unstructured":"Dong, X.L.: Generations of knowledge graphs: the crazy Iideas and the business impact. Proc. VLDB Endow. 16(12), 4130\u20134137 (2023). https:\/\/doi.org\/10.14778\/3611540.3611636","journal-title":"Proc. VLDB Endow."},{"issue":"1\u20132","key":"431_CR3","doi-asserted-by":"publisher","first-page":"51","DOI":"10.3233\/ISU-2010-0613","volume":"30","author":"P Groth","year":"2010","unstructured":"Groth, P., Gibson, A., Velterop, J.: The anatomy of a nanopublication. Inf. Serv. Use 30(1\u20132), 51\u201356 (2010). https:\/\/doi.org\/10.3233\/ISU-2010-0613","journal-title":"Inf. Serv. Use"},{"key":"431_CR4","doi-asserted-by":"publisher","unstructured":"Fabris, E., Kuhn, T., Silvello, G.: A Framework for Citing Nanopublications. In: Proc. of the Digital Libraries for Open Knowledge - 23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019, Oslo, Norway, September 9-12, 2019. Lecture Notes in Computer Science, vol. 11799, pp. 70\u201383. Springer, Heidelberg, Germany (2019). https:\/\/doi.org\/10.1007\/978-3-030-30760-8_6","DOI":"10.1007\/978-3-030-30760-8_6"},{"key":"431_CR5","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.websem.2014.05.001","volume":"29","author":"C Chichester","year":"2014","unstructured":"Chichester, C., Gaudet, P., Karch, O., Groth, P., Lane, L., Bairoch, A., Mons, B., Loizou, A.: Querying neXtProt nanopublications and their value for insights on sequence variants and tissue expression. J. Web Semant. 29, 3\u201311 (2014). https:\/\/doi.org\/10.1016\/j.websem.2014.05.001","journal-title":"J. Web Semant."},{"key":"431_CR6","doi-asserted-by":"publisher","unstructured":"Waagmeester, A., Kutmon, M., Riutta, A., Miller, R.A., Willighagen, E.L., Evelo, C.T.A., Pico, A.R.: Using the Semantic Web for Rapid Integration of WikiPathways with Other Biological Online Data Resources. PLoS Comput. Biol. 12(6) (2016) https:\/\/doi.org\/10.1371\/journal.pcbi.1004989","DOI":"10.1371\/journal.pcbi.1004989"},{"issue":"5","key":"431_CR7","doi-asserted-by":"publisher","first-page":"519","DOI":"10.3233\/SW-150189","volume":"7","author":"N Queralt-Rosinach","year":"2016","unstructured":"Queralt-Rosinach, N., Kuhn, T., Chichester, C., Dumontier, M., Sanz, F., Furlong, L.I.: Publishing disgenet as nanopublications. Semantic Web 7(5), 519\u2013528 (2016). https:\/\/doi.org\/10.3233\/SW-150189","journal-title":"Semantic Web"},{"key":"431_CR8","doi-asserted-by":"publisher","unstructured":"Giachelle, F., Marchesin, S., Silvello, G., Alonso, O.: Searching for reliable facts over a medical knowledge base. In: Proc. of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2023), pp. 3205\u20133209. ACM, New York, NY, USA (2023). https:\/\/doi.org\/10.1145\/3539618.3591822","DOI":"10.1145\/3539618.3591822"},{"key":"431_CR9","doi-asserted-by":"publisher","unstructured":"Marchesin, S., Menotti, L., Giachelle, F., Silvello, G., Alonso, O.: Building a large gene expression-cancer knowledge base with limited human annotations. Database J. Biol. Databases Curation 2023 (2023) https:\/\/doi.org\/10.1093\/database\/baad061","DOI":"10.1093\/database\/baad061"},{"key":"431_CR10","unstructured":"Giachelle, F., Marchesin, S., Menotti, L., Silvello, G.: Extending Nanopublications with Knowledge Provenance for Multi-Source Scientific Assertions. In: Proc. of the 21st Conference on Information and Research Science Connecting to Digital and Library Science (IRCDL 2025). CEUR-WS Proceedings, vol. 3937. CEUR-WS.org, Aachen, Germany (2025). https:\/\/ceur-ws.org\/Vol-3937\/paper10.pdf"},{"key":"431_CR11","doi-asserted-by":"publisher","unstructured":"Fox, M.S., Huang, J.: An Ontology for Static Knowledge Provenance. In: Proc. of the Knowledge Sharing in the Integrated Enterprise - Interoperability Strategies for the Enterprise Architect, 2004 International Conference on Enterprise Integration and Modelling Technology (ICEIMT 2004), The 7th International Conference on Design of Information Infrastructure Systems for Manufacturing, (DIISM 2004). IFIP, vol. 183, pp. 203\u2013213. Springer, Heidelberg, Germany (2004). https:\/\/doi.org\/10.1007\/0-387-29766-9_17","DOI":"10.1007\/0-387-29766-9_17"},{"key":"431_CR12","doi-asserted-by":"crossref","unstructured":"Huang, J., Fox, M.S.: Dynamic Knowledge Provenance. In: Proc. of the Business Agents and Semantic Web Workshop, pp. 372\u2013387. National Research Council of Canada, Canada (2004). http:\/\/www.eil.utoronto.ca\/wp-content\/uploads\/km\/papers\/huang-nrc04.pdf","DOI":"10.1007\/978-3-540-25956-5_26"},{"key":"431_CR13","doi-asserted-by":"publisher","unstructured":"Huang, J., Fox, M.S.: Uncertainty in Knowledge Provenance. In: Proc. of The Semantic Web: Research and Applications, First European Semantic Web Symposium (ESWS 2004). Lecture Notes in Computer Science, vol. 3053, pp. 372\u2013387. Springer, Heidelberg, Germany (2004). https:\/\/doi.org\/10.1007\/978-3-540-25956-5_26","DOI":"10.1007\/978-3-540-25956-5_26"},{"key":"431_CR14","unstructured":"Menotti, L., Marchesin, S., Silvello, G.: The PROV-K Ontology for tracking provenance of multi-sourced assertions. Zenodo (2025). https:\/\/doi.org\/10.5281\/zenodo.15187371"},{"key":"431_CR15","doi-asserted-by":"crossref","unstructured":"Giachelle, F., Marchesin, S., Menotti, L., Silvello, G.: CORE Extended Nanopublications. Zenodo (2023). https:\/\/doi.org\/10.5281\/zenodo.10277210","DOI":"10.1093\/database\/baad061"},{"key":"431_CR16","unstructured":"Menotti, L., Marchesin, S., Giachelle, F., Silvello, G.: CoreKB Trust Network. Zenodo (2025). https:\/\/doi.org\/10.5281\/zenodo.15748152"},{"issue":"4","key":"431_CR17","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1016\/j.websem.2005.09.001","volume":"3","author":"JJ Carroll","year":"2005","unstructured":"Carroll, J.J., Bizer, C., Hayes, P.J., Stickler, P.: Named graphs. J. Web Semant. 3(4), 247\u2013267 (2005). https:\/\/doi.org\/10.1016\/j.websem.2005.09.001","journal-title":"Web Semant."},{"issue":"2","key":"431_CR18","doi-asserted-by":"publisher","first-page":"147","DOI":"10.3233\/SW-140149","volume":"6","author":"C Chichester","year":"2015","unstructured":"Chichester, C., Karch, O., Gaudet, P., Lane, L., Mons, B., Bairoch, A.: Converting neXtProt into linked data and nanopublications. Semantic Web 6(2), 147\u2013153 (2015). https:\/\/doi.org\/10.3233\/SW-140149","journal-title":"Semantic Web"},{"issue":"1","key":"431_CR19","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1186\/S13326-024-00313-2","volume":"15","author":"L Vogt","year":"2024","unstructured":"Vogt, L., Kuhn, T., Hoehndorf, R.: Correction to: semantic units: organizing knowledge graphs into semantically meaningful units of representation. J. Biomed. Semant. 15(1), 10 (2024). https:\/\/doi.org\/10.1186\/S13326-024-00313-2","journal-title":"J. Biomed. Semant."},{"key":"431_CR20","doi-asserted-by":"publisher","first-page":"1159","DOI":"10.7717\/PEERJ-CS.1159","volume":"9","author":"C-I Bucur","year":"2023","unstructured":"Bucur, C.-I., Kuhn, T., Ceolin, D., Ossenbruggen, J.: Nanopublication-based semantic publishing and reviewing: a field study with formalization papers. PeerJ Comput. Sci. 9, 1159 (2023). https:\/\/doi.org\/10.7717\/PEERJ-CS.1159","journal-title":"PeerJ Comput. Sci."},{"key":"431_CR21","doi-asserted-by":"publisher","unstructured":"Kuhn, T., Mero\u00f1o-Pe\u00f1uela, A., Malic, A., Poelen, J.H., Hurlbert, A.H., Ortiz, E.C., Furlong, L.I., Queralt-Rosinach, N., Chichester, C., Banda, J.M., Willighagen, E.L., Ehrhart, F., Evelo, C.T.A., Malas, T.B., Dumontier, M.: Nanopublications: A Growing Resource of Provenance-Centric Scientific Linked Data. In: Proc. of the 14th IEEE International Conference on e-Science (e-Science 2018), pp. 83\u201392. IEEE Computer Society, Washington, DC, USA (2018). https:\/\/doi.org\/10.1109\/eScience.2018.00024","DOI":"10.1109\/eScience.2018.00024"},{"key":"431_CR22","doi-asserted-by":"publisher","unstructured":"Mons, B., Haagen, H., Chichester, C., Hoen, P.-B.t., Dunnen, J.T., Ommen, G., Mulligen, E., Singh, B., Hooft, R., Roos, M., Hammond, J., Kiesel, B., Giardine, B., Velterop, J., Groth, P., Schultes, E,: The value of data. Nature Gen. 43, 281\u2013283 (2011). https:\/\/doi.org\/10.1038\/ng0411-281","DOI":"10.1038\/ng0411-281"},{"key":"431_CR23","doi-asserted-by":"publisher","unstructured":"Bucur, C.-I., Kuhn, T., Ceolin, D.: A Unified Nanopublication Model for Effective and User-Friendly Access to the Elements of Scientific Publishing. In: Proc. of Knowledge Engineering and Knowledge Management (EKAW 2020). Lecture Notes in Computer Science, vol. 12387, pp. 104\u2013119. Springer, Heidelberg, Germany (2020). https:\/\/doi.org\/10.1007\/978-3-030-61244-3_7","DOI":"10.1007\/978-3-030-61244-3_7"},{"key":"431_CR24","doi-asserted-by":"publisher","unstructured":"Kuhn, T., Barbano, P.E., Nagy, M.L., Krauthammer, M.: Broadening the Scope of Nanopublications. In: Proc. of The Semantic Web: Semantics and Big Data (ESWC 2013). Lecture Notes in Computer Science, vol. 7882, pp. 487\u2013501. Springer, Heidelberg, Germany (2013). https:\/\/doi.org\/10.1007\/978-3-642-38288-8_33","DOI":"10.1007\/978-3-642-38288-8_33"},{"key":"431_CR25","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1186\/2041-1480-5-28","volume":"5","author":"T Clark","year":"2014","unstructured":"Clark, T., Ciccarese, P., Goble, C.A.: Micropublications: a semantic model for claims, evidence, arguments and annotations in biomedical communications. J. Biomed. Semant. 5, 28 (2014). https:\/\/doi.org\/10.1186\/2041-1480-5-28","journal-title":"J. Biomed. Semant."},{"issue":"2","key":"431_CR26","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1177\/0165551506070706","volume":"33","author":"JE Rowley","year":"2007","unstructured":"Rowley, J.E.: The wisdom hierarchy: representations of the DIKW hierarchy. J. Inf. Sci. 33(2), 163\u2013180 (2007). https:\/\/doi.org\/10.1177\/0165551506070706","journal-title":"J. Inf. Sci."},{"key":"431_CR27","doi-asserted-by":"publisher","unstructured":"Buneman, P., Khanna, S., Tan, W.C.: Why and where: A characterization of data provenance. In: Proc. of the 8th International Conference on Database Theory (ICDT 2001). Lecture Notes in Computer Science, vol. 1973, pp. 316\u2013330. Springer, Heidelberg, Germany (2001). https:\/\/doi.org\/10.1007\/3-540-44503-X_20","DOI":"10.1007\/3-540-44503-X_20"},{"issue":"4","key":"431_CR28","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1561\/1900000006","volume":"1","author":"J Cheney","year":"2009","unstructured":"Cheney, J., Chiticariu, L., Tan, W.C.: Provenance in databases: why, how, and where. Found. Trends Databases 1(4), 379\u2013474 (2009). https:\/\/doi.org\/10.1561\/1900000006","journal-title":"Found. Trends Databases"},{"key":"431_CR29","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1016\/j.future.2010.07.005","volume":"27","author":"L Moreau","year":"2011","unstructured":"Moreau, L., Clifford, B., Freire, J., Futrelle, J., Gil, Y., Groth, P., Kwasnikowska, N., Miles, S., Missier, P., Myers, J., Plale, B., Simmhan, Y., Stephan, E.G., Bussche, J.V.: The open provenance model core specification (v1.1). Future Gener. Comput. Syst. 27, 743\u2013756 (2011). https:\/\/doi.org\/10.1016\/j.future.2010.07.005","journal-title":"Future Gener. Comput. Syst."},{"key":"431_CR30","doi-asserted-by":"publisher","unstructured":"Fox, M.S., Huang, J.: Knowledge Provenance. In: Proc. of the Advances in Artificial Intelligence, 17th Conference of the Canadian Society for Computational Studies of Intelligence, (Canadian AI 2004). Lecture Notes in Computer Science, vol. 3060, pp. 517\u2013523. Springer, Heidelberg, Germany (2004). https:\/\/doi.org\/10.1007\/978-3-540-24840-8_47","DOI":"10.1007\/978-3-540-24840-8_47"},{"key":"431_CR31","doi-asserted-by":"publisher","unstructured":"Huang, J., Fox, M.S.: Trust Judgment in Knowledge Provenance. In: Proc. of the 16th International Workshop on Database and Expert Systems Applications (DEXA 2005), pp. 524\u2013528. IEEE Computer Society, Washington, DC, USA (2005). https:\/\/doi.org\/10.1109\/DEXA.2005.193","DOI":"10.1109\/DEXA.2005.193"},{"key":"431_CR32","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1186\/2041-1480-4-37","volume":"4","author":"P Ciccarese","year":"2013","unstructured":"Ciccarese, P., Soiland-Reyes, S., Belhajjame, K., Gray, A.J.G., Goble, C.A., Clark, T.: PAV ontology: provenance, authoring and versioning. J. Biomed. Semant. 4, 37 (2013). https:\/\/doi.org\/10.1186\/2041-1480-4-37","journal-title":"J. Biomed. Semant."},{"key":"431_CR33","doi-asserted-by":"publisher","unstructured":"Hartig, O., Zhao, J.: Publishing and consuming provenance metadata on the web of linked data. In: Proc. of the Provenance and Annotation of Data and Processes - Third International Provenance and Annotation Workshop (IPAW 2010). Lecture Notes in Computer Science, vol. 6378, pp. 78\u201390. Springer, Aachen, Germany (2010). https:\/\/doi.org\/10.1007\/978-3-642-17819-1_10","DOI":"10.1007\/978-3-642-17819-1_10"},{"key":"431_CR34","doi-asserted-by":"crossref","unstructured":"Marchesin, S., Menotti, L., Silvello, G., Alonso, O.: CORE: Gene Expression-Cancer Knowledge Base. Zenodo (2023). https:\/\/doi.org\/10.5281\/zenodo.7577127","DOI":"10.1093\/database\/baad061"},{"key":"431_CR35","unstructured":"DeepSeek-AI, Liu, A., et al.: DeepSeek-V3 Technical Report (2025). https:\/\/arxiv.org\/abs\/2412.19437"},{"key":"431_CR36","unstructured":"Grattafiori, A. et al.: The Llama 3 Herd of Models (2024). https:\/\/arxiv.org\/abs\/2407.21783"},{"key":"431_CR37","unstructured":"OpenAI: GPT-4o Mini: Advancing Cost-Efficient Intelligence. https:\/\/openai.com\/index\/gpt-4o-mini-advancing-cost-efficient-intelligence\/. Accessed: 2025-06-26 (2024)"},{"key":"431_CR38","unstructured":"OpenAI, Achiam, J., et al.: GPT-4 Technical Report (2024). https:\/\/arxiv.org\/abs\/2303.08774"},{"key":"431_CR39","doi-asserted-by":"publisher","unstructured":"Ojha, P., Talukdar, P.: KGEval: Accuracy Estimation of Automatically Constructed Knowledge Graphs. In: Proc. of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP 2017), pp. 1741\u20131750. Association for Computational Linguistics, Copenhagen, Denmark (2017). https:\/\/doi.org\/10.18653\/v1\/d17-1183","DOI":"10.18653\/v1\/d17-1183"},{"key":"431_CR40","doi-asserted-by":"publisher","unstructured":"Gao, J., Li, X., Xu, Y.E., Sisman, B., Dong, X.L., Yang, J.: Efficient Knowledge Graph Accuracy Evaluation. Proc. VLDB Endow. 12(11), 1679\u20131691 (2019) https:\/\/doi.org\/10.14778\/3342263.3342642","DOI":"10.14778\/3342263.3342642"},{"key":"431_CR41","doi-asserted-by":"publisher","unstructured":"Qi, Y., Zheng, W., Hong, L., Zou, L.: Evaluating Knowledge Graph Accuracy Powered by Optimized Human-Machine Collaboration. In: Proc. of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2022), pp. 1368\u20131378. ACM, New York, NY, USA (2022). https:\/\/doi.org\/10.1145\/3534678.3539233","DOI":"10.1145\/3534678.3539233"},{"issue":"5","key":"431_CR42","doi-asserted-by":"publisher","first-page":"4969","DOI":"10.1109\/TKDE.2022.3150080","volume":"35","author":"B Xue","year":"2023","unstructured":"Xue, B., Zou, L.: Knowledge graph quality ,management: a comprehensive survey. IEEE Trans. Knowl. Data Eng. 35(5), 4969\u20134988 (2023). https:\/\/doi.org\/10.1109\/TKDE.2022.3150080","journal-title":"IEEE Trans. Knowl. Data Eng."},{"issue":"9","key":"431_CR43","doi-asserted-by":"publisher","first-page":"2392","DOI":"10.14778\/3665844.3665865","volume":"17","author":"S Marchesin","year":"2024","unstructured":"Marchesin, S., Silvello, G.: Efficient and reliable estimation of knowledge graph accuracy. Proc. VLDB Endow. 17(9), 2392\u20132404 (2024). https:\/\/doi.org\/10.14778\/3665844.3665865","journal-title":"Proc. VLDB Endow."},{"key":"431_CR44","doi-asserted-by":"publisher","unstructured":"Marchesin, S., Silvello, G.: Credible Intervals for Knowledge Graph Accuracy Estimation. Proc. ACM Manag. Data (SIGMOD) 3(3) (2025) https:\/\/doi.org\/10.1145\/3725279","DOI":"10.1145\/3725279"},{"key":"431_CR45","unstructured":"Cochran, W.G.: Sampling Techniques, 3rd edn. John Wiley & Sons, New York, NY, USA (1977)"},{"key":"431_CR46","volume-title":"Bayesian Inference in Statistical Analysis","author":"GEP Box","year":"2011","unstructured":"Box, G.E.P., Tiao, G.C.: Bayesian Inference in Statistical Analysis. John Wiley & Sons, New York, NY, USA (2011)"},{"key":"431_CR47","doi-asserted-by":"publisher","first-page":"103","DOI":"10.3758\/s13423-015-0947-8","volume":"23","author":"RD Morey","year":"2016","unstructured":"Morey, R.D., Hoekstra, R., Rouder, J.N., Lee, M.D., Wagenmakers, E.J.: The fallacy of placing confidence in confidence intervals. Psychon. Bull. Rev. 23, 103\u2013123 (2016). https:\/\/doi.org\/10.3758\/s13423-015-0947-8","journal-title":"Psychon. Bull. Rev."},{"issue":"1","key":"431_CR48","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1609\/hcomp.v12i1.31605","volume":"12","author":"S Marchesin","year":"2024","unstructured":"Marchesin, S., Silvello, G., Alonso, O.: Utility-oriented knowledge graph accuracy estimation with limited annotations: a case study on dbpedia. Proc. AAAI Conf. Human Comput. Crowdsourcing 12(1), 105\u2013114 (2024). https:\/\/doi.org\/10.1609\/hcomp.v12i1.31605","journal-title":"Proc. AAAI Conf. Human Comput. Crowdsourcing"},{"key":"431_CR49","unstructured":"Mruthyunjaya, V., Pezeshkpour, P., Hruschka, E., Bhutani, N.: Rethinking Language Models as Symbolic Knowledge Graphs (2023). https:\/\/arxiv.org\/abs\/2308.13676"},{"key":"431_CR50","doi-asserted-by":"publisher","unstructured":"Sun, K., Xu, Y., Zha, H., Liu, Y., Dong, X.L.: Head-to-tail: How knowledgeable are large language models (LLMs)? A.K.A. will LLMs replace knowledge graphs? In: Duh, K., Gomez, H., Bethard, S. (eds.) Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pp. 311\u2013325. Association for Computational Linguistics, Mexico City, Mexico (2024). https:\/\/doi.org\/10.18653\/v1\/2024.naacl-long.18 . https:\/\/aclanthology.org\/2024.naacl-long.18\/","DOI":"10.18653\/v1\/2024.naacl-long.18"},{"key":"431_CR51","unstructured":"Turpin, M., Michael, J., Perez, E., Bowman, S.R.: Language models don\u2019t always say what they think: Unfaithful explanations in chain-of-thought prompting. In: Thirty-seventh Conference on Neural Information Processing Systems (2023). https:\/\/openreview.net\/forum?id=bzs4uPLXvi"},{"key":"431_CR52","doi-asserted-by":"crossref","unstructured":"Dong, Q., Li, L., Dai, D., Zheng, C., Ma, J., Li, R., Xia, H., Xu, J., Wu, Z., Chang, B., Sun, X., Li, L., Sui, Z.: A survey on in-context learning. In: Al-Onaizan, Y., Bansal, M., Chen, Y.-N. (eds.) Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pp. 1107\u20131128. Association for Computational Linguistics, Miami, Florida, USA (2024). https:\/\/doi.org\/10.18653\/v1\/2024.emnlp-main.64","DOI":"10.18653\/v1\/2024.emnlp-main.64"},{"key":"431_CR53","doi-asserted-by":"crossref","unstructured":"Wang, P., Li, L., Chen, L., Cai, Z., Zhu, D., Lin, B., Cao, Y., Kong, L., Liu, Q., Liu, T., Sui, Z.: Large language models are not fair evaluators. In: Ku, L. W., Martins, A., Srikumar, V. (eds.) Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 9440\u20139450. Association for Computational Linguistics, Bangkok, Thailand (2024). https:\/\/doi.org\/10.18653\/v1\/2024.acl-long.511","DOI":"10.18653\/v1\/2024.acl-long.511"},{"key":"431_CR54","doi-asserted-by":"publisher","unstructured":"Shami, F., Marchesin, S., Silvello, G.: Fact verification in knowledge graphs using llms. In: Proc. of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2025) (2025). https:\/\/doi.org\/10.1145\/3726302.3730142","DOI":"10.1145\/3726302.3730142"}],"container-title":["International Journal on Digital Libraries"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00799-025-00431-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00799-025-00431-x","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00799-025-00431-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T07:43:33Z","timestamp":1768895013000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00799-025-00431-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,24]]},"references-count":54,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["431"],"URL":"https:\/\/doi.org\/10.1007\/s00799-025-00431-x","relation":{},"ISSN":["1432-5012","1432-1300"],"issn-type":[{"value":"1432-5012","type":"print"},{"value":"1432-1300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,24]]},"assertion":[{"value":"15 April 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 September 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 October 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 October 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Materials Availability"}}],"article-number":"24"}}