{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T19:48:53Z","timestamp":1774986533435,"version":"3.50.1"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"3","funder":[{"name":"EU Horizon Europe","award":["101137074"],"award-info":[{"award-number":["101137074"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2025,6,17]]},"abstract":"<jats:p>\n                    Knowledge Graphs (KGs) are widely used in data-driven applications and downstream tasks, such as virtual assistants, recommendation systems, and semantic search. The accuracy of KGs directly impacts the reliability of the inferred knowledge and outcomes. Therefore, assessing the accuracy of a KG is essential for ensuring the quality of facts used in these tasks. However, the large size of real-world KGs makes manual triple-by-triple annotation impractical, thereby requiring sampling strategies to provide accuracy estimates with statistical guarantees. The current state-of-the-art approaches rely on Confidence Intervals (CIs), derived from frequentist statistics. While efficient, CIs have notable limitations and can lead to interpretation fallacies. In this paper, we propose to overcome the limitations of CIs by using\n                    <jats:italic toggle=\"yes\">Credible Intervals<\/jats:italic>\n                    (CrIs), which are grounded in Bayesian statistics. These intervals are more suitable for reliable post-data inference, particularly in KG accuracy evaluation. We prove that CrIs offer greater reliability and stronger guarantees than frequentist approaches in this context. Additionally, we introduce aHPD, an adaptive algorithm that is more efficient for real-world KGs and statistically robust, addressing the interpretive challenges of CIs.\n                  <\/jats:p>","DOI":"10.1145\/3725279","type":"journal-article","created":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:23:29Z","timestamp":1750281809000},"page":"1-26","source":"Crossref","is-referenced-by-count":3,"title":["Credible Intervals for Knowledge Graph Accuracy Estimation"],"prefix":"10.1145","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0362-5893","authenticated-orcid":false,"given":"Stefano","family":"Marchesin","sequence":"first","affiliation":[{"name":"University of Padua, Padua, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4970-4554","authenticated-orcid":false,"given":"Gianmaria","family":"Silvello","sequence":"additional","affiliation":[{"name":"University of Padua, Padua, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,18]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--540--76298-0_52"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstl.1763.0053"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--1--4757--4286--2"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/1619797.1619981"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376746"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","unstructured":"A. Bonifati G. H. L. Fletcher H. Voigt and N. Yakovets. 2018. Querying Graphs. Morgan & Claypool Publishers. doi:10.2200\/S00873ED1V01Y201808DTM051","DOI":"10.2200\/S00873ED1V01Y201808DTM051"},{"key":"e_1_2_2_7_1","unstructured":"G. E. P. Box and G. C. Tiao. 2011. Bayesian Inference in Statistical Analysis. John Wiley & Sons."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1009213286"},{"key":"e_1_2_2_9_1","unstructured":"G. Casella and R. L. Berger. 2002. Statistical Inference. Thomson Learning. 20010257 https:\/\/books.google.it\/books?id=0x_vAAAAMAAJ"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0013091500025724"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465297"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0044139"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3177873"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.14778\/3342263.3342642"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1214\/08-BA318REJ"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2015.08.001"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080810"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-013-0572--3"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2012.06.001"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555041.3589672"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526049"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1098\/rspa.1946.0056"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.2016.1208630"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1214\/11-EJS648"},{"key":"e_1_2_2_25_1","unstructured":"L. Kish. 1965. Survey Sampling. Wiley. 65019479 https:\/\/books.google.it\/books?id=xiZmAAAAIAAJ"},{"key":"e_1_2_2_26_1","first-page":"55","article-title":"Methods for Design Effects","volume":"11","author":"Kish L.","year":"1995","unstructured":"L. Kish. 1995. Methods for Design Effects. J. Off. Stat., Vol. 11, 1 (1995), 55. https:\/\/www.scb.se\/contentassets\/ca21efb41fee47d293bbee5bf7be7fb3\/methods-for-design-effects.pdf","journal-title":"J. Off. Stat."},{"key":"e_1_2_2_27_1","unstructured":"D. Kraft. 1988. A Software Package for Sequential Quadratic Programming. Technical Report. DLR German Aerospace Center - Institute for Flight Mechanics Koln Germany. 1 -- 33 pages."},{"key":"e_1_2_2_28_1","volume-title":"Proc. of the 2011 Conference on Empirical Methods in Natural Language Processing, EMNLP 2011, 27--31 July 2011, John McIntyre Conference Centre","author":"Lao N.","unstructured":"N. Lao, T. M. Mitchell, and W. W. Cohen. 2011. Random Walk Inference and Learning in A Large Scale Knowledge Base. In Proc. of the 2011 Conference on Empirical Methods in Natural Language Processing, EMNLP 2011, 27--31 July 2011, John McIntyre Conference Centre, Edinburgh, UK. ACL, 529--539. https:\/\/aclanthology.org\/D11--1049\/"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","unstructured":"E. Lesaffre and A. B. Lawson. 2012. Bayesian Biostatistics. John Wiley & Sons. doi:10.1002\/9781119942412","DOI":"10.1002\/9781119942412"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.21105\/joss.01541"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.14778\/3665844.3665865"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v12i1.31605"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3627673.3679561"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1201\/9780429029608"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191513"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3589777"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-015-0947--8"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488471"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/32.2.128"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.1937.0005"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d17--1183"},{"key":"e_1_2_2_42_1","volume-title":"Proc. of the ISWC 2018 Posters & Demonstrations, Industry and Blue Sky Ideas Tracks co-located with 17th International Semantic Web Conference (ISWC 2018","volume":"10","author":"Paulheim H.","year":"2018","unstructured":"H. Paulheim. 2018. How much is a Triple? Estimating the Cost of Knowledge Graph Creation. In Proc. of the ISWC 2018 Posters & Demonstrations, Industry and Blue Sky Ideas Tracks co-located with 17th International Semantic Web Conference (ISWC 2018), Monterey, USA, October 8--12, 2018 (CEUR, Vol. 2180). CEUR-WS.org. https:\/\/ceur-ws.org\/Vol-2180\/ISWC_2018_Outrageous_Ideas_paper_10.pdf"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.4230\/TGDK.1.1.11"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1002\/9780470317105"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d17--1184"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3534678.3539233"},{"key":"e_1_2_2_47_1","unstructured":"H. Raiffa and R. Schlaifer. 1961. Applied Statistical Decision Theory. Division of Research Graduate School of Business Adminitration Harvard University. 60011282 https:\/\/books.google.it\/books?id=wPBLAAAAMAAJ"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000063"},{"key":"e_1_2_2_49_1","volume-title":"Proc. of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI 2015","author":"Samadi M.","year":"2015","unstructured":"M. Samadi, P. P. Talukdar, M. M. Veloso, and T. M. Mitchell. 2015. AskWorld: Budget-Sensitive Query Evaluation for Knowledge-on-Demand. In Proc. of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI 2015, Buenos Aires, Argentina, July 25--31, 2015. AAAI Press, 837--843. http:\/\/ijcai.org\/Abstract\/15\/123"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629489"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1080\/09296174.2013.799918"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1214\/08-BA318D"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1927.10502953"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2022.3150080"}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3725279","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T18:54:04Z","timestamp":1774983244000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3725279"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,17]]},"references-count":54,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,6,17]]}},"alternative-id":["10.1145\/3725279"],"URL":"https:\/\/doi.org\/10.1145\/3725279","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,17]]}}}