{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:05:20Z","timestamp":1777449920197,"version":"3.51.4"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"8","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2019,4]]},"abstract":"<jats:p>The Web constitutes a valuable source of information. In recent years, it fostered the construction of large-scale knowledge bases, such as Freebase, YAGO, and DBpedia. The open nature of the Web, with content potentially being generated by everyone, however, leads to inaccuracies and misinformation. Construction and maintenance of a knowledge base thus has to rely on fact checking, an assessment of the credibility of facts. Due to an inherent lack of ground truth information, such fact checking cannot be done in a purely automated manner, but requires human involvement.<\/jats:p><jats:p>In this paper, we propose a comprehensive framework to guide users in the validation of facts, striving for a minimisation of the invested effort. Our framework is grounded in a novel probabilistic model that combines user input with automated credibility inference. Based thereon, we show how to guide users in fact checking by identifying the facts for which validation is most beneficial. Moreover, our framework includes techniques to reduce the manual effort invested in fact checking by determining when to stop the validation and by supporting efficient batching strategies. We further show how to handle fact checking in a streaming setting. Our experiments with three real-world datasets demonstrate the efficiency and effectiveness of our framework: A knowledge base of high quality, with a precision of above 90%, is constructed with only a half of the validation effort required by baseline techniques.<\/jats:p>","DOI":"10.14778\/3324301.3324303","type":"journal-article","created":{"date-parts":[[2019,6,24]],"date-time":"2019-06-24T13:43:16Z","timestamp":1561383796000},"page":"850-863","source":"Crossref","is-referenced-by-count":16,"title":["User guidance for efficient fact checking"],"prefix":"10.14778","volume":"12","author":[{"given":"Thanh Tam","family":"Nguyen","sequence":"first","affiliation":[{"name":"\u00c9cole Polytechnique F\u00e9d\u00e9rale de Lausanne"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias","family":"Weidlich","sequence":"additional","affiliation":[{"name":"Humboldt-Universit\u00e4t zu Berlin"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongzhi","family":"Yin","sequence":"additional","affiliation":[{"name":"University of Queensland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bolong","family":"Zheng","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Quoc Viet Hung","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Griffith University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bela","family":"Stantic","sequence":"additional","affiliation":[{"name":"Griffith University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,4]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Dbpedia. http:\/\/www.dbpedia.org. Dbpedia. http:\/\/www.dbpedia.org."},{"key":"e_1_2_1_2_1","unstructured":"Earthsky example claim. http:\/\/earthsky.org\/human-world\/does-eating-turkey-make-you-sleepy. Earthsky example claim. http:\/\/earthsky.org\/human-world\/does-eating-turkey-make-you-sleepy."},{"key":"e_1_2_1_3_1","unstructured":"Freebase. http:\/\/www.freebase.com. Freebase. http:\/\/www.freebase.com."},{"key":"e_1_2_1_4_1","unstructured":"Kidshealth example claim. http:\/\/kidshealth.org\/en\/kids\/turkey-sleepy.html. Kidshealth example claim. http:\/\/kidshealth.org\/en\/kids\/turkey-sleepy.html."},{"key":"e_1_2_1_5_1","unstructured":"Snopes example claim assessment. http:\/\/www.snopes.com\/food\/ingredient\/turkey.asp. Snopes example claim assessment. http:\/\/www.snopes.com\/food\/ingredient\/turkey.asp."},{"key":"e_1_2_1_6_1","unstructured":"Webmd example claim. http:\/\/www.webmd.com\/food-recipes\/the-truth-about-tryptophan. Webmd example claim. http:\/\/www.webmd.com\/food-recipes\/the-truth-about-tryptophan."},{"key":"e_1_2_1_7_1","unstructured":"Yago. http:\/\/www.mpi-inf.mpg.de\/yago. Yago. http:\/\/www.mpi-inf.mpg.de\/yago."},{"key":"e_1_2_1_8_1","unstructured":"http:\/\/resources.mpi-inf.mpg.de\/impact\/peopleondrugs\/data.tar.gz 2017. http:\/\/resources.mpi-inf.mpg.de\/impact\/peopleondrugs\/data.tar.gz 2017."},{"key":"e_1_2_1_9_1","unstructured":"http:\/\/resources.mpi-inf.mpg.de\/impact\/web_credibility_analysis\/Snopes.tar.gz 2017. http:\/\/resources.mpi-inf.mpg.de\/impact\/web_credibility_analysis\/Snopes.tar.gz 2017."},{"key":"e_1_2_1_10_1","unstructured":"http:\/\/resources.mpi-inf.mpg.de\/impact\/web_credibility_analysis\/Wikipedia.tar.gz 2017. http:\/\/resources.mpi-inf.mpg.de\/impact\/web_credibility_analysis\/Wikipedia.tar.gz 2017."},{"key":"e_1_2_1_11_1","unstructured":"https:\/\/www.figure-eight.com 2018. https:\/\/www.figure-eight.com 2018."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1002\/9780470594001"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465318"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807252"},{"key":"e_1_2_1_15_1","first-page":"2670","volume-title":"IJCAI","author":"Banko M.","year":"2007"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-015-0385-2"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.14778\/1453856.1453916"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2009.00698.x"},{"issue":"3","key":"e_1_2_1_19_1","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1080\/00031305.1992.10475878","article-title":"Explaining the gibbs sampler","volume":"46","author":"Casella G.","year":"1992","journal-title":"The American Statistician"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623623"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.14778\/2535568.2448938"},{"key":"e_1_2_1_22_1","volume-title":"Log-linear models and conditional random fields. Tutorial notes at CIKM, 8:1--12","author":"Elkan C.","year":"2008"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/988672.988687"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687629"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1083"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-017-0484-3"},{"key":"e_1_2_1_27_1","first-page":"1","volume-title":"WISE","author":"Hung N. Q. V.","year":"2013"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2723731"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376701"},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/6444.001.0001","volume-title":"State-space models with regime switching: classical and gibbs-sampling approaches with applications","author":"Kim C.-J.","year":"1999"},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","DOI":"10.4135\/9781412984843","volume-title":"Log-linear models","author":"Knoke D.","year":"1980"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/18.910572"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/1599081.1599140"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35176-1_20"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137628.3137646"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767859"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052717"},{"key":"e_1_2_1_38_1","first-page":"627","volume-title":"JMLR","author":"Lin C.-J.","year":"2008"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.14778\/2735471.2735474"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806537"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623714"},{"key":"e_1_2_1_42_1","first-page":"279","volume-title":"North-Holland Mathematics Studies","author":"Nemhauser G. L.","year":"1981"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816653"},{"key":"e_1_2_1_44_1","first-page":"2850","volume-title":"IJCAI","author":"Nguyen T. T.","year":"2017"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36973-5_47"},{"key":"e_1_2_1_46_1","first-page":"1009","volume-title":"WWW","author":"Pasternack J.","year":"2013"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3041021.3055133"},{"key":"e_1_2_1_48_1","volume-title":"Cambridge university press","author":"Reason J.","year":"1990"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/ITA.2013.6502970"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/1701495.1701559"},{"key":"e_1_2_1_51_1","volume-title":"Pearson Education","author":"Russell S. J.","year":"2003"},{"key":"e_1_2_1_52_1","first-page":"222","volume-title":"AAAI","author":"Samadi M.","year":"2016"},{"key":"e_1_2_1_53_1","first-page":"1624","volume-title":"NIPS","author":"Schmidt M.","year":"2009"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.aap9559"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185677.2185737"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732286.2732295"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.14778\/1952376.1952378"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.14778\/3229863.3236228"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.14778\/2168651.2168656"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3324301.3324303","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,20]],"date-time":"2024-07-20T04:37:24Z","timestamp":1721450244000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3324301.3324303"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4]]},"references-count":59,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2019,4]]}},"alternative-id":["10.14778\/3324301.3324303"],"URL":"https:\/\/doi.org\/10.14778\/3324301.3324303","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2019,4]]}}}