{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T22:27:23Z","timestamp":1767652043756,"version":"3.41.0"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T00:00:00Z","timestamp":1672185600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Facebook Research award, the Australian Research Council","award":["DP190102141"],"award-info":[{"award-number":["DP190102141"]}]},{"name":"ARC Training Centre for Information Resilience","award":["IC200100022"],"award-info":[{"award-number":["IC200100022"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2023,3,31]]},"abstract":"<jats:p>Automated fact-checking (AFC) systems exist to combat disinformation, however, their complexity usually makes them opaque to the end-user, making it difficult to foster trust in the system. In this article, we introduce the E-BART model with the hope of making progress on this front. E-BART is able to provide a veracity prediction for a claim and jointly generate a human-readable explanation for this decision. We show that E-BART is competitive with the state-of-the-art on the e-FEVER and e-SNLI tasks. In addition, we validate the joint-prediction architecture by showing (1) that generating explanations does not significantly impede the model from performing well in its main task of veracity prediction, and (2) that predicted veracity and explanations are more internally coherent when generated jointly than separately. We also calibrate the E-BART model, allowing the output of the final model to be correctly interpreted as the confidence of correctness. Finally, we also conduct an extensive human evaluation on the impact of generated explanations and observe that: Explanations increase human ability to spot misinformation and make people more skeptical about claims, and explanations generated by E-BART are competitive with ground truth explanations.<\/jats:p>","DOI":"10.1145\/3546917","type":"journal-article","created":{"date-parts":[[2022,7,9]],"date-time":"2022-07-09T13:17:18Z","timestamp":1657372638000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["A Neural Model to Jointly Predict and Explain Truthfulness of Statements"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0013-6982","authenticated-orcid":false,"given":"Erik","family":"Brand","sequence":"first","affiliation":[{"name":"The University of Queensland, Brisbane, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9191-3280","authenticated-orcid":false,"given":"Kevin","family":"Roitero","sequence":"additional","affiliation":[{"name":"University of Udine, Udine, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7337-7592","authenticated-orcid":false,"given":"Michael","family":"Soprano","sequence":"additional","affiliation":[{"name":"University of Udine, Udine, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7889-5025","authenticated-orcid":false,"given":"Afshin","family":"Rahimi","sequence":"additional","affiliation":[{"name":"The University of Queensland, Brisbane, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7311-3693","authenticated-orcid":false,"given":"Gianluca","family":"Demartini","sequence":"additional","affiliation":[{"name":"The University of Queensland, Brisbane, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,12,28]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_3_2_2_2","DOI":"10.36370\/tto.2019.15"},{"doi-asserted-by":"publisher","key":"e_1_3_2_3_2","DOI":"10.18653\/v1\/2020.acl-main.656"},{"doi-asserted-by":"publisher","key":"e_1_3_2_4_2","DOI":"10.1186\/s12874-018-0606-7"},{"doi-asserted-by":"publisher","key":"e_1_3_2_5_2","DOI":"10.18653\/v1\/D15-1075"},{"key":"e_1_3_2_6_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Brown Tom B.","year":"2020","unstructured":"Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et\u00a0al. 2020. Language models are few-shot learners. In Proceedings of the Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_7_2","first-page":"9560","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Camburu Oana-Maria","year":"2018","unstructured":"Oana-Maria Camburu, Tim Rockt\u00e4schel, Thomas Lukasiewicz, and Phil Blunsom. 2018. E-SNLI: Natural language inference with natural language explanations. In Proceedings of the Annual Conference on Neural Information Processing Systems. 9560\u20139572."},{"doi-asserted-by":"publisher","key":"e_1_3_2_8_2","DOI":"10.1007\/978-3-030-62419-4_9"},{"key":"e_1_3_2_9_2","first-page":"4171","volume-title":"Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics. 4171\u20134186."},{"unstructured":"Lucas Graves. 2018. Understanding the promise and limits of automated fact-checking. Factsheet published by the Reuters Institute for the Study of Journalism (2018).","key":"e_1_3_2_10_2"},{"key":"e_1_3_2_11_2","first-page":"1321","volume-title":"Proceedings of the 34th International Conference on Machine Learning (ICML\u201917)","author":"Guo Chuan","year":"2017","unstructured":"Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q. Weinberger. 2017. On calibration of modern neural networks. In Proceedings of the 34th International Conference on Machine Learning (ICML\u201917). JMLR.org, 1321\u20131330."},{"doi-asserted-by":"publisher","key":"e_1_3_2_12_2","DOI":"10.18653\/v1\/W18-5516"},{"doi-asserted-by":"publisher","key":"e_1_3_2_13_2","DOI":"10.1609\/aaai.v33i01.33016586"},{"doi-asserted-by":"publisher","key":"e_1_3_2_14_2","DOI":"10.18653\/v1\/2020.emnlp-main.623"},{"unstructured":"Klaus Krippendorff. 2011. Computing Krippendorff\u2019s alpha-reliability. Working Paper. Retrieved from https:\/\/repository.upenn.edu\/asc_papers\/43.","key":"e_1_3_2_15_2"},{"doi-asserted-by":"publisher","key":"e_1_3_2_16_2","DOI":"10.1613\/jair.1.12012"},{"doi-asserted-by":"publisher","key":"e_1_3_2_17_2","DOI":"10.18653\/v1\/2020.acl-main.703"},{"doi-asserted-by":"publisher","key":"e_1_3_2_18_2","DOI":"10.18653\/v1\/P19-1441"},{"key":"e_1_3_2_19_2","article-title":"RoBERTa: A robustly optimized BERT pretraining approach","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. arXiv preprint arXiv:1907.11692 (2019).","journal-title":"arXiv preprint arXiv:1907.11692"},{"key":"e_1_3_2_20_2","first-page":"2901","volume-title":"Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI\u201915)","author":"Naeini Mahdi Pakdaman","year":"2015","unstructured":"Mahdi Pakdaman Naeini, Gregory F. Cooper, and Milos Hauskrecht. 2015. Obtaining well calibrated probabilities using Bayesian binning. In Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI\u201915). AAAI Press, 2901\u20132907."},{"doi-asserted-by":"publisher","key":"e_1_3_2_21_2","DOI":"10.1609\/aaai.v33i01.33016859"},{"doi-asserted-by":"publisher","key":"e_1_3_2_22_2","DOI":"10.1038\/s41586-021-03344-2"},{"key":"e_1_3_2_23_2","volume-title":"Proceedings of the 9th International Conference on Learning Representations","author":"Pilault Jonathan","year":"2021","unstructured":"Jonathan Pilault, Amine Elhattami, and Christopher J. Pal. 2021. Conditionally adaptive multi-task learning: Improving transfer learning in NLP using fewer parameters & less data. In Proceedings of the 9th International Conference on Learning Representations."},{"issue":"3","key":"e_1_3_2_24_2","first-page":"61","article-title":"Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods","volume":"10","author":"Platt John","year":"1999","unstructured":"John Platt et\u00a0al. 1999. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv. Large Margin Classif. 10, 3 (1999), 61\u201374.","journal-title":"Adv. Large Margin Classif."},{"doi-asserted-by":"publisher","key":"e_1_3_2_25_2","DOI":"10.18653\/v1\/2020.fever-1.7"},{"doi-asserted-by":"publisher","key":"e_1_3_2_26_2","DOI":"10.1613\/jair.1.12012"},{"doi-asserted-by":"publisher","key":"e_1_3_2_27_2","DOI":"10.18653\/v1\/D19-1410"},{"key":"e_1_3_2_28_2","first-page":"439","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference","author":"Roitero Kevin","year":"2020","unstructured":"Kevin Roitero, Michael Soprano, Shaoyang Fan, Damiano Spina, Stefano Mizzaro, and Gianluca Demartini. 2020. Can the crowd identify misinformation objectively? The effects of judgment scale and assessor\u2019s background. In Proceedings of the 43rd International ACM SIGIR Conference. Association for Computing Machinery, New York, NY, 439\u2013448."},{"key":"e_1_3_2_29_2","article-title":"DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter","author":"Sanh Victor","year":"2019","unstructured":"Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108 (2019).","journal-title":"arXiv preprint arXiv:1910.01108"},{"key":"e_1_3_2_30_2","article-title":"Pre-trained summarization distillation","author":"Shleifer Sam","year":"2020","unstructured":"Sam Shleifer and Alexander M. Rush. 2020. Pre-trained summarization distillation. arXiv preprint arXiv:2010.13002 (2020).","journal-title":"arXiv preprint arXiv:2010.13002"},{"doi-asserted-by":"publisher","key":"e_1_3_2_31_2","DOI":"10.1145\/3292500.3330935"},{"doi-asserted-by":"publisher","key":"e_1_3_2_32_2","DOI":"10.1007\/978-3-030-45442-5_45"},{"key":"e_1_3_2_33_2","volume-title":"Proceedings of theTruth and Trust Online Conference (TTO\u201920)","author":"Stammbach Dominik","year":"2020","unstructured":"Dominik Stammbach and Elliott Ash. 2020. e-FEVER: Explanations and summaries for automated fact checking. In Proceedings of theTruth and Trust Online Conference (TTO\u201920). Hacks Hackers."},{"doi-asserted-by":"publisher","key":"e_1_3_2_34_2","DOI":"10.18653\/v1\/D19-6616"},{"doi-asserted-by":"publisher","key":"e_1_3_2_35_2","DOI":"10.18653\/v1\/W18-5501"},{"doi-asserted-by":"publisher","key":"e_1_3_2_36_2","DOI":"10.1145\/3351095.3372834"},{"key":"e_1_3_2_37_2","first-page":"5998","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the Annual Conference on Neural Information Processing Systems. 5998\u20136008."},{"doi-asserted-by":"publisher","key":"e_1_3_2_38_2","DOI":"10.3115\/v1\/W14-2508"},{"doi-asserted-by":"publisher","key":"e_1_3_2_39_2","DOI":"10.18653\/v1\/2020.acl-main.97"},{"doi-asserted-by":"publisher","key":"e_1_3_2_40_2","DOI":"10.18653\/v1\/W18-5515"},{"key":"e_1_3_2_41_2","first-page":"609","volume-title":"Proceedings of the 18th International Conference on Machine Learning (ICML\u201901)","author":"Zadrozny Bianca","year":"2001","unstructured":"Bianca Zadrozny and Charles Elkan. 2001. Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers. In Proceedings of the 18th International Conference on Machine Learning (ICML\u201901). 609\u2013616."},{"doi-asserted-by":"publisher","key":"e_1_3_2_42_2","DOI":"10.1186\/s12874-016-0200-9"},{"key":"e_1_3_2_43_2","article-title":"Explicit contextual semantics for text comprehension","author":"Zhang Zhuosheng","year":"2018","unstructured":"Zhuosheng Zhang, Yuwei Wu, Zuchao Li, and Hai Zhao. 2018. Explicit contextual semantics for text comprehension. arXiv preprint arXiv:1809.02794 (2018).","journal-title":"arXiv preprint arXiv:1809.02794"},{"doi-asserted-by":"publisher","key":"e_1_3_2_44_2","DOI":"10.1609\/aaai.v34i05.6510"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3546917","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3546917","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:41Z","timestamp":1750186841000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3546917"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,28]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3,31]]}},"alternative-id":["10.1145\/3546917"],"URL":"https:\/\/doi.org\/10.1145\/3546917","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"type":"print","value":"1936-1955"},{"type":"electronic","value":"1936-1963"}],"subject":[],"published":{"date-parts":[[2022,12,28]]},"assertion":[{"value":"2021-11-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-19","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}