{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T22:32:53Z","timestamp":1781044373677,"version":"3.54.1"},"reference-count":43,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002347","name":"TU Kaiserslautern CS Ph.D. scholarship program, the BMBF project XAINES","doi-asserted-by":"publisher","award":["01IW20005"],"award-info":[{"award-number":["01IW20005"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002347","name":"TU Kaiserslautern CS Ph.D. scholarship program, the BMBF project XAINES","doi-asserted-by":"publisher","award":["CA18231"],"award-info":[{"award-number":["CA18231"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002347","name":"TU Kaiserslautern CS Ph.D. scholarship program, the BMBF project XAINES","doi-asserted-by":"publisher","award":["801199"],"award-info":[{"award-number":["801199"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000921","name":"STSM grant from the COST project Multi3Generation","doi-asserted-by":"publisher","award":["01IW20005"],"award-info":[{"award-number":["01IW20005"]}],"id":[{"id":"10.13039\/501100000921","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000921","name":"STSM grant from the COST project Multi3Generation","doi-asserted-by":"publisher","award":["CA18231"],"award-info":[{"award-number":["CA18231"]}],"id":[{"id":"10.13039\/501100000921","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000921","name":"STSM grant from the COST project Multi3Generation","doi-asserted-by":"publisher","award":["801199"],"award-info":[{"award-number":["801199"]}],"id":[{"id":"10.13039\/501100000921","id-type":"DOI","asserted-by":"publisher"}]},{"name":"NVIDIA AI Lab (NVAIL) program","award":["01IW20005"],"award-info":[{"award-number":["01IW20005"]}]},{"name":"NVIDIA AI Lab (NVAIL) program","award":["CA18231"],"award-info":[{"award-number":["CA18231"]}]},{"name":"NVIDIA AI Lab (NVAIL) program","award":["801199"],"award-info":[{"award-number":["801199"]}]},{"name":"European Union\u2019s Horizon 2020 research and innovation programme under the Marie Sk\u0142odowska-Curie grant agreement","award":["01IW20005"],"award-info":[{"award-number":["01IW20005"]}]},{"name":"European Union\u2019s Horizon 2020 research and innovation programme under the Marie Sk\u0142odowska-Curie grant agreement","award":["CA18231"],"award-info":[{"award-number":["CA18231"]}]},{"name":"European Union\u2019s Horizon 2020 research and innovation programme under the Marie Sk\u0142odowska-Curie grant agreement","award":["801199"],"award-info":[{"award-number":["801199"]}]},{"name":"DFF Sapere Aude research leader grant","award":["01IW20005"],"award-info":[{"award-number":["01IW20005"]}]},{"name":"DFF Sapere Aude research leader grant","award":["CA18231"],"award-info":[{"award-number":["CA18231"]}]},{"name":"DFF Sapere Aude research leader grant","award":["801199"],"award-info":[{"award-number":["801199"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Fact-checking systems have become important tools to verify fake and misguiding news. These systems become more trustworthy when human-readable explanations accompany the veracity labels. However, manual collection of these explanations is expensive and time-consuming. Recent work has used extractive summarization to select a sufficient subset of the most important facts from the ruling comments (RCs) of a professional journalist to obtain fact-checking explanations. However, these explanations lack fluency and sentence coherence. In this work, we present an iterative edit-based algorithm that uses only phrase-level edits to perform unsupervised post-editing of disconnected RCs. To regulate our editing algorithm, we use a scoring function with components including fluency and semantic preservation. In addition, we show the applicability of our approach in a completely unsupervised setting. We experiment with two benchmark datasets, namely LIAR-PLUS and PubHealth. We show that our model generates explanations that are fluent, readable, non-redundant, and cover important information for the fact check.<\/jats:p>","DOI":"10.3390\/info13100500","type":"journal-article","created":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T21:11:51Z","timestamp":1666041111000},"page":"500","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Generating Fluent Fact Checking Explanations with Unsupervised Post-Editing"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1350-5425","authenticated-orcid":false,"given":"Shailza","family":"Jolly","sequence":"first","affiliation":[{"name":"Amazon Alexa AI, 10117 Berlin, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0023-2616","authenticated-orcid":false,"given":"Pepa","family":"Atanasova","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Copenhagen, 1050 Copenhagen, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1562-7909","authenticated-orcid":false,"given":"Isabelle","family":"Augenstein","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Copenhagen, 1050 Copenhagen, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Kotonya, N., and Toni, F. (2020, January 8\u201313). Explainable Automated Fact-Checking: A Survey. Proceedings of the 28th International Conference on Computational Linguistics, Barcelona, Spain.","DOI":"10.18653\/v1\/2020.coling-main.474"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Thorne, J., Vlachos, A., Christodoulopoulos, C., and Mittal, A. (2018, January 1\u20136). FEVER: A Large-scale Dataset for Fact Extraction and VERification. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), New Orleans, LA, USA.","DOI":"10.18653\/v1\/N18-1074"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Augenstein, I., Lioma, C., Wang, D., Lima, L.C., Hansen, C., Hansen, C., and Simonsen, J.G. (2019, January 3\u20137). MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claims. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1475"},{"key":"ref_4","unstructured":"Wang, W.Y. (August, January 30). \u201cLiar, Liar Pants on Fire\u201d: A New Benchmark Dataset for Fake News Detection. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Vancouver, BC, Canada."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Alhindi, T., Petridis, S., and Muresan, S. (2018, January 1). Where is Your Evidence: Improving Fact-checking by Justification Modeling. Proceedings of the First Workshop on Fact Extraction and VERification (FEVER), Brussels, Belgium.","DOI":"10.18653\/v1\/W18-5513"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Atanasova, P., Wright, D., and Augenstein, I. (2020, January 16\u201318). Generating Label Cohesive and Well-Formed Adversarial Claims. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.","DOI":"10.18653\/v1\/2020.emnlp-main.256"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kotonya, N., and Toni, F. (2020, January 16\u201318). Explainable Automated Fact-Checking for Public Health Claims. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.","DOI":"10.18653\/v1\/2020.emnlp-main.623"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liu, X., Mou, L., Meng, F., Zhou, H., Zhou, J., and Song, S. (2020, January 5\u201310). Unsupervised Paraphrasing by Simulated Annealing. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.28"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kumar, D., Mou, L., Golab, L., and Vechtomova, O. (2020, January 5\u201310). Iterative Edit-Based Unsupervised Sentence Simplification. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.707"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lu, Y.J., and Li, C.T. (2020, January 5\u201310). GCAN: Graph-aware Co-Attention Networks for Explainable Fake News Detection on Social Media. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.48"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wu, L., Rao, Y., Zhao, Y., Liang, H., and Nazir, A. (2020, January 5\u201310). DTCA: Decision Tree-based Co-Attention Networks for Explainable Claim Verification. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.97"},{"key":"ref_12","unstructured":"Atanasova, P., Simonsen, J.G., Lioma, C., and Augenstein, I. (2021, January 2\u20139). Diagnostics-Guided Explanation Generation. Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI\u201921), Virtually."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mishra, R., Gupta, D., and Leippold, M. (2020, January 19). Generating Fact Checking Summaries for Web Claims. Proceedings of the Sixth Workshop on Noisy User-generated Text (W-NUT 2020), Online.","DOI":"10.18653\/v1\/2020.wnut-1.12"},{"key":"ref_14","unstructured":"Gunning, D. (2017). Explainable Artificial Intelligence (xai), Defense Advanced Research Projects Agency (DARPA)."},{"key":"ref_15","unstructured":"Bengio, S., Wallach, H., Larochelle, H., Grauman, K., Cesa-Bianchi, N., and Garnett, R. (2018). e-SNLI: Natural Language Inference with Natural Language Explanations. Advances in Neural Information Processing Systems 31, Curran Associates, Inc."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"DeYoung, J., Jain, S., Rajani, N.F., Lehman, E., Xiong, C., Socher, R., and Wallace, B.C. (2020, January 5\u201310). ERASER: A Benchmark to Evaluate Rationalized NLP Models. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.408"},{"key":"ref_17","unstructured":"Stammbach, D., and Ash, E. (2020, January 16\u201317). e-FEVER: Explanations and Summaries for Automated Fact Checking. Proceedings of the 2020 Truth and Trust Online Conference (TTO 2020), Virtual."},{"key":"ref_18","first-page":"1877","article-title":"Language Models are Few-Shot Learners","volume":"Volume 33","author":"Larochelle","year":"2020","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Schumann, R., Mou, L., Lu, Y., Vechtomova, O., and Markert, K. (2020, January 5\u201310). Discrete Optimization for Unsupervised Sentence Summarization with Word-Level Extraction. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.452"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Atanasova, P., Simonsen, J.G., Lioma, C., and Augenstein, I. (2020, January 5\u201310). Generating Fact Checking Explanations. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.656"},{"key":"ref_21","unstructured":"Sanh, V., Debut, L., Chaumond, J., and Wolf, T. (2020). DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Beltagy, I., Lo, K., and Cohan, A. (2019, January 3\u20137). SciBERT: A Pretrained Language Model for Scientific Text. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1371"},{"key":"ref_23","unstructured":"Beltagy, I., Peters, M.E., and Cohan, A. (2020). Longformer: The Long-Document Transformer. arXiv."},{"key":"ref_24","unstructured":"Simonyan, K., Vedaldi, A., and Zisserman, A. (2014). Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Atanasova, P., Simonsen, J.G., Lioma, C., and Augenstein, I. (2020, January 5\u201310). A Diagnostic Study of Explainability Techniques for Text Classification. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.","DOI":"10.18653\/v1\/2020.emnlp-main.263"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kindermans, P.J., Hooker, S., Adebayo, J., Alber, M., Sch\u00fctt, K.T., D\u00e4hne, S., Erhan, D., and Kim, B. (2019). The (un) reliability of saliency methods. Explainable AI: Interpreting, Explaining and Visualizing Deep Learning, Springer.","DOI":"10.1007\/978-3-030-28954-6_14"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1771","DOI":"10.1162\/089976602760128018","article-title":"Training products of experts by minimizing contrastive divergence","volume":"14","author":"Hinton","year":"2002","journal-title":"Neural Comput."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J.R., Bethard, S., and McClosky, D. (2014, January 22\u201327). The Stanford CoreNLP natural language processing toolkit. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, Baltimore, MD, USA.","DOI":"10.3115\/v1\/P14-5010"},{"key":"ref_29","first-page":"10820","article-title":"Unsupervised Text Generation by Learning from Search","volume":"Volume 33","author":"Larochelle","year":"2020","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"ref_30","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv."},{"key":"ref_31","first-page":"9","article-title":"Language models are unsupervised multitask learners","volume":"1","author":"Radford","year":"2019","journal-title":"OpenAI Blog"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhang, X., and Lapata, M. (2017, January 7\u201311). Sentence Simplification with Deep Reinforcement Learning. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark.","DOI":"10.18653\/v1\/D17-1062"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kriz, R., Sedoc, J., Apidianaki, M., Zheng, C., Kumar, G., Miltsakaki, E., and Callison-Burch, C. (2019, January 2\u20137). Complexity-Weighted Loss and Diverse Reranking for Sentence Simplification. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA.","DOI":"10.18653\/v1\/N19-1317"},{"key":"ref_34","first-page":"1","article-title":"Automatic keyword extraction from individual documents","volume":"1","author":"Rose","year":"2010","journal-title":"Text Min. Appl. Theory"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Reimers, N., Gurevych, I., Reimers, N., Gurevych, I., Thakur, N., Reimers, N., Daxenberger, J., and Gurevych, I. (2019, January 3\u20137). Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing, Hong Kong, China.","DOI":"10.18653\/v1\/D19-1410"},{"key":"ref_36","unstructured":"Zhang, J., Zhao, Y., Saleh, M., and Liu, P. (2020, January 13\u201318). Pegasus: Pre-training with extracted gap-sentences for abstractive summarization. Proceedings of the International Conference on Machine Learning. PMLR, Virtual Event."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Nallapati, R., Zhai, F., and Zhou, B. (2017, January 4\u20139). SummaRuNNer: A Recurrent Neural Network Based Sequence Model for Extractive Summarization of Documents. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI\u201917), San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.10958"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Chen, Y.C., and Bansal, M. (2018, January 15\u201320). Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia.","DOI":"10.18653\/v1\/P18-1063"},{"key":"ref_39","unstructured":"Tan, J., Wan, X., and Xiao, J. (August, January 30). Abstractive Document Summarization with a Graph-Based Attentional Neural Model. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Kincaid, J.P., Fishburne, R.P., Rogers, R.L., and Chissom, B.S. (1975). Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel, Technical report; Naval Technical Training Command Millington TN Research Branch.","DOI":"10.21236\/ADA006655"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1037\/h0043254","article-title":"A recalculation of four adult readability formulas","volume":"49","author":"Powers","year":"1958","journal-title":"J. Educ. Psychol."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Liu, Y., and Lapata, M. (2019, January 3\u20137). Text Summarization with Pretrained Encoders. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1387"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1017\/S0140525X00057046","article-title":"Explanatory coherence","volume":"12","author":"Thagard","year":"1989","journal-title":"Behav. Brain Sci."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/10\/500\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:56:03Z","timestamp":1760144163000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/10\/500"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":43,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["info13100500"],"URL":"https:\/\/doi.org\/10.3390\/info13100500","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,17]]}}}