{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T04:40:49Z","timestamp":1784868049016,"version":"3.55.0"},"reference-count":70,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2023,6,15]],"date-time":"2023-06-15T00:00:00Z","timestamp":1686787200000},"content-version":"vor","delay-in-days":165,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,6,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Neural sequence generation models are known to \u201challucinate\u201d, by producing outputs that are unrelated to the source text. These hallucinations are potentially harmful, yet it remains unclear in what conditions they arise and how to mitigate their impact. In this work, we first identify internal model symptoms of hallucinations by analyzing the relative token contributions to the generation in contrastive hallucinated vs. non-hallucinated outputs generated via source perturbations. We then show that these symptoms are reliable indicators of natural hallucinations, by using them to design a lightweight hallucination detector which outperforms both model-free baselines and strong classifiers based on quality estimation or large pre-trained models on manually annotated English-Chinese and German-English translation test beds.<\/jats:p>","DOI":"10.1162\/tacl_a_00563","type":"journal-article","created":{"date-parts":[[2023,6,15]],"date-time":"2023-06-15T16:53:58Z","timestamp":1686848038000},"page":"546-564","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":38,"title":["Understanding and Detecting Hallucinations in Neural Machine Translation via Model Introspection"],"prefix":"10.1162","volume":"11","author":[{"given":"Weijia","family":"Xu","sequence":"first","affiliation":[{"name":"Microsoft Research, Redmond, USA. weijiaxu@microsoft.com"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sweta","family":"Agrawal","sequence":"additional","affiliation":[{"name":"University of Maryland, USA. sweagraw@cs.umd.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eleftheria","family":"Briakou","sequence":"additional","affiliation":[{"name":"University of Maryland, USA. ebriakou@cs.umd.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marianna J.","family":"Martindale","sequence":"additional","affiliation":[{"name":"University of Maryland, USA. mmartind@umd.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marine","family":"Carpuat","sequence":"additional","affiliation":[{"name":"University of Maryland, USA. marine@cs.umd.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2023,6,12]]},"reference":[{"key":"2023061516534916100_bib1","first-page":"1","article-title":"Findings of the 2021 conference on machine translation (WMT21)","volume-title":"Proceedings of the Sixth Conference on Machine Translation","author":"Akhbardeh","year":"2021"},{"key":"2023061516534916100_bib2","doi-asserted-by":"publisher","first-page":"412","DOI":"10.18653\/v1\/D17-1042","article-title":"A causal framework for explaining the predictions of black-box sequence-to-sequence models","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","author":"Alvarez-Melis","year":"2017"},{"key":"2023061516534916100_bib3","doi-asserted-by":"publisher","first-page":"597","DOI":"10.1162\/tacl_a_00288","article-title":"Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond","volume":"7","author":"Artetxe","year":"2019","journal-title":"Transactions of the Association for Computational Linguistics"},{"issue":"7","key":"2023061516534916100_bib4","doi-asserted-by":"publisher","first-page":"e0130140","DOI":"10.1371\/journal.pone.0130140","article-title":"On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation","volume":"10","author":"Bach","year":"2015","journal-title":"PloS One"},{"key":"2023061516534916100_bib5","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1145\/3442188.3445922","article-title":"On the dangers of stochastic parrots: Can language models be too big?","volume-title":"Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency FAccT \u201921","author":"Bender","year":"2021"},{"key":"2023061516534916100_bib6","doi-asserted-by":"publisher","first-page":"168","DOI":"10.18653\/v1\/D19-5617","article-title":"Machine translation of restaurant reviews: New corpus for domain adaptation and robustness","volume-title":"Proceedings of the 3rd Workshop on Neural Generation and Translation","author":"Berard","year":"2019"},{"key":"2023061516534916100_bib7","doi-asserted-by":"publisher","first-page":"526","DOI":"10.18653\/v1\/W19-5361","article-title":"Naver labs Europe\u2019s systems for the WMT19 machine translation robustness task","volume-title":"Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1)","author":"Berard","year":"2019"},{"key":"2023061516534916100_bib8","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1007\/978-3-319-44781-0_8","article-title":"Layer-wise relevance propagation for neural networks with local renormalization layers","volume-title":"International Conference on Artificial Neural Networks","author":"Binder","year":"2016"},{"key":"2023061516534916100_bib9","doi-asserted-by":"publisher","first-page":"272","DOI":"10.18653\/v1\/W18-6401","article-title":"Findings of the 2018 conference on machine translation (WMT18)","volume-title":"Proceedings of the Third Conference on Machine Translation","author":"Bojar","year":"2018"},{"key":"2023061516534916100_bib10","doi-asserted-by":"publisher","first-page":"1563","DOI":"10.18653\/v1\/2020.emnlp-main.121","article-title":"Detecting fine-grained cross-lingual semantic divergences without supervision by learning to rank","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Briakou","year":"2020"},{"key":"2023061516534916100_bib11","doi-asserted-by":"publisher","first-page":"7236","DOI":"10.18653\/v1\/2021.acl-long.562","article-title":"Beyond noise: Mitigating the impact of fine-grained semantic divergences on neural machine translation","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Briakou","year":"2021"},{"key":"2023061516534916100_bib12","first-page":"2","article-title":"The IWSLT 2015 evaluation campaign","volume-title":"Proceedings of the 12th International Workshop on Spoken Language Translation: Evaluation Campaign","author":"Cettolo","year":"2015"},{"key":"2023061516534916100_bib13","first-page":"104","article-title":"The University of Edinburgh\u2019s English-German and English-Hausa submissions to the WMT21 news translation task","volume-title":"Proceedings of the Sixth Conference on Machine Translation","author":"Chen","year":"2021"},{"key":"2023061516534916100_bib14","doi-asserted-by":"publisher","first-page":"8440","DOI":"10.18653\/v1\/2020.acl-main.747","article-title":"Unsupervised cross-lingual representation learning at scale","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Conneau","year":"2020"},{"key":"2023061516534916100_bib15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18653\/v1\/W19-5201","article-title":"Saliency-driven word alignment interpretation for neural machine translation","volume-title":"Proceedings of the Fourth Conference on Machine Translation (Volume 1: Research Papers)","author":"Ding","year":"2019"},{"key":"2023061516534916100_bib16","doi-asserted-by":"publisher","first-page":"1150","DOI":"10.18653\/v1\/P17-1106","article-title":"Visualizing and understanding neural machine translation","volume-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Ding","year":"2017"},{"key":"2023061516534916100_bib17","doi-asserted-by":"publisher","first-page":"5055","DOI":"10.18653\/v1\/2020.acl-main.454","article-title":"FEQA: A question answering evaluation framework for faithfulness assessment in abstractive summarization","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Durmus","year":"2020"},{"key":"2023061516534916100_bib18","doi-asserted-by":"publisher","first-page":"322","DOI":"10.18653\/v1\/W18-6539","article-title":"Findings of the E2E NLG challenge","volume-title":"Proceedings of the 11th International Conference on Natural Language Generation","author":"Du\u0161ek","year":"2018"},{"key":"2023061516534916100_bib19","first-page":"653","article-title":"On adversarial examples for character-level neural machine translation","volume-title":"Proceedings of the 27th International Conference on Computational Linguistics","author":"Ebrahimi","year":"2018"},{"key":"2023061516534916100_bib20","doi-asserted-by":"publisher","first-page":"2214","DOI":"10.18653\/v1\/P19-1213","article-title":"Ranking generated summaries by correctness: An interesting but challenging application for natural language inference","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Falke","year":"2019"},{"key":"2023061516534916100_bib21","doi-asserted-by":"publisher","first-page":"3719","DOI":"10.18653\/v1\/D18-1407","article-title":"Pathologies of neural models make interpretations difficult","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Feng","year":"2018"},{"issue":"5","key":"2023061516534916100_bib22","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many raters","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychological Bulletin"},{"key":"2023061516534916100_bib23","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1162\/tacl_a_00330","article-title":"Unsupervised quality estimation for neural machine translation","volume":"8","author":"Fomicheva","year":"2020","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2023061516534916100_bib24","first-page":"197","article-title":"The University of Edinburgh\u2019s submission to the German-to-English and English-to-German tracks in the WMT 2020 news translation and zero-shot translation robustness tasks","volume-title":"Proceedings of the Fifth Conference on Machine Translation","author":"Germann","year":"2020"},{"key":"2023061516534916100_bib25","doi-asserted-by":"crossref","unstructured":"Nuno M. Guerreiro , ElenaVoita, and Andr\u00e9 F. T.Martins. 2022. Looking for a needle in a haystack: A comprehensive study of hallucinations in neural machine translation. 10.48550\/arXiv.2208.05309","DOI":"10.18653\/v1\/2023.eacl-main.75"},{"key":"2023061516534916100_bib26","doi-asserted-by":"publisher","first-page":"6098","DOI":"10.18653\/v1\/D19-1632","article-title":"The FLORES evaluation datasets for low-resource machine translation: Nepali\u2013English and Sinhala\u2013English","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Guzm\u00e1n","year":"2019"},{"key":"2023061516534916100_bib27","doi-asserted-by":"publisher","first-page":"953","DOI":"10.18653\/v1\/D19-1088","article-title":"Towards understanding neural machine translation with word importance","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"He","year":"2019"},{"key":"2023061516534916100_bib28","doi-asserted-by":"crossref","unstructured":"Kevin Heffernan , Onur\u00c7elebi, and HolgerSchwenk. 2022. Bitext mining using distilled sentence representations for low-resource languages. 10.48550\/arXiv.2205.12654","DOI":"10.18653\/v1\/2022.findings-emnlp.154"},{"key":"2023061516534916100_bib29","article-title":"The curious case of neural text degeneration","volume-title":"International Conference on Learning Representations","author":"Holtzman","year":"2020"},{"key":"2023061516534916100_bib30","doi-asserted-by":"publisher","DOI":"10.1002\/9781118548387","volume-title":"Applied Logistic Regression","author":"Hosmer Jr","year":"2013"},{"key":"2023061516534916100_bib31","unstructured":"Ziwei Ji , NayeonLee, RitaFrieske, TiezhengYu, DanSu, YanXu, EtsukoIshii, YejinBang, AndreaMadotto, and PascaleFung. 2022. Survey of hallucination in natural language generation. 10.48550\/arXiv.2202.03629"},{"key":"2023061516534916100_bib32","doi-asserted-by":"publisher","first-page":"42","DOI":"10.18653\/v1\/D19-5506","article-title":"Training on synthetic noise improves robustness to natural noise in machine translation","volume-title":"Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019)","author":"Karpukhin","year":"2019"},{"key":"2023061516534916100_bib33","doi-asserted-by":"publisher","first-page":"284","DOI":"10.18653\/v1\/P18-1027","article-title":"Sharp nearby, fuzzy far away: How neural language models use context","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Khandelwal","year":"2018"},{"key":"2023061516534916100_bib34","doi-asserted-by":"publisher","first-page":"562","DOI":"10.18653\/v1\/W17-4763","article-title":"Predictor-estimator using multilevel task learning with stack propagation for neural quality estimation","volume-title":"Proceedings of the Second Conference on Machine Translation","author":"Kim","year":"2017"},{"key":"2023061516534916100_bib35","article-title":"Adam: A method for stochastic optimization","volume-title":"Proceedings of the 3th International Conference on Learning Representations","author":"Kingma","year":"2015"},{"key":"2023061516534916100_bib36","first-page":"177","article-title":"Moses: Open source toolkit for statistical machine translation","volume-title":"Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics Companion Volume Proceedings of the Demo and Poster Sessions","author":"Koehn","year":"2007"},{"key":"2023061516534916100_bib37","article-title":"Hallucinations in neural machine translation","volume-title":"NeurIPS Interpretability and Robustness for Audio, Speech and Language Workshop","author":"Lee","year":"2018"},{"key":"2023061516534916100_bib38","doi-asserted-by":"publisher","first-page":"681","DOI":"10.18653\/v1\/N16-1082","article-title":"Visualizing and understanding neural models in NLP","volume-title":"Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Li","year":"2016"},{"key":"2023061516534916100_bib39","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1612.08220","article-title":"Understanding neural networks through representation erasure","volume":"abs\/1612.08220","author":"Li","year":"2016","journal-title":"CoRR"},{"key":"2023061516534916100_bib40","article-title":"Decoupled weight decay regularization","volume-title":"International Conference on Learning Representations","author":"Loshchilov","year":"2019"},{"key":"2023061516534916100_bib41","first-page":"189","article-title":"An analysis of source context dependency in neural machine translation","volume-title":"21st Annual Conference of the European Association for Machine Translation","author":"Ma","year":"2018"},{"key":"2023061516534916100_bib42","first-page":"13","article-title":"Fluency over adequacy: A pilot study in mea suring user trust in imperfect MT","volume-title":"Proceedings of the 13th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Papers)","author":"Martindale","year":"2018"},{"key":"2023061516534916100_bib43","first-page":"233","article-title":"Identifying fluently inadequate output in neural and statistical machine translation","volume-title":"Proceedings of Machine Translation Summit XVII Volume 1: Research Track","author":"Martindale","year":"2019"},{"key":"2023061516534916100_bib44","doi-asserted-by":"publisher","first-page":"1906","DOI":"10.18653\/v1\/2020.acl-main.173","article-title":"On faithfulness and factuality in abstractive summarization","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Maynez","year":"2020"},{"key":"2023061516534916100_bib45","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/978-3-030-28954-6_10","article-title":"Layer-wise relevance propagation: An overview","author":"Montavon","year":"2019","journal-title":"Explainable AI: Interpreting, Explaining and Visualizing Deep Learning"},{"key":"2023061516534916100_bib46","doi-asserted-by":"publisher","first-page":"5070","DOI":"10.18653\/v1\/2020.coling-main.445","article-title":"TransQuest: Translation quality estimation with cross-lingual transformers","volume-title":"Proceedings of the 28th International Conference on Computational Linguistics","author":"Ranasinghe","year":"2020"},{"key":"2023061516534916100_bib47","doi-asserted-by":"publisher","first-page":"1172","DOI":"10.18653\/v1\/2021.naacl-main.92","article-title":"The curious case of hallucinations in neural machine translation","volume-title":"Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Raunak","year":"2021"},{"key":"2023061516534916100_bib48","doi-asserted-by":"publisher","first-page":"2685","DOI":"10.18653\/v1\/2020.emnlp-main.213","article-title":"COMET: A neural framework for MT evaluation","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Rei","year":"2020"},{"key":"2023061516534916100_bib49","first-page":"911","article-title":"Unbabel\u2019s participation in the WMT20 metrics shared task","volume-title":"Proceedings of the Fifth Conference on Machine Translation","author":"Rei","year":"2020"},{"key":"2023061516534916100_bib50","article-title":"Confidence through attention","volume-title":"Proceedings of the 16th Machine Translation Summit (MT Summit 2017)","author":"Rikters","year":"2017"},{"key":"2023061516534916100_bib51","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2110.05456","article-title":"Rome was built in 1776: A case study on factual correctness in knowledge-grounded response generation","volume":"abs\/2110 .05456","author":"Santhanam","year":"2021","journal-title":"CoRR"},{"key":"2023061516534916100_bib52","doi-asserted-by":"publisher","first-page":"1351","DOI":"10.18653\/v1\/2021.eacl-main.115","article-title":"WikiMatrix: Mining 135M parallel sentences in 1620 language pairs from Wikipedia","volume-title":"Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume","author":"Schwenk","year":"2021"},{"key":"2023061516534916100_bib53","first-page":"5175","article-title":"Rare but severe neural machine translation errors induced by minimal deletion: An empirical study on Chinese and English","volume-title":"Proceedings of the 29th International Conference on Computational Linguistics","author":"Shi","year":"2022"},{"key":"2023061516534916100_bib54","article-title":"Deep inside convolutional networks: Visualising image classification models and saliency maps","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR)","author":"Simonyan","year":"2014"},{"key":"2023061516534916100_bib55","first-page":"743","article-title":"Findings of the WMT 2020 shared task on quality estimation","volume-title":"Proceedings of the Fifth Conference on Machine Translation","author":"Specia","year":"2020"},{"key":"2023061516534916100_bib56","first-page":"684","article-title":"Findings of the WMT 2021 shared task on quality estimation","volume-title":"Proceedings of the Sixth Conference on Machine Translation","author":"Specia","year":"2021"},{"key":"2023061516534916100_bib57","article-title":"Estimating the sentence-level quality of machine translation systems","volume-title":"Proceedings of the 13th Annual conference of the European Association for Machine Translation","author":"Specia","year":"2009"},{"key":"2023061516534916100_bib58","article-title":"The JRC-Acquis: A multilingual aligned parallel corpus with 20+ languages","volume-title":"Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC\u201906)","author":"Steinberger","year":"2006"},{"key":"2023061516534916100_bib59","first-page":"46","article-title":"Is this translation error critical?: Classification-based human and automatic machine translation evaluation focusing on critical errors","volume-title":"Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval)","author":"Sudoh","year":"2021"},{"key":"2023061516534916100_bib60","first-page":"1049","article-title":"Multilingual machine translation evaluation metrics fine-tuned on pseudo-negative examples for WMT 2021 metrics task","volume-title":"Proceedings of the Sixth Conference on Machine Translation","author":"Takahashi","year":"2021"},{"key":"2023061516534916100_bib61","first-page":"5998","article-title":"Attention is all you need","volume-title":"Advances in Neural Information Processing Systems","author":"Vaswani","year":"2017"},{"key":"2023061516534916100_bib62","doi-asserted-by":"publisher","first-page":"1126","DOI":"10.18653\/v1\/2021.acl-long.91","article-title":"Analyzing the source and target contributions to predictions in neural machine translation","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Voita","year":"2021"},{"key":"2023061516534916100_bib63","doi-asserted-by":"publisher","first-page":"3544","DOI":"10.18653\/v1\/2020.acl-main.326","article-title":"On exposure bias, hallucination and domain shift in neural machine translation","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Wang","year":"2020"},{"key":"2023061516534916100_bib64","doi-asserted-by":"publisher","first-page":"3070","DOI":"10.18653\/v1\/2020.acl-main.278","article-title":"On the inference calibration of neural machine translation","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Wang","year":"2020"},{"key":"2023061516534916100_bib65","doi-asserted-by":"publisher","first-page":"2253","DOI":"10.18653\/v1\/D17-1239","article-title":"Challenges in data-to-document generation","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","author":"Wiseman","year":"2017"},{"key":"2023061516534916100_bib66","doi-asserted-by":"publisher","first-page":"2734","DOI":"10.18653\/v1\/2021.eacl-main.236","article-title":"On hallucination and predictive uncertainty in conditional language generation","volume-title":"Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume","author":"Xiao","year":"2021"},{"key":"2023061516534916100_bib67","doi-asserted-by":"publisher","first-page":"535","DOI":"10.18653\/v1\/W18-6431","article-title":"The University of Maryland\u2019s Chinese-English neural machine translation systems at WMT18","volume-title":"Proceedings of the Third Conference on Machine Translation: Shared Task Papers","author":"Weijia","year":"2018"},{"key":"2023061516534916100_bib68","doi-asserted-by":"publisher","first-page":"816","DOI":"10.18653\/v1\/W18-6466","article-title":"Quality estimation with force- decoded attention and cross-lingual embeddings","volume-title":"Proceedings of the Third Conference on Machine Translation: Shared Task Papers","author":"Yankovskaya","year":"2018"},{"key":"2023061516534916100_bib69","article-title":"Findings of the WMT 2022 shared task on quality estimation","volume-title":"Proceedings of the Seventh Conference on Machine Translation","author":"Zerva","year":"2022"},{"key":"2023061516534916100_bib70","doi-asserted-by":"publisher","first-page":"1393","DOI":"10.18653\/v1\/2021.findings-acl.120","article-title":"Detecting hallucinated content in conditional neural sequence generation","volume-title":"Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021","author":"Zhou","year":"2021"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00563\/2131193\/tacl_a_00563.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00563\/2131193\/tacl_a_00563.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,15]],"date-time":"2023-12-15T04:51:59Z","timestamp":1702615919000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/doi\/10.1162\/tacl_a_00563\/116414\/Understanding-and-Detecting-Hallucinations-in"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":70,"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00563","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023]]},"published":{"date-parts":[[2023]]}}}