{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T21:31:03Z","timestamp":1777152663353,"version":"3.51.4"},"reference-count":55,"publisher":"MIT Press - Journals","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Linguistics"],"published-print":{"date-parts":[[2012,6]]},"abstract":"<jats:p> Natural language understanding depends heavily on assessing veridicality\u2014whether events mentioned in a text are viewed as happening or not\u2014but little consideration is given to this property in current relation and event extraction systems. Furthermore, the work that has been done has generally assumed that veridicality can be captured by lexical semantic properties whereas we show that context and world knowledge play a significant role in shaping veridicality. We extend the FactBank corpus, which contains semantically driven veridicality annotations, with pragmatically informed ones. Our annotations are more complex than the lexical assumption predicts but systematic enough to be included in computational work on textual understanding. They also indicate that veridicality judgments are not always categorical, and should therefore be modeled as distributions. We build a classifier to automatically assign event veridicality distributions based on our new annotations. The classifier relies not only on lexical features like hedges or negations, but also on structural features and approximations of world knowledge, thereby providing a nuanced picture of the diverse factors that shape veridicality. <\/jats:p><jats:p> \u201cAll I know is what I read in the papers\u201d <\/jats:p><jats:p> \u2014Will Rogers <\/jats:p>","DOI":"10.1162\/coli_a_00097","type":"journal-article","created":{"date-parts":[[2012,2,13]],"date-time":"2012-02-13T16:47:55Z","timestamp":1329151675000},"page":"301-333","source":"Crossref","is-referenced-by-count":46,"title":["Did It Happen? The Pragmatic Complexity of Veridicality Assessment"],"prefix":"10.1162","volume":"38","author":[{"given":"Marie-Catherine","family":"de Marneffe","sequence":"first","affiliation":[{"name":"Stanford University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christopher D.","family":"Manning","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christopher","family":"Potts","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"R1","doi-asserted-by":"publisher","DOI":"10.1093\/jos\/17.1.31"},{"key":"R2","volume-title":"Logics of Conversation.","author":"Asher Nicholas","year":"2003"},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.2307\/2026481"},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.1163\/9789004253162_004"},{"issue":"1","key":"R5","first-page":"39","volume":"22","author":"Berger Adam L","year":"1996","journal-title":"Computational Linguistics"},{"key":"R6","doi-asserted-by":"publisher","DOI":"10.1057\/9780230005853"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1006\/jbin.2001.1029"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9612.2010.00142.x"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1007\/11736790_9"},{"key":"R11","first-page":"449","volume-title":"In Proceedings of the 5th International Conference on Language Resources and Evaluation","author":"de Marneffe Marie-Catherine","year":"2006"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.3115\/1698381.1698393"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6947-5-13"},{"key":"R14","first-page":"1","volume-title":"In Proceedings of the Fourteenth Conference on Computational Natural Language Learning: Shared Task","author":"Farkas Rich\u00e1rd","year":"2010"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1007\/s11098-008-9202-8"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9612.2005.00077.x"},{"key":"R18","first-page":"55","volume-title":"In Language and Cognition 4, Yearbook of the Research Group for Theoretical and Experimental Linguistics.","author":"Giannakidou Anastasia","year":"1994"},{"key":"R19","first-page":"113","volume-title":"Studies in\u00a0Greek Syntax.","author":"Giannakidou Anastasia","year":"1995"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.1023\/A:1005492130684"},{"key":"R21","doi-asserted-by":"publisher","DOI":"10.1023\/A:1012758115458"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1111\/j.1933-1592.2010.00338.x"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.1259\/bjr.73.873.11064655"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M2284"},{"issue":"2","key":"R25","first-page":"169","volume":"4","author":"Karttunen Lauri","year":"1973","journal-title":"Linguistic Inquiry"},{"key":"R26","volume-title":"Annotating, Extracting and Reasoning about Time and Events","author":"Karttunen Lauri","year":"2005"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.3115\/1572340.1572342"},{"key":"R28","doi-asserted-by":"publisher","DOI":"10.1515\/9783111350219.143"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.3115\/1075096.1075150"},{"key":"R30","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511620638.006"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/5526.001.0001"},{"key":"R32","unstructured":"Manning, Christopher\u00a0D. 2006. Local textual inference: it\u2019s hard to circumscribe, but you know it when you see it\u2014and NLP needs it. Ms., Stanford University."},{"key":"R34","volume-title":"The Bush Dyslexicon.","author":"Miller Mark\u00a0Crispin","year":"2001"},{"key":"R35","doi-asserted-by":"publisher","DOI":"10.5840\/monist19695327"},{"key":"R36","doi-asserted-by":"publisher","DOI":"10.3115\/1596374.1596381"},{"key":"R37","volume-title":"Proceedings of the Workshop on\u00a0Negation and Speculation in Natural Language Processing","author":"Morante Roser","year":"2010"},{"key":"R38","first-page":"014","volume-title":"In Proceedings of\u00a0COLING 2010: Poster Volume","author":"Prabhakaran Vinodkumar","year":"2010"},{"key":"R39","unstructured":"Pustejovsky, James, Marc Verhagen, Roser Saur\u00ed, Jessica Littman, Robert Gaizauskas, Graham Katz, Inderjeet Mani, Robert Knippen, and Andrea Setzer. 2006. Timebank 1.2. Linguistic Data Consortium,\u00a0Philadelphia, PA."},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-8-50"},{"key":"R41","first-page":"1337","volume-title":"Encyclopedia of Library and Information Sciences, 3rd ed.","author":"Rieh Soo\u00a0Young","year":"2010"},{"issue":"4","key":"R42","first-page":"3","volume":"5","author":"Rooryck Johan","year":"2001","journal-title":"Glot International"},{"key":"R43","doi-asserted-by":"publisher","DOI":"10.1515\/9783110885248-009"},{"key":"R44","doi-asserted-by":"publisher","DOI":"10.3115\/1614108.1614144"},{"key":"R45","first-page":"61","volume-title":"Computing Attitude and Affect in\u00a0Text: Theory and Applications (The\u00a0Information Retrieval Series)","author":"Rubin Victoria\u00a0L","year":"2005"},{"key":"R46","doi-asserted-by":"publisher","DOI":"10.1515\/9783050080116.427"},{"key":"R47","volume-title":"A Factuality Profiler for\u00a0Eventualities in Text.","author":"Saur\u00ed Roser","year":"2008"},{"key":"R48","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-009-9089-9"},{"key":"R49","doi-asserted-by":"publisher","DOI":"10.1007\/BF00160894"},{"key":"R50","doi-asserted-by":"publisher","DOI":"10.1016\/j.lingua.2006.05.006"},{"key":"R51","doi-asserted-by":"publisher","DOI":"10.3115\/1613715.1613751"},{"key":"R52","doi-asserted-by":"publisher","DOI":"10.3115\/1572306.1572314"},{"key":"R53","doi-asserted-by":"publisher","DOI":"10.1093\/mind\/105.419.451"},{"key":"R54","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4020-8354-9_6"},{"key":"R55","doi-asserted-by":"publisher","DOI":"10.1515\/flin.1987.21.1.25"},{"key":"R56","doi-asserted-by":"publisher","DOI":"10.3115\/1631862.1631868"},{"issue":"3","key":"R57","first-page":"286","volume":"25","author":"Zwarts Frans","year":"1995","journal-title":"Linguistic Analysis"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/COLI_a_00097","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:27:13Z","timestamp":1615584433000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/38\/2\/301-333\/2148"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,6]]},"references-count":55,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2012,6]]}},"alternative-id":["10.1162\/COLI_a_00097"],"URL":"https:\/\/doi.org\/10.1162\/coli_a_00097","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,6]]}}}