{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T21:55:57Z","timestamp":1777499757466,"version":"3.51.4"},"reference-count":66,"publisher":"MIT Press","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Linguistics"],"published-print":{"date-parts":[[2012,6]]},"abstract":"<jats:p>Identifying the veracity, or factuality, of event mentions in text is fundamental for reasoning about eventualities in discourse. Inferences derived from events judged as not having happened, or as being only possible, are different from those derived from events evaluated as factual. Event factuality involves two separate levels of information. On the one hand, it deals with polarity, which distinguishes between positive and negative instantiations of events. On the other, it has to do with degrees of certainty (e.g., possible, probable), an information level generally subsumed under the category of epistemic modality. This article aims at contributing to a better understanding of how event factuality is articulated in natural language. For that purpose, we put forward a linguistic-oriented computational model which has at its core an algorithm articulating the effect of factuality relations across levels of syntactic embedding. As a proof of concept, this model has been implemented in De Facto, a factuality profiler for eventualities mentioned in text, and tested against a corpus built specifically for the task, yielding an F<jats:sub>1<\/jats:sub>of 0.70 (macro-averaging) and 0.80 (micro-averaging). These two measures mutually compensate for an over-emphasis present in the other (either on the lesser or greater populated categories), and can therefore be interpreted as the lower and upper bounds of the De Facto's performance.<\/jats:p>","DOI":"10.1162\/coli_a_00096","type":"journal-article","created":{"date-parts":[[2012,2,13]],"date-time":"2012-02-13T16:47:55Z","timestamp":1329151675000},"page":"261-299","source":"Crossref","is-referenced-by-count":64,"title":["Are You Sure That This Happened? Assessing the Factuality Degree of Events in Text"],"prefix":"10.1162","volume":"38","author":[{"given":"Roser","family":"Saur\u00ed","sequence":"first","affiliation":[{"name":"Barcelona Media - Innovation Center"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Pustejovsky","sequence":"additional","affiliation":[{"name":"Brandeis University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"R2","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780199263882.001.0001","volume-title":"Evidentiality","author":"Aikhenvald Alexandra Y.","year":"2004"},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-011-1715-9"},{"key":"R4","volume-title":"Linguistic Communication and Speech Acts","author":"Bach Kent","year":"1979"},{"issue":"1","key":"R5","first-page":"93","volume":"9","author":"Biber Douglas","year":"1989","journal-title":"Text"},{"key":"R6","volume-title":"Evidentiality: The Linguistic Coding of Epistemology","author":"Chafe Wallace","year":"1986"},{"key":"R7","first-page":"5","volume-title":"Proceedings of the Workshop on Negation and Speculation in Natural Language Processing","author":"Dalianis Hercules","year":"2010"},{"key":"R8","volume-title":"The Interaction of Modality and Negation: a Typological Study","author":"de Haan Ferdinand","year":"1997"},{"key":"R9","first-page":"449","volume-title":"Proceedings of LREC 2006","author":"de Marneffe Marie-Catherine","year":"2006"},{"key":"R10","volume-title":"Language Understanding Annotation Corpus","author":"Diab Mona","year":"2009"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.3115\/1698381.1698393"},{"key":"R12","unstructured":"Dor, Daniel. 1995.Representations, Attitudes and Factivity Evaluations. An Epistemically-based Analysis of Lexical Selection. Ph.D. thesis, Stanford University."},{"key":"R13","first-page":"1","volume-title":"Proceedings of the 14th CoNLL Conference \u2013 Shared Task","author":"Farkas Rich\u00e1rd","year":"2010"},{"key":"R14","doi-asserted-by":"publisher","DOI":"10.1023\/A:1005481821597"},{"key":"R15","volume-title":"English Grammar. A Function-Based Introduction","author":"Giv\u00f3n Talmy","year":"1993"},{"key":"R16","volume-title":"University of Michigan Workshop in Philosophy and Linguistics","author":"Glanzberg Michael","year":"2003"},{"key":"R17","volume-title":"An Introduction to Functional Grammar","author":"Halliday M. A. K.","year":"2004"},{"key":"R18","first-page":"41","volume-title":"Proceedings of the Workshop on Negation and Speculation in Natural Language Processing","author":"Henriksson Aron","year":"2010"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.3115\/1654536.1654571"},{"key":"R20","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1163\/9789004368828_005","volume-title":"Syntax and Semantics, IV","author":"Hooper Joan B.","year":"1975"},{"key":"R21","unstructured":"Horn, Laurence R. 1972.On the Semantic Properties of Logical Operators in English. Ph.D. thesis, UCLA. Distributed by the Indiana University Linguistics Club, 1976."},{"key":"R22","volume-title":"A Natural History of Negation","author":"Horn Laurence R.","year":"1989"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.1093\/applin\/17.4.433"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.2307\/412084"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.1515\/flin.1987.21.1.67"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-9-S11-S10"},{"key":"R28","doi-asserted-by":"publisher","DOI":"10.3115\/1572340.1572342"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-9-10"},{"key":"R30","doi-asserted-by":"publisher","DOI":"10.1515\/9783111350219.143"},{"key":"R31","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1515\/9783110126969.7.639","volume-title":"Semantik: Ein internationales Handbuch der zeitgenoessischen Forschung","author":"Kratzer Angelika","year":"1991"},{"key":"R32","doi-asserted-by":"publisher","DOI":"10.3115\/1117601.1117635"},{"issue":"4","key":"R33","first-page":"458","volume":"2","author":"Lakoff George","year":"1973","journal-title":"Journal of Philosophical Logic"},{"key":"R34","first-page":"17","volume-title":"BioLINK 2004: Linking Biological Literature, Ontologies, and Databases","author":"Light Marc","year":"2004"},{"key":"R35","volume-title":"Semantics","author":"Lyons John","year":"1977"},{"key":"R36","doi-asserted-by":"publisher","DOI":"10.1057\/9780230511910"},{"key":"R37","first-page":"992","volume-title":"Proceedings of the 45th ACL","author":"Medlock Ben","year":"2007"},{"key":"R38","first-page":"27","volume-title":"Proceedings of the RANLP","author":"Moilanen Karo","year":"2007"},{"key":"R39","first-page":"36","volume-title":"Proceedings of the 1st Workshop on Computational Approaches to Subjectivity and Sentiment Analysis (WASSA 2010)","author":"Moilanen Karo","year":"2010"},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.3115\/1572364.1572369"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.3115\/1596374.1596381"},{"key":"R42","doi-asserted-by":"publisher","DOI":"10.1075\/pbns.87"},{"key":"R43","first-page":"67","volume-title":"Inference in Computational Semantics, ICoS-5","author":"Nairn Rowan","year":"2006"},{"key":"R44","first-page":"69","volume-title":"Proceedings of the Workshop on Negation and Speculation in Natural Language Processing","author":"Nawaz Raheel","year":"2010"},{"key":"R45","first-page":"278","volume-title":"Proceedings of the 3rd International ICWSM Conference","author":"Neviarouskaya Alena","year":"2009"},{"key":"R47","first-page":"1398","volume-title":"Proceedings of the 2009 EMNLP Conference","author":"\u00d6zg\u00fcr Arzucan","year":"2009"},{"key":"R48","volume-title":"Mood and Modality","author":"Palmer Frank R.","year":"1986"},{"key":"R49","doi-asserted-by":"publisher","DOI":"10.1007\/1-4020-4102-0_1"},{"key":"R50","first-page":"1014","volume-title":"CoLing 2010. Poster Volume","author":"Prabhakaran Vinodkumar","year":"2010"},{"issue":"2","key":"R51","first-page":"43","volume":"47","author":"Prasad Rashmi","year":"2007","journal-title":"Traitement Automatique des Langues"},{"key":"R52","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-005-7882-7"},{"key":"R53","volume-title":"TimeBank 1.2","author":"Pustejovsky James","year":"2006"},{"key":"R54","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-28624-2_4"},{"key":"R55","unstructured":"Rubin, Victoria L. 2006.Identifying Certainty in Texts. Ph.D. thesis, Syracuse University."},{"key":"R56","first-page":"141","volume-title":"Proceedings of the NAACL-HLT 2007","author":"Rubin Victoria L."},{"key":"R57","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2010.02.006"},{"key":"R58","unstructured":"Saur\u00ed, Roser. 2008.A Factuality Profiler for Eventualities in Text. Ph.D thesis, Brandeis University."},{"key":"R59","first-page":"509","volume-title":"Proceedings of the First IEEE International Conference on Semantic Computing","author":"Saur\u00ed Roser","year":"2007"},{"key":"R60","volume-title":"FactBank 1.0","author":"Saur\u00ed Roser","year":"2009"},{"key":"R61","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-009-9089-9"},{"key":"R62","first-page":"1332","volume-title":"Proceedings of LREC 2006","author":"Saur\u00ed Roser","year":"2006"},{"key":"R63","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btn381"},{"key":"R64","first-page":"281","volume-title":"ACL 08: HLT","author":"Szarvas Gyorgy","year":"2008"},{"key":"R65","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139166799"},{"key":"R66","first-page":"48","volume-title":"Proceedings of the 14th CoNLL: Shared Task","author":"Velldal Erik","year":"2010"},{"key":"R67","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-9-S11-S9"},{"key":"R68","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-005-7880-9"},{"key":"R69","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-7-356"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/COLI_a_00096","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,19]],"date-time":"2024-04-19T16:17:51Z","timestamp":1713543471000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/38\/2\/261-299\/2145"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,6]]},"references-count":66,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2012,6]]}},"alternative-id":["10.1162\/COLI_a_00096"],"URL":"https:\/\/doi.org\/10.1162\/coli_a_00096","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,6]]}}}