{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T08:06:57Z","timestamp":1772611617294,"version":"3.50.1"},"reference-count":112,"publisher":"MIT Press","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Linguistics"],"published-print":{"date-parts":[[2019,6]]},"abstract":"<jats:p>Event processing is an active area of research in the Natural Language Processing community, but resources and automatic systems developed so far have mainly addressed contemporary texts. However, the recognition and elaboration of events is a crucial step when dealing with historical texts Particularly in the current era of massive digitization of historical sources: Research in this domain can lead to the development of methodologies and tools that can assist historians in enhancing their work, while having an impact also on the field of Natural Language Processing. Our work aims at shedding light on the complex concept of events when dealing with historical texts. More specifically, we introduce new annotation guidelines for event mentions and types, categorized into 22 classes. Then, we annotate a historical corpus accordingly, and compare two approaches for automatic event detection and classification following this novel scheme. We believe that this work can foster research in a field of inquiry as yet underestimated in the area of Temporal Information Processing. To this end, we release new annotation guidelines, a corpus, and new models for automatic annotation.<\/jats:p>","DOI":"10.1162\/coli_a_00347","type":"journal-article","created":{"date-parts":[[2019,3,20]],"date-time":"2019-03-20T18:09:55Z","timestamp":1553105395000},"page":"229-265","source":"Crossref","is-referenced-by-count":22,"title":["Novel Event Detection and Classification for Historical Texts"],"prefix":"10.1162","volume":"45","author":[{"given":"Rachele","family":"Sprugnoli","sequence":"first","affiliation":[{"name":"Universit\u00e0 Cattolica del Sacro Cuore, Linguistic Sciences and Foreign Literature Department."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sara","family":"Tonelli","sequence":"additional","affiliation":[{"name":"Fondazione Bruno Kessler, Digital Humanities Research Group."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"bib1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2907"},{"key":"bib2","doi-asserted-by":"publisher","DOI":"10.1057\/9781137304186_13"},{"key":"bib3","doi-asserted-by":"publisher","DOI":"10.1162\/coli.07-034-R2"},{"key":"bib4","doi-asserted-by":"publisher","DOI":"10.1111\/coin.12017"},{"key":"bib5","doi-asserted-by":"publisher","DOI":"10.1002\/9780470758335.ch13"},{"key":"bib6","first-page":"333","volume-title":"Proceedings of LREC 2012","author":"Bartalesi Lenzi Valentina","year":"2012"},{"key":"bib7","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S15-2136"},{"key":"bib8","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1165"},{"key":"bib9","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S17-2093"},{"key":"bib10","doi-asserted-by":"publisher","DOI":"10.1093\/tcbh\/hwq007"},{"key":"bib11","first-page":"183","volume-title":"Proceedings of the BioNLP Shared Task 2011 Workshop","author":"Bj\u00f6rne Jari","year":"2011"},{"key":"bib12","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"key":"bib13","volume-title":"Varieties of Cultural History","author":"Burke Peter","year":"1997"},{"issue":"2","key":"bib14","first-page":"249","volume":"22","author":"Carletta Jean","year":"1996","journal-title":"Computational Linguistics"},{"key":"bib15","doi-asserted-by":"publisher","DOI":"10.3115\/1119355.1119377"},{"key":"bib16","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104"},{"key":"bib17","first-page":"2493","volume":"12","author":"Collobert Ronan","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"bib18","first-page":"3355","volume-title":"Proceedings of LREC","author":"Cybulska Agata","year":"2010"},{"key":"bib19","first-page":"39","volume-title":"Proceedings of the 5th ACL-HLT Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities","author":"Cybulska Agata","year":"2011"},{"key":"bib20","doi-asserted-by":"publisher","DOI":"10.13189\/sa.2017.050406"},{"key":"bib21","doi-asserted-by":"publisher","DOI":"10.3366\/cor.2012.0024"},{"key":"bib22","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2015.06.003"},{"key":"bib23","first-page":"3702","volume-title":"10th Language Resources and Evaluation Conference","author":"Derczynski Leon","year":"2016"},{"key":"bib24","doi-asserted-by":"publisher","DOI":"10.2307\/1932409"},{"key":"bib25","volume-title":"Oxford Research Encyclopedia of Linguistics","author":"den Dikken Marcel","year":"2016"},{"key":"bib26","first-page":"837","volume-title":"LREC","author":"Doddington George R.","year":"2004"},{"key":"bib27","doi-asserted-by":"publisher","DOI":"10.1075\/slcs.152.05dol"},{"key":"bib28","first-page":"1","volume-title":"Proceedings of ICLR 2016","author":"Dozat Timothy","year":"2016"},{"key":"bib29","first-page":"2121","volume":"12","author":"Duchi John","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"bib30","doi-asserted-by":"publisher","DOI":"10.3115\/1118238.1118250"},{"key":"bib31","author":"Fokkens Antske","year":"2018","journal-title":"arXiv preprint arXiv:1801.07073"},{"key":"bib32","first-page":"3728","volume-title":"Proceedings of LREC","author":"Fokkens Antske","year":"2014"},{"key":"bib33","first-page":"259","volume":"47","author":"Guerrero Nieto Marta","year":"2011","journal-title":"Procesamiento del Lenguaje Natural"},{"key":"bib34","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1141"},{"key":"bib35","first-page":"1","volume-title":"Proceedings of Corpus Linguistics","volume":"3","author":"Ide Nancy","year":"2001"},{"key":"bib36","first-page":"2177","volume-title":"Computer","author":"Ide Nancy","year":"2004"},{"key":"bib37","doi-asserted-by":"publisher","DOI":"10.1007\/1-4020-5833-0_7"},{"key":"bib38","unstructured":"Iso, SemAf\/Time Working Group. 2008. ISO DIS 24617-1: 2008 Language resource management. Semantic annotation framework - Part 1: Time and events. Technical report, ISO Central Secretariat, Geneva."},{"key":"bib39","first-page":"20","volume-title":"Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013)","volume":"2","author":"Jung Hyuckchul","year":"2013"},{"key":"bib40","doi-asserted-by":"publisher","DOI":"10.3115\/1118238.1118252"},{"key":"bib41","volume-title":"Historical Thesaurus of the Oxford English Dictionary","author":"Kay Christian","year":"2009"},{"key":"bib42","doi-asserted-by":"publisher","DOI":"10.1515\/cogl.1994.5.2.115"},{"key":"bib43","author":"Keskar Nitish Shirish","year":"2017","journal-title":"CoRR"},{"key":"bib44","doi-asserted-by":"publisher","DOI":"10.3115\/1572340.1572342"},{"key":"bib46","first-page":"1","volume-title":"Proceedings of the BioNLP Shared Task 2011 Workshop","author":"Kim Jin Dong","year":"2011"},{"key":"bib47","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-3003"},{"key":"bib48","author":"Kingma Diederik","year":"2014","journal-title":"arXiv preprint arXiv:1412.6980"},{"key":"bib49","first-page":"83","volume-title":"Proceedings of the Second Joint Conference on Lexical and Computational Semantics (* SEM)","volume":"2","author":"Kolomiyets Oleksandr","year":"2013"},{"key":"bib50","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1175"},{"key":"bib51","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1030"},{"key":"bib52","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"bib53","unstructured":"Le Boeuf, Patrick, Martin Doerr, Christian Emil Ore, and Stephen Stead. 2017. Definition of the CIDOC conceptual reference model, Version 6.2.2. Technical report, ICOM\/CIDOC Documentation Standards Group. CIDOC CRM Special Interest Group."},{"key":"bib54","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1201"},{"key":"bib55","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-3005"},{"key":"bib56","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-2050"},{"key":"bib57","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-3004"},{"key":"bib58","unstructured":"Linguistic Data Consortium. 2005. ACE (Automatic Content Extraction) English annotation guidelines for events, Technical Report version 5.4.3 2005.07.01, LDC."},{"key":"bib59","first-page":"284","volume-title":"ACL 2010 - SemEval 2010 - Proceedings of the 5th International Workshop on Semantic Evaluation","author":"Llorens Hector","year":"2010"},{"key":"bib60","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1101"},{"key":"bib61","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-5010"},{"key":"bib62","doi-asserted-by":"publisher","DOI":"10.1145\/3125571.3125585"},{"key":"bib63","doi-asserted-by":"publisher","DOI":"10.1023\/A:1005389330615"},{"key":"bib64","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-3009"},{"key":"bib65","doi-asserted-by":"publisher","DOI":"10.1075\/la.85"},{"key":"bib66","author":"Mikolov Tomas","year":"2013","journal-title":"arXiv preprint arXiv:1301.3781"},{"key":"bib67","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S15-2132"},{"key":"bib68","volume-title":"Proceedings of the Ninth Text Analysis Conference","author":"Mitamura Teruko","year":"2016"},{"key":"bib69","volume-title":"Proceedings of the Text Analysis Conference","author":"Mitamura Teruko","year":"2017"},{"key":"bib70","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-0809"},{"key":"bib71","first-page":"40","volume-title":"Proceedings of the ACL Workshop on Data and Text for Mining Integrative Biology","author":"N\u00e9dellec Clair","year":"2006"},{"key":"bib72","first-page":"1","volume-title":"Proceedings of the BioNLP Shared Task 2013 Workshop","author":"N\u00e9dellec Claire","year":"2013"},{"key":"bib73","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781316286494","volume-title":"Experience and its Modes","author":"Oakeshott Michael","year":"2015"},{"key":"bib74","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"bib75","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2017.04.010"},{"issue":"4","key":"bib76","first-page":"409","volume":"17","author":"Pustejovsky James","year":"1991","journal-title":"Computational Linguistics"},{"key":"bib77","first-page":"1","volume-title":"Proceedings of IWCS-5","author":"Pustejovsky James","year":"2003"},{"key":"bib79","volume-title":"Proceedings of the Eight Text Analysis Conference (TAC 2015)","author":"Reimers Nils","year":"2015"},{"key":"bib80","author":"Reimers Nils","year":"2017","journal-title":"arXiv preprint arXiv:1707.06799"},{"key":"bib81","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1035"},{"key":"bib82","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729586"},{"issue":"16","key":"bib83","first-page":"1","volume":"2000","author":"Roberts Jane","year":"2000","journal-title":"Studies in Modern English"},{"key":"bib84","doi-asserted-by":"publisher","DOI":"10.3115\/976973.977015"},{"key":"bib85","doi-asserted-by":"publisher","DOI":"10.3115\/977035.977059"},{"key":"bib86","first-page":"35","volume-title":"New Directions in Question Answering","author":"Schilder Frank","year":"2003"},{"key":"bib87","first-page":"26","volume-title":"Proceedings of the 6th International Conference on Knowledge Capture (K-CAP\u201911)","author":"Segers Roxane","year":"2011"},{"key":"bib88","first-page":"153","volume":"9","author":"Shaw Ryan","year":"2009","journal-title":"ASWC"},{"key":"bib89","volume-title":"Events and Periods as Concepts for Organizing Historical Knowledge","author":"Shaw Ryan Benjamin","year":"2010"},{"key":"bib90","first-page":"762","volume-title":"AMIA Annual Symposium Proceedings","volume":"2010","author":"Sohn Sunghwan","year":"2010"},{"key":"bib91","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-1005"},{"key":"bib92","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-0812"},{"key":"bib93","first-page":"212","volume-title":"Formal Representation and Digital Humanities","author":"Speranza Manuela","year":"2018"},{"key":"bib94","volume-title":"Basic Statistical Analysis","author":"Sprinthall Richard C","year":"2003"},{"key":"bib95","unstructured":"Sprugnoli, Rachele. 2018. Event Detection and Classification for the Digital Humanities. Ph.D. thesis, University of Trento."},{"key":"bib96","doi-asserted-by":"publisher","DOI":"10.31235\/osf.io\/dvb9y"},{"key":"bib97","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324916000292"},{"key":"bib98","doi-asserted-by":"publisher","DOI":"10.4000\/books.aaccademia.2469"},{"key":"bib99","unstructured":"Styler, William F. IV, Guergana Savova, Martha Palmer, James Pustejovsky, Tim O\u2019Gorman, and Piet C. de Groen. 2014. Thyme annotation guidelines. Technical report, University of Colorado at Boulder."},{"key":"bib100","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001628"},{"key":"bib101","doi-asserted-by":"publisher","DOI":"10.3115\/1071958.1071960"},{"key":"bib102","first-page":"1","volume":"21","author":"Talmy Leonard","year":"1996","journal-title":"Language and Space"},{"key":"bib103","doi-asserted-by":"publisher","DOI":"10.3115\/1699648.1699696"},{"key":"bib105","unstructured":"Tieleman, Tijmen and Geoffrey Hinton. 2012. Lecture 6.5-rmsprop, coursera: Neural networks for machine learning. University of Toronto, Technical Report."},{"key":"bib106","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S17-2098"},{"key":"bib107","first-page":"1","volume-title":"Second Joint Conference on Lexical and Computational Semantics (* SEM)","volume":"2","author":"UzZaman Naushad","year":"2013"},{"key":"bib108","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2011.03.003"},{"key":"bib109","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S15-2137"},{"key":"bib110","doi-asserted-by":"publisher","DOI":"10.2307\/2182371"},{"key":"bib111","first-page":"75","volume-title":"Computational Linguistics","author":"Verhagen Marc","year":"2007"},{"key":"bib112","first-page":"57","volume-title":"ACL 2010 - SemEval 2010 - 5th International Workshop on Semantic Evaluation, Proceedings","author":"Verhagen Marc","year":"2010"},{"key":"bib113","first-page":"58","volume-title":"Proceedings of SemEval 2013","author":"Zavarella Vanni","year":"2013"},{"key":"bib114","author":"Zeiler Matthew D.","year":"2012","journal-title":"arXiv preprint arXiv:1212.5701"},{"key":"bib115","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-016-9343-x"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/coli_a_00347","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,14]],"date-time":"2022-09-14T02:19:32Z","timestamp":1663121972000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/45\/2\/229-265\/1630"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6]]},"references-count":112,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,6]]}},"alternative-id":["10.1162\/coli_a_00347"],"URL":"https:\/\/doi.org\/10.1162\/coli_a_00347","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6]]}}}