{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:13:44Z","timestamp":1750220024630,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,3,27]],"date-time":"2023-03-27T00:00:00Z","timestamp":1679875200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,3,27]]},"DOI":"10.1145\/3555776.3578592","type":"proceedings-article","created":{"date-parts":[[2023,6,7]],"date-time":"2023-06-07T17:16:29Z","timestamp":1686158189000},"page":"902-910","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["FREDA: Flexible Relation Extraction Data Annotation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4062-1026","authenticated-orcid":false,"given":"Michael","family":"Strobl","sequence":"first","affiliation":[{"name":"University of Alberta, Edmonton, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3322-4193","authenticated-orcid":false,"given":"Amine","family":"Trabelsi","sequence":"additional","affiliation":[{"name":"University de Sherbrooke, Sherbrooke, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0060-5988","authenticated-orcid":false,"given":"Osmar","family":"Zaiane","sequence":"additional","affiliation":[{"name":"University of Alberta, Edmonton, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,6,7]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.142"},{"key":"e_1_3_2_1_2_1","unstructured":"Christoph Alt Marc H\u00fcbner and Leonhard Hennig. 2018. Improving Relation Extraction by Pre-trained Language Representations. In Automated Knowledge Base Construction (AKBC).  Christoph Alt Marc H\u00fcbner and Leonhard Hennig. 2018. Improving Relation Extraction by Pre-trained Language Representations. In Automated Knowledge Base Construction (AKBC)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/1785162.1785216"},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 5338--5345","author":"Brody Sam","year":"2021","unstructured":"Sam Brody , Sichao Wu , and Adrian Benton . 2021 . Towards Realistic Few-Shot Relation Extraction . In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 5338--5345 . Sam Brody, Sichao Wu, and Adrian Benton. 2021. Towards Realistic Few-Shot Relation Extraction. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 5338--5345."},{"volume-title":"Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)","author":"Chang Angel","key":"e_1_3_2_1_5_1","unstructured":"Angel Chang and Christopher D. Manning . 2012. SUTime: A library for recognizing and normalizing time expressions . In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12) . 3735--3740. Angel Chang and Christopher D. Manning. 2012. SUTime: A library for recognizing and normalizing time expressions. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12). 3735--3740."},{"key":"e_1_3_2_1_6_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long and Short Papers). 4171--4186. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 4171--4186."},{"key":"e_1_3_2_1_7_1","volume-title":"Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC","author":"Elsahar Hady","year":"2018","unstructured":"Hady Elsahar , Pavlos Vougiouklis , Arslen Remaci , Christophe Gravier , Jonathon Hare , Frederique Laforest , and Elena Simperl . 2018 . T-REx: A Large Scale Alignment of Natural Language with Knowledge Base Triples . In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). Hady Elsahar, Pavlos Vougiouklis, Arslen Remaci, Christophe Gravier, Jonathon Hare, Frederique Laforest, and Elena Simperl. 2018. T-REx: A Large Scale Alignment of Natural Language with Knowledge Base Triples. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)."},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 6250--6255","author":"Gao Tianyu","year":"2019","unstructured":"Tianyu Gao , Xu Han , Hao Zhu , Zhiyuan Liu , Peng Li , Maosong Sun , and Jie Zhou . 2019 . FewRel 2.0: Towards More Challenging Few-Shot Relation Classification . In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 6250--6255 . Tianyu Gao, Xu Han, Hao Zhu, Zhiyuan Liu, Peng Li, Maosong Sun, and Jie Zhou. 2019. FewRel 2.0: Towards More Challenging Few-Shot Relation Classification. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 6250--6255."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1514"},{"key":"e_1_3_2_1_10_1","volume-title":"Overview of the TAC2011 Knowledge Base Population Track. In Third text analysis conference.","author":"Ji Heng","year":"2010","unstructured":"Heng Ji , Ralph Grishman , and Hoa Trang Dang . 2010 . Overview of the TAC2011 Knowledge Base Population Track. In Third text analysis conference. Heng Ji, Ralph Grishman, and Hoa Trang Dang. 2010. Overview of the TAC2011 Knowledge Base Population Track. In Third text analysis conference."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00300"},{"key":"e_1_3_2_1_12_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2014","unstructured":"Diederik P. Kingma and Jimmy Ba . 2014 . Adam : A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_3_2_1_13_1","volume-title":"Richard Eckart de Castilho, and Iryna Gurevych","author":"Klie Jan-Christoph","year":"2018","unstructured":"Jan-Christoph Klie , Michael Bugert , Beto Boullosa , Richard Eckart de Castilho, and Iryna Gurevych . 2018 . The INCEpTION Platform: Machine- Assisted and Knowledge-Oriented Interactive Annotation. In Proceedings of the 27th International Conference on Computational Linguistics : System Demonstrations. Association for Computational Linguistics , 5--9. http:\/\/tubiblio.ulb.tu-darmstadt.de\/106270\/ Event Title : The 27th International Conference on Computational Linguistics (COLING 2018). Jan-Christoph Klie, Michael Bugert, Beto Boullosa, Richard Eckart de Castilho, and Iryna Gurevych. 2018. The INCEpTION Platform: Machine-Assisted and Knowledge-Oriented Interactive Annotation. In Proceedings of the 27th International Conference on Computational Linguistics: System Demonstrations. Association for Computational Linguistics, 5--9. http:\/\/tubiblio.ulb.tu-darmstadt.de\/106270\/ Event Title: The 27th International Conference on Computational Linguistics (COLING 2018)."},{"volume-title":"The Stanford CoreNLP Natural Language Processing Toolkit","author":"Manning Christopher D.","key":"e_1_3_2_1_14_1","unstructured":"Christopher D. Manning , Mihai Surdeanu , John Bauer , Jenny Finkel , Steven J. Bethard , and David McClosky . 2014. The Stanford CoreNLP Natural Language Processing Toolkit . In Association for Computational Linguistics (ACL) System Demonstrations . 55--60. http:\/\/www.aclweb.org\/anthology\/P\/P14\/P14-5010 Christopher D. Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven J. Bethard, and David McClosky. 2014. The Stanford CoreNLP Natural Language Processing Toolkit. In Association for Computational Linguistics (ACL) System Demonstrations. 55--60. http:\/\/www.aclweb.org\/anthology\/P\/P14\/P14-5010"},{"key":"e_1_3_2_1_15_1","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 749--758","author":"Mesquita Filipe","year":"2019","unstructured":"Filipe Mesquita , Matteo Cannaviccio , Jordan Schmidek , Paramita Mirza , and Denilson Barbosa . 2019 . Knowledgenet: A benchmark dataset for knowledge base population . In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 749--758 . Filipe Mesquita, Matteo Cannaviccio, Jordan Schmidek, Paramita Mirza, and Denilson Barbosa. 2019. Knowledgenet: A benchmark dataset for knowledge base population. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 749--758."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219748"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1005"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/1889788.1889799"},{"key":"e_1_3_2_1_19_1","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 3702--3710","author":"Rosenman Shachar","year":"2020","unstructured":"Shachar Rosenman , Alon Jacovi , and Yoav Goldberg . 2020 . Exposing Shallow Heuristics of Relation Extraction Models with Challenge Data . In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 3702--3710 . Shachar Rosenman, Alon Jacovi, and Yoav Goldberg. 2020. Exposing Shallow Heuristics of Relation Extraction Models with Challenge Data. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 3702--3710."},{"key":"e_1_3_2_1_20_1","volume-title":"Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL","author":"Kim Sang Erik Tjong","year":"2003","unstructured":"Erik Tjong Kim Sang and Fien De Meulder . 2003 . Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition . In Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003. 142--147. Erik Tjong Kim Sang and Fien De Meulder. 2003. Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition. In Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003. 142--147."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1279"},{"key":"e_1_3_2_1_22_1","volume-title":"Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics. 102--107","author":"Stenetorp Pontus","year":"2012","unstructured":"Pontus Stenetorp , Sampo Pyysalo , Goran Topi\u0107 , Tomoko Ohta , Sophia Ananiadou , and Jun'ichi Tsujii . 2012 . BRAT: a web-based tool for NLP-assisted text annotation . In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics. 102--107 . Pontus Stenetorp, Sampo Pyysalo, Goran Topi\u0107, Tomoko Ohta, Sophia Ananiadou, and Jun'ichi Tsujii. 2012. BRAT: a web-based tool for NLP-assisted text annotation. In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics. 102--107."},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of The 12th Language Resources and Evaluation Conference. 1951--1958","author":"Strobl Michael","year":"2020","unstructured":"Michael Strobl , Amine Trabelsi , and Osmar R Za\u00efane . 2020 . WEXEA: Wikipedia EXhaustive Entity Annotation . In Proceedings of The 12th Language Resources and Evaluation Conference. 1951--1958 . Michael Strobl, Amine Trabelsi, and Osmar R Za\u00efane. 2020. WEXEA: Wikipedia EXhaustive Entity Annotation. In Proceedings of The 12th Language Resources and Evaluation Conference. 1951--1958."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.444"},{"volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. 35--45","author":"Zhang Yuhao","key":"e_1_3_2_1_25_1","unstructured":"Yuhao Zhang , Victor Zhong , Danqi Chen , Gabor Angeli , and Christopher D. Manning . 2017. Position-aware attention and supervised data improve slot filling . In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. 35--45 . Yuhao Zhang, Victor Zhong, Danqi Chen, Gabor Angeli, and Christopher D. Manning. 2017. Position-aware attention and supervised data improve slot filling. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. 35--45."}],"event":{"name":"SAC '23: 38th ACM\/SIGAPP Symposium on Applied Computing","sponsor":["SIGAPP ACM Special Interest Group on Applied Computing"],"location":"Tallinn Estonia","acronym":"SAC '23"},"container-title":["Proceedings of the 38th ACM\/SIGAPP Symposium on Applied Computing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3555776.3578592","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3555776.3578592","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:35Z","timestamp":1750182695000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3555776.3578592"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,27]]},"references-count":25,"alternative-id":["10.1145\/3555776.3578592","10.1145\/3555776"],"URL":"https:\/\/doi.org\/10.1145\/3555776.3578592","relation":{},"subject":[],"published":{"date-parts":[[2023,3,27]]},"assertion":[{"value":"2023-06-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}