{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T15:21:05Z","timestamp":1777648865798,"version":"3.51.4"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,6,2]],"date-time":"2022-06-02T00:00:00Z","timestamp":1654128000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,6,2]],"date-time":"2022-06-02T00:00:00Z","timestamp":1654128000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"BBSRC Japan Partnering Award","award":["BB\/P025684\/1"],"award-info":[{"award-number":["BB\/P025684\/1"]}]},{"DOI":"10.13039\/100012338","name":"Alan Turing Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100012338","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Artificial Intelligence Research Center, AIST, Japan"},{"name":"University of the Philippines System Doctoral Studies Fund"},{"name":"Atypon Systems Limited, UK"},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["CASE award"],"award-info":[{"award-number":["CASE award"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Nested and overlapping events are particularly frequent and informative structures in biomedical event extraction. However, state-of-the-art neural models either neglect those structures during learning or use syntactic features and external tools to detect them. To overcome these limitations, this paper presents and compares two neural models: a novel EXhaustive Neural Network (EXNN) and a Search-Based Neural Network (SBNN) for detection of nested and overlapping events.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We evaluate the proposed models as an event detection component in isolation and within a pipeline setting. Evaluation in several annotated biomedical event extraction datasets shows that both EXNN and SBNN achieve higher performance in detecting nested and overlapping events, compared to the state-of-the-art model Turku Event Extraction System (TEES).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The experimental results reveal that both EXNN and SBNN are effective for biomedical event extraction. Furthermore, results on a pipeline setting indicate that our models improve detection of events compared to models that use either gold or predicted named entities.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12859-022-04746-3","type":"journal-article","created":{"date-parts":[[2022,6,2]],"date-time":"2022-06-02T11:06:55Z","timestamp":1654168015000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Comparing neural models for nested and overlapping biomedical event detection"],"prefix":"10.1186","volume":"23","author":[{"given":"Kurt","family":"Espinosa","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Panagiotis","family":"Georgiadis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fenia","family":"Christopoulou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Meizhi","family":"Ju","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Makoto","family":"Miwa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sophia","family":"Ananiadou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,6,2]]},"reference":[{"issue":"5560","key":"4746_CR1","doi-asserted-by":"publisher","first-page":"1662","DOI":"10.1126\/science.1069492","volume":"295","author":"H Kitano","year":"2002","unstructured":"Kitano H. Systems biology: a brief overview. Science. 2002;295(5560):1662\u20134.","journal-title":"Science"},{"issue":"11","key":"4746_CR2","doi-asserted-by":"publisher","first-page":"1587","DOI":"10.1093\/bioinformatics\/btu061","volume":"30","author":"D Zhou","year":"2014","unstructured":"Zhou D, Zhong D, He Y. Event trigger identification for biomedical events extraction using domain knowledge. Bioinformatics. 2014;30(11):1587\u201394.","journal-title":"Bioinformatics"},{"key":"4746_CR3","doi-asserted-by":"publisher","unstructured":"Ju M, Miwa M, Ananiadou S. A neural layered model for nested named entity recognition. In: Proceedings of the conference of the North American chapter of the association for computational linguistics: human language technologies, vol. 1 (Long Papers); 2018. p. 1446\u20131459. https:\/\/doi.org\/10.18653\/v1\/N18-1131.","DOI":"10.18653\/v1\/N18-1131"},{"issue":"18","key":"4746_CR4","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1093\/bioinformatics\/btq382","volume":"26","author":"L Tari","year":"2010","unstructured":"Tari L, Anwar S, Liang S, Cai J, Baral C. Discovering drug-drug interactions: a text-mining and reasoning approach based on properties of drug metabolism. Bioinformatics. 2010;26(18):547\u201353.","journal-title":"Bioinformatics"},{"key":"4746_CR5","doi-asserted-by":"crossref","unstructured":"Giles CB, Wren JD. Large-scale directional relationship extraction and resolution. In: BMC Bioinformatics, vol. 9; 2008. Springer. p. 11.","DOI":"10.1186\/1471-2105-9-S9-S11"},{"key":"4746_CR6","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1186\/1471-2105-7-S3-S5","volume":"7","author":"KB Cohen","year":"2006","unstructured":"Cohen KB, Hunter L. A critical review of Pasbio\u2019s argument structures for biomedical verbs. BMC Bioinform. 2006;7:5. https:\/\/doi.org\/10.1186\/1471-2105-7-S3-S5.","journal-title":"BMC Bioinform"},{"issue":"7","key":"4746_CR7","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1016\/j.tibtech.2010.04.005","volume":"28","author":"S Ananiadou","year":"2010","unstructured":"Ananiadou S, Pyysalo S, Tsujii J, Kell DB. Event extraction for systems biology by text mining the literature. Trends Biotechnol. 2010;28(7):381\u201390.","journal-title":"Trends Biotechnol"},{"issue":"3","key":"4746_CR8","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1093\/bfgp\/elu015","volume":"14","author":"S Ananiadou","year":"2014","unstructured":"Ananiadou S, Thompson P, Nawaz R, McNaught J, Kell DB. Event-based text mining for biology and functional genomics. Brief Funct Genomics. 2014;14(3):213\u201330.","journal-title":"Brief Funct Genomics"},{"key":"4746_CR9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2015\/571381","volume":"2015","author":"J Vanegas","year":"2015","unstructured":"Vanegas J, Matos S, Gonz\u00e1lez F, Oliveira J. An overview of biomolecular event extraction from scientific documents. Comput Math Methods Med. 2015;2015:1\u201319. https:\/\/doi.org\/10.1155\/2015\/571381.","journal-title":"Comput Math Methods Med"},{"key":"4746_CR10","doi-asserted-by":"crossref","unstructured":"Kim JD, Ohta T, Pyysalo S, Kano Y, Tsujii J. Overview of BioNLP\u201909 shared task on event extraction. In: Proceedings of the workshop on current trends in biomedical natural language processing: shared task, 2009. p. 1\u20139.","DOI":"10.3115\/1572340.1572342"},{"key":"4746_CR11","doi-asserted-by":"crossref","unstructured":"Kim JD, Pyysalo S, Ohta T, Bossy R, Nguyen N, Tsujii J. Overview of BioNLP shared task 2011. In: Proceedings of BioNLP shared task workshop; 2011. p. 1\u20136.","DOI":"10.3115\/1572340.1572342"},{"key":"4746_CR12","unstructured":"N\u00e9dellec C, Bossy R, Kim JD, Kim JJ, Ohta T, Pyysalo S, Zweigenbaum P. Overview of bionlp shared task 2013. In: Proceedings of the BioNLP shared task workshop; 2013. p. 1\u20137."},{"key":"4746_CR13","unstructured":"McClosky D, Surdeanu M, Manning CD. Event extraction as dependency parsing. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies; 2011. p. 1626\u201335."},{"issue":"10","key":"4746_CR14","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1186\/1471-2105-16-S10-S2","volume":"16","author":"S Pyysalo","year":"2015","unstructured":"Pyysalo S, Ohta T, Rak R, Rowley A, Chun H-W, Jung S-J, Choi S-P, Tsujii J, Ananiadou S. Overview of the cancer genetics and pathway curation tasks of bionlp shared task 2013. BMC Bioinform. 2015;16(10):2.","journal-title":"BMC Bioinform"},{"key":"4746_CR15","doi-asserted-by":"publisher","unstructured":"Bj\u00f6rne J, Salakoski T. Biomedical event extraction using convolutional neural networks and dependency parsing. In: Proceedings of the BioNLP 2018 workshop; 2018. p. 98\u2013108. https:\/\/doi.org\/10.18653\/v1\/W18-2311.","DOI":"10.18653\/v1\/W18-2311"},{"key":"4746_CR16","doi-asserted-by":"publisher","unstructured":"Rao S, Marcu D, Knight K, Daum\u00e9\u00a0III H. Biomedical event extraction using abstract meaning representation. In: BioNLP 2017. p. 126\u201335. https:\/\/doi.org\/10.18653\/v1\/W17-2315.","DOI":"10.18653\/v1\/W17-2315"},{"key":"4746_CR17","unstructured":"Riedel S, McCallum A. Robust biomedical event extraction with dual decomposition and minimal domain adaptation. In: Proceedings of the shared task workshop on biomedical natural language processing; 2011. p. 46\u201350."},{"issue":"11","key":"4746_CR18","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1186\/1471-2105-13-S11-S5","volume":"13","author":"A Vlachos","year":"2012","unstructured":"Vlachos A, Craven M. Biomedical event extraction from abstracts and full papers using search-based structured prediction. BMC Bioinform. 2012;13(11):5. https:\/\/doi.org\/10.1186\/1471-2105-13-S11-S5.","journal-title":"BMC Bioinform"},{"key":"4746_CR19","doi-asserted-by":"publisher","unstructured":"Venugopal D, Chen C, Gogate V, Ng V. Relieving the computational bottleneck: joint inference for event extraction with high-dimensional features. In: Proceedings of the conference on empirical methods in natural language processing; 2014. p. 831\u201343. https:\/\/doi.org\/10.3115\/v1\/D14-1090.","DOI":"10.3115\/v1\/D14-1090"},{"key":"4746_CR20","doi-asserted-by":"crossref","unstructured":"Trieu HL, Tran TT, Duong KN, Nguyen A, Miwa M, Ananiadou S. Deepeventmine: end-to-end neural nested event extraction from biomedical texts. Bioinformatics. 2020.","DOI":"10.1093\/bioinformatics\/btaa540"},{"key":"4746_CR21","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-020-3376-2","author":"L Zhu","year":"2020","unstructured":"Zhu L, Zheng H. Biomedical event extraction with a novel combination strategy based on hybrid deep neural networks. BMC Bioinform. 2020. https:\/\/doi.org\/10.1186\/s12859-020-3376-2.","journal-title":"BMC Bioinform"},{"key":"4746_CR22","doi-asserted-by":"publisher","unstructured":"Zhao Y, Jin X, Wang Y, Cheng X. Document embedding enhanced event detection with hierarchical and supervised attention. In: Proceedings of the annual meeting of the association for computational linguistics, vol. 2 (short papers), Association for Computational Linguistics; 2018. p. 414\u20139. https:\/\/doi.org\/10.18653\/v1\/P18-2066.","DOI":"10.18653\/v1\/P18-2066"},{"key":"4746_CR23","doi-asserted-by":"crossref","unstructured":"Nguyen TM, Nguyen TH. One for all: neural joint modeling of entities and events. In: Proceedings of the AAAI conference on artificial intelligence, vol. 33; 2019. p. 6851\u20138.","DOI":"10.1609\/aaai.v33i01.33016851"},{"key":"4746_CR24","doi-asserted-by":"crossref","unstructured":"Miwa M, Thompson P, Korkontzelos I, Ananiadou S. Comparable study of event extraction in newswire and biomedical domains. In: Proceedings of the international conference on computational linguistics: technical papers; 2014. p. 2270\u20139.","DOI":"10.1093\/oxfordhb\/9780199573691.013.004"},{"key":"4746_CR25","doi-asserted-by":"publisher","unstructured":"Espinosa KJ, Miwa M, Ananiadou S. A search-based neural model for biomedical nested and overlapping event detection. In: Proceedings of the conference on empirical methods in natural language processing and the international joint conference on natural language processing; 2019. p. 3679\u201386. https:\/\/doi.org\/10.18653\/v1\/D19-1381.","DOI":"10.18653\/v1\/D19-1381"},{"key":"4746_CR26","doi-asserted-by":"publisher","unstructured":"Nivre J. Inductive dependency parsing, text, speech and language technology, vol. 34, 1st edn.; Springer, Netherlands. 2006. https:\/\/doi.org\/10.1007\/1-4020-4889-0.","DOI":"10.1007\/1-4020-4889-0"},{"key":"4746_CR27","doi-asserted-by":"crossref","unstructured":"Sagae K, Tsujii J. Shift-reduce dependency dag parsing. In: Proceedings of the international conference on computational linguistics; 2008. p. 753\u2013760.","DOI":"10.3115\/1599081.1599176"},{"key":"4746_CR28","doi-asserted-by":"crossref","unstructured":"Wang Y, Che W, Guo J, Liu T. A neural transition-based approach for semantic dependency graph parsing. In: Proceedings of the AAAI conference on artificial intelligence; 2018.","DOI":"10.1609\/aaai.v32i1.11968"},{"issue":"8","key":"4746_CR29","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735\u201380.","journal-title":"Neural Comput"},{"key":"4746_CR30","doi-asserted-by":"crossref","unstructured":"Tai KS, Socher R, Manning CD. Improved semantic representations from tree-structured long short-term memory networks. In: Proceedings of the annual meeting of the association for computational linguistics and the international joint conference on natural language processing, vol. 1 (long papers); 2015. p. 1556\u20131566.","DOI":"10.3115\/v1\/P15-1150"},{"issue":"11","key":"4746_CR31","doi-asserted-by":"publisher","first-page":"558","DOI":"10.1145\/368996.369025","volume":"5","author":"AB Kahn","year":"1962","unstructured":"Kahn AB. Topological sorting of large networks. Commun ACM. 1962;5(11):558\u201362.","journal-title":"Commun ACM"},{"issue":"2","key":"4746_CR32","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/BF00268499","volume":"6","author":"RE Tarjan","year":"1976","unstructured":"Tarjan RE. Edge-disjoint spanning trees and depth-first search. Acta Informatica. 1976;6(2):171\u201385.","journal-title":"Acta Informatica"},{"issue":"01","key":"4746_CR33","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1142\/S0219720010004586","volume":"8","author":"M Miwa","year":"2010","unstructured":"Miwa M, S\u00e6tre R, Kim J-D, Tsujii J. Event extraction with complex event classification using rich features. J Bioinform Comput Biol. 2010;8(01):131\u201346.","journal-title":"J Bioinform Comput Biol"},{"key":"4746_CR34","doi-asserted-by":"crossref","unstructured":"Christopoulou F. Miwa M, Ananiadou S. A walk-based model on entity graphs for relation extraction. In: Proceedings of the annual meeting of the association for computational linguistics, vol. 2 (short papers); 2018. p. 81\u201388.","DOI":"10.18653\/v1\/P18-2014"},{"key":"4746_CR35","doi-asserted-by":"crossref","unstructured":"Minkov E, Wang R, Tomasic A, Cohen W. NER systems that suit user\u2019s preferences: adjusting the recall-precision trade-off for entity extraction. In: Proceedings of the human language technology conference of the NAACL, companion volume: short papers; 2006. p. 93\u20136.","DOI":"10.3115\/1614049.1614073"},{"key":"4746_CR36","unstructured":"Snoek J, Larochelle H, Adams RP. Practical Bayesian optimization of machine learning algorithms. In: Proceedings of the international conference on neural information processing systems, vol. 2, NIPS\u201912; 2012. p. 2951\u201359."},{"key":"4746_CR37","doi-asserted-by":"crossref","unstructured":"Yeh A. More accurate tests for the statistical significance of result differences. In: Proceedings of the international conference on computational linguistics, vol. 2; 2000. p. 947\u2013953.","DOI":"10.3115\/992730.992783"},{"key":"4746_CR38","doi-asserted-by":"crossref","unstructured":"Muis AO, Lu W. Learning to recognize discontiguous entities. In: Proceedings of the conference on empirical methods in natural language processing; 2016. p. 75\u201384.","DOI":"10.18653\/v1\/D16-1008"},{"key":"4746_CR39","doi-asserted-by":"publisher","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K. BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the conference of the North American chapter of the association for computational linguistics: human language technologies, vol. 1 (long and short papers); 2019. p. 4171\u20134186. https:\/\/doi.org\/10.18653\/v1\/N19-1423.","DOI":"10.18653\/v1\/N19-1423"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-022-04746-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-022-04746-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-022-04746-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T09:07:34Z","timestamp":1727341654000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-022-04746-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,2]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["4746"],"URL":"https:\/\/doi.org\/10.1186\/s12859-022-04746-3","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,2]]},"assertion":[{"value":"18 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 May 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 June 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"211"}}