{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T00:31:59Z","timestamp":1760229119965,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2022,5,31]],"date-time":"2022-05-31T00:00:00Z","timestamp":1653955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Shanghai Science Committee","award":["22N51900200"],"award-info":[{"award-number":["22N51900200"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Event detection is an important task in the field of natural language processing, which aims to detect trigger words in a sentence and classify them into specific event types. Event detection tasks suffer from data sparsity and event instances imbalance problems in small-scale datasets. For this reason, the correlation information of event types can be used to alleviate the above problems. In this paper, we design a Hierarchical Attention Neural Network for Event Types (HANN-ET). Specifically, we select Long Short-Term Memory (LSTM) as the semantic encoder and utilize dynamic multi-pooling and the Graph Attention Network (GAT) to enrich the sentence feature. Meanwhile, we build several upper-level event type modules and employ a weighted attention aggregation mechanism to integrate these modules to obtain the correlation event type information. Each upper-level module is completed by a Neural Module Network (NMNs), event types within the same upper-level module can share information, and an attention aggregation mechanism can provide effective bias scores for the trigger word classifier. We conduct extensive experiments on the ACE2005 and the MAVEN datasets, and the results show that our approach outperforms previous state-of-the-art methods and achieves the competitive F1 scores of 78.9% on the ACE2005 dataset and 68.8% on the MAVEN dataset.<\/jats:p>","DOI":"10.3390\/s22114202","type":"journal-article","created":{"date-parts":[[2022,6,1]],"date-time":"2022-06-01T21:43:42Z","timestamp":1654119822000},"page":"4202","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Hierarchical Attention Neural Network for Event Types to Improve Event Detection"],"prefix":"10.3390","volume":"22","author":[{"given":"Yanliang","family":"Jin","sequence":"first","affiliation":[{"name":"Key Laboratory of Specialty Fiber Optics and Optical Access Networks, Joint International Research Laboratory of Specialty Fiber Optics and Advanced Communication, Shanghai University, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinjin","family":"Ye","sequence":"additional","affiliation":[{"name":"Key Laboratory of Specialty Fiber Optics and Optical Access Networks, Joint International Research Laboratory of Specialty Fiber Optics and Advanced Communication, Shanghai University, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liquan","family":"Shen","sequence":"additional","affiliation":[{"name":"Key Laboratory of Specialty Fiber Optics and Optical Access Networks, Joint International Research Laboratory of Specialty Fiber Optics and Advanced Communication, Shanghai University, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yong","family":"Xiong","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lele","family":"Fan","sequence":"additional","affiliation":[{"name":"Key Laboratory of Specialty Fiber Optics and Optical Access Networks, Joint International Research Laboratory of Specialty Fiber Optics and Advanced Communication, Shanghai University, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingfu","family":"Zang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Specialty Fiber Optics and Optical Access Networks, Joint International Research Laboratory of Specialty Fiber Optics and Advanced Communication, Shanghai University, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wang, X., Wang, Z., Han, X., Jiang, W., Han, R., Liu, Z., and Zhou, J. (2020, January 16\u201320). MAVEN: A Massive General Domain Event Detection Dataset. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2020.emnlp-main.129"},{"key":"ref_2","unstructured":"Liao, S., and Grishman, R. (2010, January 11\u201316). Using document level cross-event inference to improve event extraction. Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, Uppsala, Sweden."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Liu, S., Liu, K., He, S., and Zhao, J. (2016, January 13). A probabilistic soft logic based approach to exploiting latent and global information in event classification. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10375"},{"key":"ref_4","unstructured":"Li, Q., Ji, H., and Huang, L. (2013, January 4\u20139). Joint event extraction via structured prediction with global features. Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, Sofia, Bulgaria."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liu, S., Chen, Y., Liu, K., Zhao, J., Luo, Z., and Luo, W. (2017, January 13\u201315). Improving event detection via information sharing among related event types. Proceedings of the Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data, Nanjing, China.","DOI":"10.1007\/978-3-319-69005-6_11"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Deng, S., Zhang, N., Li, L., Chen, H., Tou, H., Chen, M., Huang, F., and Chen, H. (2021, January 1\u20136). OntoED: Low-resource Event Detection with Ontology Embedding. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Virtual Event.","DOI":"10.18653\/v1\/2021.acl-long.220"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Han, X., Yu, P., Liu, Z., Sun, M., and Li, P. (November, January 31). Hierarchical relation extraction with coarse-to-fine grained attention. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1247"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, X., Wang, Z., Han, X., Liu, Z., Li, J., Li, P., and Ren, X. (2019, January 3\u20137). HMEAE: Hierarchical modular event argument extraction. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China.","DOI":"10.18653\/v1\/D19-1584"},{"key":"ref_9","unstructured":"Andreas, J., Rohrbach, M., Darrell, T., and Klein, D. (July, January 26). Neural module networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_10","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., and Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, The MIT Press."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Mehta, S., Islam, M.R., Rangwala, H., and Ramakrishnan, N. (2019, January 13\u201317). Event detection using hierarchical multi-aspect attention. Proceedings of the World Wide Web Conference, San Francisco, CA, USA.","DOI":"10.1145\/3308558.3313659"},{"key":"ref_12","unstructured":"Veli\u010dkovi\u0107, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., and Bengio, Y. (May, January 30). Graph attention networks. Proceedings of the International Conference on Learning Representations, Vancouver Convention Center, Vancouver, ON, Canada."},{"key":"ref_13","first-page":"84","article-title":"A method of extracting financial event information based on lexical-semantic model","volume":"38","author":"Ming","year":"2018","journal-title":"Comput. Appl."},{"key":"ref_14","first-page":"92","article-title":"Chinese text event information extraction based on hidden Markov model","volume":"24","author":"Jiangde","year":"2007","journal-title":"Microelectron. Comput."},{"key":"ref_15","first-page":"445","article-title":"Chinese event type recognition based on conditional random field","volume":"25","author":"Hu","year":"2012","journal-title":"Pattern Recognit. Artif. Intell."},{"key":"ref_16","first-page":"1","article-title":"A survey on deep learning: Algorithms, techniques, and applications","volume":"51","author":"Pouyanfar","year":"2018","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chen, Y., Xu, L., Liu, K., Zeng, D., and Zhao, J. (2015, January 26\u201331). Event extraction via dynamic multi-pooling convolutional neural networks. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China.","DOI":"10.3115\/v1\/P15-1017"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Nguyen, T.H., Cho, K., and Grishman, R. (2016, January 12\u201317). Joint event extraction via recurrent neural networks. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.","DOI":"10.18653\/v1\/N16-1034"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Nguyen, T.H., and Grishman, R. (2018, January 2\u20137). Graph convolutional networks with argument-aware pooling for event detection. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12039"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, X., Luo, Z., and Huang, H. (November, January 31). Jointly multiple events extraction via attention-based graph information aggregation. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1156"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yan, H., Jin, X., Meng, X., Guo, J., and Cheng, X. (2019, January 3\u20137). Event detection with multi-order graph convolution and aggregated attention. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China.","DOI":"10.18653\/v1\/D19-1582"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cui, S., Yu, B., Liu, T., Zhang, Z., Wang, X., and Shi, J. (2020, January 16\u201320). Edge-Enhanced Graph Convolution Networks for Event Detection with Syntactic Relation. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, Online.","DOI":"10.18653\/v1\/2020.findings-emnlp.211"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Jin, X., Wang, Y., and Cheng, X. (2018, January 15\u201320). Document embedding enhanced event detection with hierarchical and supervised attention. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia.","DOI":"10.18653\/v1\/P18-2066"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chen, Y., Yang, H., Liu, K., Zhao, J., and Jia, Y. (November, January 31). Collective event detection via a hierarchical and bias tagging networks with gated multi-level attention mechanisms. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1158"},{"key":"ref_26","first-page":"756","article-title":"Learning to select important context words for event detection","volume":"12085","author":"Ngo","year":"2020","journal-title":"Adv. Knowl. Discov. Data Min."},{"key":"ref_27","unstructured":"Jang, E., Gu, S., and Poole, B. (2017, January 24\u201326). Categorical reparameterization with Gumbel-softmax. Proceedings of the International Conference on Learning Representations, Palais des Congr\u00e8s Neptune, Toulon, France."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Deng, S., Zhang, N., Kang, J., Zhang, Y., Zhang, W., and Chen, H. (2020, January 3\u20137). Meta-learning with dynamic-memory-based prototypical network for few-shot event detection. Proceedings of the 13th International Conference on Web Search and Data Mining, Houston, TX, USA.","DOI":"10.1145\/3336191.3371796"},{"key":"ref_29","first-page":"233","article-title":"Exploiting the matching information in the support set for few shot event classification","volume":"12085","author":"Lai","year":"2020","journal-title":"Adv. Knowl. Discov. Data Min."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wang, X., Han, X., Liu, Z., Sun, M., and Li, P. (2019, January 2\u20137). Adversarial training for weakly supervised event detection. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota.","DOI":"10.18653\/v1\/N19-1105"},{"key":"ref_31","unstructured":"Jacob, D., Chang, M.-W., Lee, K., and Kristina, T. (2019, January 2\u20137). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, Z., Wang, X., Han, X., Lin, Y., Hou, L., Liu, Z., Li, P., Li, J., and Zhou, J. (2021, January 1\u20136). CLEVE: Contrastive Pre-training for Event Extraction. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Online Event.","DOI":"10.18653\/v1\/2021.acl-long.491"},{"key":"ref_33","first-page":"e26752","article-title":"The New York Times Annotated Corpus","volume":"6","author":"Sandhaus","year":"2008","journal-title":"Linguist. Data Consort."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xu, D., Li, J., Zhu, M., Zhang, M., and Zhou, G. (2020, January 16\u201320). Improving AMR Parsing with Sequence-to-Sequence Pre-training. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, Online Event.","DOI":"10.18653\/v1\/2020.emnlp-main.196"},{"key":"ref_35","unstructured":"Tong, M., Wang, S., Cao, Y., Xu, B., Li, J., Hou, L., and Chua, T.S. (2020, January 7\u201312). Image enhanced event detection in news articles. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., and Hovy, E. (2016, January 12\u201317). Hierarchical attention networks for document classification. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.","DOI":"10.18653\/v1\/N16-1174"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Luong, M.T., Pham, H., and Manning, C.D. (2015, January 17\u201321). Effective approaches to attention-based neural machine translation. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.","DOI":"10.18653\/v1\/D15-1166"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4202\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:22:58Z","timestamp":1760138578000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4202"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,31]]},"references-count":37,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22114202"],"URL":"https:\/\/doi.org\/10.3390\/s22114202","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,5,31]]}}}