{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T20:01:40Z","timestamp":1776283300481,"version":"3.50.1"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"S13","license":[{"start":{"date-parts":[[2020,9,1]],"date-time":"2020-09-01T00:00:00Z","timestamp":1598918400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,17]],"date-time":"2020-09-17T00:00:00Z","timestamp":1600300800000},"content-version":"vor","delay-in-days":16,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2020,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>Biomedical document triage is the foundation of biomedical information extraction, which is important to precision medicine. Recently, some neural networks-based methods have been proposed to classify biomedical documents automatically. In the biomedical domain, documents are often very long and often contain very complicated sentences. However, the current methods still find it difficult to capture important features across sentences.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>In this paper, we propose a hierarchical attention-based capsule model for biomedical document triage. The proposed model effectively employs hierarchical attention mechanism and capsule networks to capture valuable features across sentences and construct a final latent feature representation for a document. We evaluated our model on three public corpora.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusions<\/jats:title>\n<jats:p>Experimental results showed that both hierarchical attention mechanism and capsule networks are helpful in biomedical document triage task. Our method proved itself highly competitive or superior compared with other state-of-the-art methods.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12859-020-03673-5","type":"journal-article","created":{"date-parts":[[2020,9,17]],"date-time":"2020-09-17T00:03:04Z","timestamp":1600300984000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Biomedical document triage using a hierarchical attention-based capsule network"],"prefix":"10.1186","volume":"21","author":[{"given":"Jian","family":"Wang","sequence":"first","affiliation":[]},{"given":"Mengying","family":"Li","sequence":"additional","affiliation":[]},{"given":"Qishuai","family":"Diao","sequence":"additional","affiliation":[]},{"given":"Hongfei","family":"Lin","sequence":"additional","affiliation":[]},{"given":"Zhihao","family":"Yang","sequence":"additional","affiliation":[]},{"given":"YiJia","family":"Zhang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,9,17]]},"reference":[{"key":"3673_CR1","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1007\/978-981-10-1503-8_7","volume":"939","author":"M Simmons","year":"2016","unstructured":"Simmons M, Singhal A, Lu Z. Text mining for precision medicine: Bringing structure to ehrs and biomedical literature to understand genes and health. Adv Exp Med Biol. 2016; 939:139\u201366.","journal-title":"Adv Exp Med Biol"},{"issue":"11","key":"3673_CR2","doi-asserted-by":"publisher","first-page":"1005017","DOI":"10.1371\/journal.pcbi.1005017","volume":"12","author":"S Ayush","year":"2016","unstructured":"Ayush S, Michael S, Zhiyong L, Andrey R. Text mining genotype-phenotype relationships from biomedical literature for database curation and precision medicine. PLoS Comput Biol. 2016; 12(11):1005017.","journal-title":"PLoS Comput Biol"},{"issue":"9","key":"3673_CR3","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1056\/NEJMp1500523","volume":"372","author":"FS Collins","year":"2015","unstructured":"Collins FS, Varmus H. A new initiative on precision medicine. N Engl J Med. 2015; 372(9):793\u20135.","journal-title":"N Engl J Med"},{"key":"3673_CR4","volume-title":"Biocomputing 2000","author":"TC Rindflesch","year":"1999","unstructured":"Rindflesch TC, Tanabe L, Weinstein JN, Hunter L. Edgar: extraction of drugs, genes and relations from the biomedical literature. In: Biocomputing 2000. Singapore: World Scientific: 1999. p. 517\u201328."},{"issue":"6","key":"3673_CR5","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1016\/j.jbi.2004.08.004","volume":"37","author":"M Krauthammer","year":"2004","unstructured":"Krauthammer M, Nenadic G. Term identification in the biomedical literature. J Biomed Inform. 2004; 37(6):512\u201326.","journal-title":"J Biomed Inform"},{"key":"3673_CR6","volume-title":"TREC, vol. 500\u2013261","author":"AM Cohen","year":"2004","unstructured":"Cohen AM, Bhupatiraju RT, Hersh WR. Feature generation, feature selection, classifiers, and conceptual drift for biomedical document triage. In: TREC, vol. 500\u2013261. America: National Institute of Standards and Technology (NIST): 2004."},{"key":"3673_CR7","volume-title":"AMIA Annual Symposium Proceedings. vol. 2006","author":"AM Cohen","year":"2006","unstructured":"Cohen AM. An effective general purpose approach for automated biomedical document classification. In: AMIA Annual Symposium Proceedings. vol. 2006. America: American Medical Informatics Association: 2006. p. 161."},{"issue":"2","key":"3673_CR8","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/gb-2008-9-s2-s4","volume":"9","author":"M Krallinger","year":"2008","unstructured":"Krallinger M, Leitner F, Rodriguez-Penagos C, Valencia A. Overview of the protein-protein interaction annotation extraction task of biocreative ii. Genome Biol. 2008; 9(2):4.","journal-title":"Genome Biol"},{"issue":"8","key":"3673_CR9","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1186\/1471-2105-12-S8-S3","volume":"12","author":"M Krallinger","year":"2011","unstructured":"Krallinger M, Vazquez M, Leitner F, Salgado D, Chatr-Aryamontri A, Winter A, Perfetto L, Briganti L, Licata L, Iannuccelli M, et al. The protein-protein interaction tasks of biocreative iii: classification\/ranking of articles and linking bio-ontology concepts to full text. BMC bioinformatics. 2011; 12(8):3.","journal-title":"BMC bioinformatics"},{"key":"3673_CR10","doi-asserted-by":"crossref","unstructured":"Islamaj Do\u011fan R, Kim S, Chatr-aryamontri A, Wei C-H, Comeau DC, Antunes R, Matos S, Chen Q, Elangovan A, Panyam NC, et al. Overview of the biocreative vi precision medicine track: mining protein interactions and mutations for precision medicine. Database. 2019; 147(2019).","DOI":"10.1093\/database\/bay147"},{"issue":"1","key":"3673_CR11","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1093\/bib\/bbv024","volume":"17","author":"C-C Huang","year":"2015","unstructured":"Huang C-C, Lu Z. Community challenges in biomedical text mining over 10 years: success, failure and the future. Brief Bioinform. 2015; 17(1):132\u201344.","journal-title":"Brief Bioinform"},{"key":"3673_CR12","volume-title":"TREC","author":"L Si","year":"2005","unstructured":"Si L, Kanungo T. Thresholding strategies for text classifiers: Trec 2005 biomedical triage task experiments. In: TREC. America: National Institute of Standards and Technology (NIST): 2005."},{"issue":"12","key":"3673_CR13","doi-asserted-by":"publisher","first-page":"115892","DOI":"10.1371\/journal.pone.0115892","volume":"9","author":"H Almeida","year":"2014","unstructured":"Almeida H, Meurs M-J, Kosseim L, Butler G, Tsang A. Machine learning for biomedical literature triage. PLoS ONE. 2014; 9(12):115892.","journal-title":"PLoS ONE"},{"issue":"7553","key":"3673_CR14","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015; 521(7553):436\u201344.","journal-title":"Nature"},{"key":"3673_CR15","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP","author":"Y Kim","year":"2014","unstructured":"Kim Y. Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP. Doha: ACL: 2014. p. 1746\u201351."},{"key":"3673_CR16","volume-title":"Twenty-ninth AAAI Conference on Artificial Intelligence","author":"S Lai","year":"2015","unstructured":"Lai S, Xu L, Liu K, Zhao J. Recurrent convolutional neural networks for text classification. In: Twenty-ninth AAAI Conference on Artificial Intelligence. Austin: AAAI Press: 2015."},{"key":"3673_CR17","volume-title":"2016 23rd International Conference on Pattern Recognition (ICPR)","author":"A Ekbal","year":"2016","unstructured":"Shweta, Ekbal A, Saha S, Bhattacharyya P. A deep learning architecture for protein-protein interaction article identification. In: 2016 23rd International Conference on Pattern Recognition (ICPR). Mexico: IEEE: 2016."},{"key":"3673_CR18","volume-title":"ACM Conference Bioinform","author":"A Rios","year":"2015","unstructured":"Rios A, Kavuluru R. Convolutional neural networks for biomedical text classification:application in indexing biomedical articles. In: ACM Conference Bioinform. Atlanta: ACM: 2015."},{"issue":"11","key":"3673_CR19","doi-asserted-by":"publisher","first-page":"1279","DOI":"10.1093\/jamia\/ocz085","volume":"26","author":"J Du","year":"2019","unstructured":"Du J, Chen Q, Peng Y, Xiang Y, Tao C, Lu Z. Ml-net: multi-label classification of biomedical texts with deep neural networks. J Am Med Inform Assoc JAMIA. 2019; 26(11):1279\u201385.","journal-title":"J Am Med Inform Assoc JAMIA"},{"key":"3673_CR20","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1016\/j.jbi.2018.03.011","volume":"81","author":"Y Zhang","year":"2018","unstructured":"Zhang Y, Lin H, Yang Z, Wang J, Zhang S, Yuanyuan, Sun, Yang L. A hybrid model based on neural networks for biomedical relation extraction. J Biomed Inform. 2018; 81:83\u201392.","journal-title":"J Biomed Inform"},{"key":"3673_CR21","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.jbi.2018.08.005","volume":"86","author":"SS Kumar","year":"2018","unstructured":"Kumar SS, Ashish A. Drug-drug interaction extraction from biomedical texts using long short-term memory network. J Biomed Inform. 2018; 86:15\u201324.","journal-title":"J Biomed Inform"},{"key":"3673_CR22","volume-title":"Proceedings of the Eighth International Joint Conference on Natural Language Processing, IJCNLP, vol. 1","author":"N Pappas","year":"2017","unstructured":"Pappas N, Popescu-Belis A. Multilingual hierarchical attention networks for document classification. In: Proceedings of the Eighth International Joint Conference on Natural Language Processing, IJCNLP, vol. 1. Taipei: Asian Federation of Natural Language Processing: 2017. p. 1015\u201325."},{"key":"3673_CR23","unstructured":"Sabour S, Frosst N, Hinton GE. Dynamic routing between capsules. In: AdNIPS\u201917: Proceedings of the 31st International Conference on Neural Information Processing Systems. Beach, CA: 2017. p. 3856\u201366."},{"key":"3673_CR24","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"W Zhao","year":"2018","unstructured":"Zhao W, Ye J, Yang M, Lei Z, Zhang S, Zhao Z. Investigating capsule networks with dynamic routing for text classification. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Brussels: Association for Computational Linguistics: 2018. p. 3110\u201319."},{"key":"3673_CR25","volume-title":"omputer Vision - ECCV 2018 Workshops Proceedings, Part III. Lecture Notes in Computer Science, vol. 11131","author":"S Ramasinghe","year":"2018","unstructured":"Ramasinghe S, Athuralya CD, Khan S. A context-aware capsule network for multi-label classification. In: omputer Vision - ECCV 2018 Workshops Proceedings, Part III. Lecture Notes in Computer Science, vol. 11131. Munich: Springer: 2018. p. 546\u201354."},{"key":"3673_CR26","first-page":"3111","volume":"26","author":"T Mikolov","year":"2013","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado G, Dean J. Distributed representations of words and phrases and their compositionality. AAdv Neural Inf Process Syst. 2013; 26:3111\u20139.","journal-title":"AAdv Neural Inf Process Syst"},{"issue":"6","key":"3673_CR27","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1109\/MIS.2016.45","volume":"31","author":"S Lai","year":"2016","unstructured":"Lai S, Liu K, He S, Zhao J. How to generate a good word embedding. IEEE Intell Syst. 2016; 31(6):5\u201314.","journal-title":"IEEE Intell Syst"},{"key":"3673_CR28","volume-title":"3rd International Conference on Learning Representations, ICLR","author":"D Bahdanau","year":"2014","unstructured":"Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate. In: 3rd International Conference on Learning Representations, ICLR. San Diego: Conference Track Proceedings: 2014."},{"key":"3673_CR29","unstructured":"Kim Y, Denton C, Hoang L, Rush AM. Structured attention networks. In: 5th International Conference on Learning Representations, ICLR 2017. Toulon: 2017."},{"key":"3673_CR30","unstructured":"Kingma DP, Ba J. Adam: A method for stochastic optimization. In: 3rd International Conference on Learning Representations, ICLR (poster). San Diego: 2014."}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-020-03673-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-020-03673-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-020-03673-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,16]],"date-time":"2021-09-16T23:08:53Z","timestamp":1631833733000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-020-03673-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9]]},"references-count":30,"journal-issue":{"issue":"S13","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["3673"],"URL":"https:\/\/doi.org\/10.1186\/s12859-020-03673-5","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9]]},"assertion":[{"value":"17 September 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"No ethics approval was required for the study.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The content is that the authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"380"}}