{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T08:07:25Z","timestamp":1771920445065,"version":"3.50.1"},"reference-count":53,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,1,8]],"date-time":"2019-01-08T00:00:00Z","timestamp":1546905600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61877050"],"award-info":[{"award-number":["61877050"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Fund Program for the Scientific Activities of Selected Returned Overseas Professionals in Shaanxi Province","award":["202160002"],"award-info":[{"award-number":["202160002"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Drug-drug interactions (DDIs) may bring huge health risks and dangerous effects to a patient\u2019s body when taking two or more drugs at the same time or within a certain period of time. Therefore, the automatic extraction of unknown DDIs has great potential for the development of pharmaceutical agents and the safety of drug use. In this article, we propose a novel recurrent hybrid convolutional neural network (RHCNN) for DDI extraction from biomedical literature. In the embedding layer, the texts mentioning two entities are represented as a sequence of semantic embeddings and position embeddings. In particular, the complete semantic embedding is obtained by the information fusion between a word embedding and its contextual information which is learnt by recurrent structure. After that, the hybrid convolutional neural network is employed to learn the sentence-level features which consist of the local context features from consecutive words and the dependency features between separated words for DDI extraction. Lastly but most significantly, in order to make up for the defects of the traditional cross-entropy loss function when dealing with class imbalanced data, we apply an improved focal loss function to mitigate against this problem when using the DDIExtraction 2013 dataset. In our experiments, we achieve DDI automatic extraction with a micro F-score of 75.48% on the DDIExtraction 2013 dataset, outperforming the state-of-the-art approach by 2.49%.<\/jats:p>","DOI":"10.3390\/e21010037","type":"journal-article","created":{"date-parts":[[2019,1,11]],"date-time":"2019-01-11T11:36:42Z","timestamp":1547206602000},"page":"37","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":77,"title":["Drug-Drug Interaction Extraction via Recurrent Hybrid Convolutional Neural Networks with an Improved Focal Loss"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0572-641X","authenticated-orcid":false,"given":"Xia","family":"Sun","sequence":"first","affiliation":[{"name":"Department of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6067-2517","authenticated-orcid":false,"given":"Ke","family":"Dong","sequence":"additional","affiliation":[{"name":"Department of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"}]},{"given":"Long","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5549-5691","authenticated-orcid":false,"given":"Richard","family":"Sutcliffe","sequence":"additional","affiliation":[{"name":"Department of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"}]},{"given":"Feijuan","family":"He","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Xi\u2019an Jiaotong University City College, Xi\u2019an 710069, China"}]},{"given":"Sushing","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Computer Information Science and Engineering, University of Florida, Gainesville, FL 32608, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0706-2103","authenticated-orcid":false,"given":"Jun","family":"Feng","sequence":"additional","affiliation":[{"name":"Department of Information Science and Technology, Northwest University, Xi\u2019an 710127, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1517\/14740338.2012.631910","article-title":"Epidemiology and characteristics of adverse drug reactions caused by drug-drug interactions","volume":"11","author":"Magro","year":"2012","journal-title":"Expert Opin. Drug Saf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"D1074","DOI":"10.1093\/nar\/gkx1037","article-title":"DrugBank 5.0: A major update to the DrugBank database for 2018","volume":"46","author":"Wishart","year":"2017","journal-title":"Nucleic Acids Res."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Thorn, C.F., Klein, T.E., and Altman, R.B. (2013). PharmGKB: The pharmacogenomics knowledge base. Pharmacogenomics, Springer.","DOI":"10.1007\/978-1-62703-435-7_20"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1186\/1479-7364-5-1-61","article-title":"A useful tool for drug interaction evaluation: The University of Washington Metabolism and Transport Drug Interaction Database","volume":"5","author":"Hachad","year":"2010","journal-title":"Hum. Genom."},{"key":"ref_5","unstructured":"Baxter, K., and Preston, C. (2010). Stockley\u2019s Drug Interactions, Pharmaceutical Press."},{"key":"ref_6","unstructured":"Segura Bedmar, I., Martinez, P., and S\u00e1nchez Cisneros, D. (2011, January 7). The 1st DDIExtraction-2011 challenge task: Extraction of Drug-Drug Interactions from biomedical texts. Proceedings of the 1st Challenge Task on Drug-Drug Interaction Extraction 2011, Huelva, Spain."},{"key":"ref_7","unstructured":"Diab, M.T., Baldwin, T., and Baroni, M. (2013, January 14\u201315). SemEval-2013 Task 9: Extraction of Drug-Drug Interactions from Biomedical Texts (DDIExtraction 2013). Proceedings of the 7th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2013, Atlanta, GA, USA."},{"key":"ref_8","first-page":"1771","article-title":"Glycosidic enzymes enhance retinal transduction following intravitreal delivery of AAV2","volume":"17","author":"Allen","year":"2011","journal-title":"Mol. Vis."},{"key":"ref_9","first-page":"S1","article-title":"A linguistic rule-based approach to extract drug-drug interactions from pharmacological documents","volume":"12","year":"2011","journal-title":"BMC Bioinform."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1093\/bioinformatics\/btl616","article-title":"RelEx\u2014Relation extraction using dependency parse trees","volume":"23","author":"Fundel","year":"2006","journal-title":"Bioinformatics"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1016\/j.jbi.2011.04.005","article-title":"Using a shallow linguistic kernel for drug\u2013drug interaction extraction","volume":"44","author":"Martinez","year":"2011","journal-title":"J. Biomed. Inform."},{"key":"ref_12","unstructured":"Diab, M.T., Baldwin, T., and Baroni, M. (2013, January 14\u201315). UTurku: Drug Named Entity Recognition and Drug-Drug Interaction Extraction Using SVM Classification and Domain Knowledge. Proceedings of the 7th International Workshop on Semantic Evaluation, SemEval, NAACL-HLT 2013, Atlanta, GA, USA."},{"key":"ref_13","unstructured":"Chowdhury, M.F.M., and Lavelli, A. (2013, January 9\u201314). Exploiting the scope of negations and heterogeneous features for relation extraction: A case study for drug-drug interaction extraction. Proceedings of the Conference of the North American Chapter of the Association of Computational Linguistics, Atlanta, GA, USA."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.jbi.2015.03.002","article-title":"Extracting drug\u2013drug interactions from literature using a rich feature-based linear kernel approach","volume":"55","author":"Kim","year":"2015","journal-title":"J. Biomed. Inform."},{"key":"ref_15","first-page":"109","article-title":"Extracting drug-drug interactions from biomedical text using a feature-based kernel approach","volume":"92","author":"Raihani","year":"2016","journal-title":"J. Theor. Appl. Inf. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1650039","DOI":"10.1142\/S0129065716500398","article-title":"Deep Learning Representation from Electroencephalography of Early-Stage Creutzfeldt-Jakob Disease and Features for Differentiation from Rapidly Progressive Dementia","volume":"27","author":"Morabito","year":"2017","journal-title":"Int. J. Neural Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.cmpb.2018.04.012","article-title":"Automated EEG-based Screening of Depression Using Deep Convolutional Neural Network","volume":"161","author":"Acharya","year":"2018","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Yu, Q., Xie, L., Wang, Y., Zhou, Y., Fishman, E.K., and Yuille, A.L. (2018, January 18\u201322). Recurrent saliency transformation network: Incorporating multi-stage visual cues for small organ segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00864"},{"key":"ref_19","unstructured":"Rajpurkar, P., Irvin, J., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D., Bagul, A., Langlotz, C., and Shpanskaya, K. (arXiv, 2017). CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning, arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"6918381","DOI":"10.1155\/2016\/6918381","article-title":"Drug-drug interaction extraction via convolutional neural networks","volume":"2016","author":"Liu","year":"2016","journal-title":"Comput. Math. Methods Med."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3444","DOI":"10.1093\/bioinformatics\/btw486","article-title":"Drug drug interaction extraction from biomedical literature using syntax convolutional neural network","volume":"32","author":"Zhao","year":"2016","journal-title":"Bioinformatics"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1850404","DOI":"10.1155\/2016\/1850404","article-title":"Multichannel convolutional neural network for biological relation extraction","volume":"2016","author":"Quan","year":"2016","journal-title":"BioMed Res. Int."},{"key":"ref_23","unstructured":"Gurevych, I., and Miyao, Y. (2018, January 15\u201320). Enhancing Drug-Drug Interaction Extraction from Texts by Molecular Structure Information. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.ins.2017.06.021","article-title":"Drug\u2013drug interaction extraction from biomedical literature using support vector machine and long short term memory networks","volume":"415","author":"Huang","year":"2017","journal-title":"Inf. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.jbi.2018.08.005","article-title":"Drug-drug interaction extraction from biomedical texts using long short-term memory network","volume":"86","author":"Sahu","year":"2018","journal-title":"J. Biomed. Inform."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"828","DOI":"10.1093\/bioinformatics\/btx659","article-title":"Drug\u2013drug interaction extraction via hierarchical RNNs on sequence and shortest dependency paths","volume":"34","author":"Zhang","year":"2017","journal-title":"Bioinformatics"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.artmed.2018.03.001","article-title":"Position-aware deep multi-task learning for drug\u2013drug interaction extraction","volume":"87","author":"Zhou","year":"2018","journal-title":"Artif. Intell. Med."},{"key":"ref_29","unstructured":"Zeng, D., Liu, K., Lai, S., Zhou, G., and Zhao, J. (2014, January 23\u201329). Relation classification via convolutional deep neural network. Proceedings of the COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, Dublin, Ireland."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lai, S., Xu, L., Liu, K., and Zhao, J. (2015, January 25\u201330). Recurrent Convolutional Neural Networks for Text Classification. Proceedings of the AAAI\u201915 Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9513"},{"key":"ref_31","unstructured":"Kalchbrenner, N., Espeholt, L., Simonyan, K., van den Oord, A., Graves, A., and Kavukcuoglu, K. (arXiv, 2016). Neural Machine Translation in Linear Time, arXiv."},{"key":"ref_32","unstructured":"Palmer, M., Hwa, R., and Riedel, S. (2017, January 9\u201311). Fast and Accurate Entity Recognition with Iterated Dilated Convolutions. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, EMNLP 2017, Copenhagen, Denmark."},{"key":"ref_33","unstructured":"Yang, Z., Hu, Z., Salakhutdinov, R., and Berg-Kirkpatrick, T. (2017, January 6\u201311). Improved Variational Autoencoders for Text Modeling using Dilated Convolutions. Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia."},{"key":"ref_34","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE Transactions on Pattern Analysis and Machine Intelligence, Venice, Italy."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, L., Yang, Z., Zhao, Z., Lin, H., and Li, Y. (2013). Extracting drug-drug interaction from the biomedical literature using a stacked generalization-based approach. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0065814"},{"key":"ref_36","unstructured":"Yang, Q., and Wooldridge, M. (2015, January 25\u201331). Target-Dependent Twitter Sentiment Classification with Rich Automatic Features. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI 2015, Buenos Aires, Argentina."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1109\/TASLP.2016.2520371","article-title":"Deep sentence embedding using long short-term memory networks: Analysis and application to information retrieval","volume":"24","author":"Palangi","year":"2016","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process. (TASLP)"},{"key":"ref_38","first-page":"2493","article-title":"Natural language processing (almost) from scratch","volume":"12","author":"Collobert","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_39","first-page":"3111","article-title":"Distributed Representations of Words and Phrases and their Compositionality","volume":"26","author":"Mikolov","year":"2013","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Pennington, J., Socher, R., and Manning, C. (2014, January 25\u201329). Glove: Global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1162"},{"key":"ref_41","unstructured":"Pyysalo, S., Ginter, F., Moen, H., Salakoski, T., and Ananiadou, S. (2013, January 12\u201313). Distributional semantics resources for biomedical text processing. Proceedings of the 5th International Symposium on Languages in Biology and Medicine, Tokyo, Japan."},{"key":"ref_42","unstructured":"Turian, J., Ratinov, L., and Bengio, Y. (2010, January 11\u201316). Word representations: A simple and general method for semi-supervised learning. Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, Uppsala, Sweden."},{"key":"ref_43","first-page":"626","article-title":"Classifying Relations by Ranking with Convolutional Neural Networks","volume":"Volume 1","author":"Xiang","year":"2015","journal-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, ACL 2015"},{"key":"ref_44","unstructured":"Moschitti, A., Pang, B., and Daelemans, W. (2014, January 25\u201329). Convolutional Neural Networks for Sentence Classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, Doha, Qatar."},{"key":"ref_45","unstructured":"Su, J. (2018, November 10). Customize Complex Loss Function in Keras. Available online: https:\/\/spaces.ac.cn\/archives\/4493."},{"key":"ref_46","unstructured":"Kingma, D., and Ba, J. (arXiv, 2014). Adam: A Method for Stochastic Optimization, arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1016\/j.jbi.2013.07.011","article-title":"The DDI corpus: An annotated corpus with pharmacological substances and drug\u2013drug interactions","volume":"46","author":"Declerck","year":"2013","journal-title":"J. Biomed. Inform."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.jbi.2014.05.007","article-title":"Lessons learnt from the DDIExtraction-2013 shared task","volume":"51","year":"2014","journal-title":"J. Biomed. Inform."},{"key":"ref_49","first-page":"351","article-title":"FBK-irst: A multi-phase kernel based approach for drug-drug interaction detection and classification that exploits linguistic information","volume":"Volume 2","author":"Chowdhury","year":"2013","journal-title":"Proceedings of the 7th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2013"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Yi, Z., Li, S., Yu, J., Tan, Y., Wu, Q., Yuan, H., and Wang, T. (2017). Drug-drug Interaction Extraction via Recurrent Neural Network with Multiple Attention Layers. International Conference on Advanced Data Mining and Applications, Springer.","DOI":"10.1007\/978-3-319-69179-4_39"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1162\/coli.2008.34.1.35","article-title":"Feature forest models for probabilistic HPSG parsing","volume":"34","author":"Miyao","year":"2008","journal-title":"Comput. Linguist."},{"key":"ref_52","unstructured":"Sagae, K., and Tsujii, J. (2007, January 28\u201330). Dependency parsing and domain adaptation with LR models and parser ensembles. Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), Prague, Czech Republic."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Chen, D., and Manning, C. (2014, January 25\u201329). A fast and accurate dependency parser using neural networks. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1082"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/1\/37\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:24:18Z","timestamp":1760185458000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/1\/37"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,8]]},"references-count":53,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,1]]}},"alternative-id":["e21010037"],"URL":"https:\/\/doi.org\/10.3390\/e21010037","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,8]]}}}