{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T04:34:11Z","timestamp":1764304451853,"version":"build-2065373602"},"reference-count":61,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2015,12,11]],"date-time":"2015-12-11T00:00:00Z","timestamp":1449792000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National 863 Program of China","award":["2015AA015405"],"award-info":[{"award-number":["2015AA015405"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61402128","61473101","61173075","61272383"],"award-info":[{"award-number":["61402128","61473101","61173075","61272383"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Strategic Emerging Industry Development Special Funds of Shenzhen","award":["JCYJ20140508161040764","JCYJ20140417172417105","JCYJ20140627163809422"],"award-info":[{"award-number":["JCYJ20140508161040764","JCYJ20140417172417105","JCYJ20140627163809422"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Semantic features are very important for machine learning-based drug name recognition (DNR) systems. The semantic features used in most DNR systems are based on drug dictionaries manually constructed by experts. Building large-scale drug dictionaries is a time-consuming task and adding new drugs to existing drug dictionaries immediately after they are developed is also a challenge. In recent years, word embeddings that contain rich latent semantic information of words have been widely used to improve the performance of various natural language processing tasks. However, they have not been used in DNR systems. Compared to the semantic features based on drug dictionaries, the advantage of word embeddings lies in that learning them is unsupervised. In this paper, we investigate the effect of semantic features based on word embeddings on DNR and compare them with semantic features based on three drug dictionaries. We propose a conditional random fields (CRF)-based system for DNR. The skip-gram model, an unsupervised algorithm, is used to induce word embeddings on about 17.3 GigaByte (GB) unlabeled biomedical texts collected from MEDLINE (National Library of Medicine, Bethesda, MD, USA). The system is evaluated on the drug-drug interaction extraction (DDIExtraction) 2013 corpus. Experimental results show that word embeddings significantly improve the performance of the DNR system and they are competitive with semantic features based on drug dictionaries. F-score is improved by 2.92 percentage points when word embeddings are added into the baseline system. It is comparative with the improvements from semantic features based on drug dictionaries. Furthermore, word embeddings are complementary to the semantic features based on drug dictionaries. When both word embeddings and semantic features based on drug dictionaries are added, the system achieves the best performance with an F-score of 78.37%, which outperforms the best system of the DDIExtraction 2013 challenge by 6.87 percentage points.<\/jats:p>","DOI":"10.3390\/info6040848","type":"journal-article","created":{"date-parts":[[2015,12,14]],"date-time":"2015-12-14T02:57:29Z","timestamp":1450061849000},"page":"848-865","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":41,"title":["Effects of Semantic Features on Machine Learning-Based Drug Name Recognition Systems: Word Embeddings vs. Manually Constructed Dictionaries"],"prefix":"10.3390","volume":"6","author":[{"given":"Shengyu","family":"Liu","sequence":"first","affiliation":[{"name":"Key Laboratory of Network Oriented Intelligent Computation, Harbin Institute of Technology Shenzhen Graduate School, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Buzhou","family":"Tang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Network Oriented Intelligent Computation, Harbin Institute of Technology Shenzhen Graduate School, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingcai","family":"Chen","sequence":"additional","affiliation":[{"name":"Key Laboratory of Network Oriented Intelligent Computation, Harbin Institute of Technology Shenzhen Graduate School, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaolong","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Network Oriented Intelligent Computation, Harbin Institute of Technology Shenzhen Graduate School, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,12,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"816","DOI":"10.1016\/j.drudis.2008.06.001","article-title":"Drug name recognition and classification in biomedical texts: A case study outlining approaches underpinning automated systems","volume":"13","year":"2008","journal-title":"Drug Discov. Today"},{"key":"ref_2","unstructured":"Segura-Bedmar, I., Mart\u00ednez, P., and Herrero-Zazo, M. (2013, January 14\u201315). SemEval-2013 task 9: Extraction of drug-drug interactions from biomedical texts (DDIExtraction 2013). Proceedings of the 7th International Workshop on Semantic Evaluation, Atlanta, GA, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sanchez-Cisneros, D., Mart\u00ednez, P., and Segura-Bedmar, I. (2013, January 1). Combining dictionaries and ontologies for drug name recognition in biomedical texts. Proceedings of the 7th International Workshop on Data and Text Mining in Biomedical Informatics, San Francisco, CA, USA.","DOI":"10.1145\/2512089.2512100"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1016\/j.drudis.2013.10.006","article-title":"Drug name recognition in biomedical texts: A machine-learning-based method","volume":"19","author":"He","year":"2014","journal-title":"Drug Discov. Today"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"S1","DOI":"10.1186\/1758-2946-7-S1-S1","article-title":"CHEMDNER: The drugs and chemical names extraction challenge","volume":"7","author":"Krallinger","year":"2015","journal-title":"J. Cheminformatics"},{"key":"ref_6","unstructured":"Bj\u00f6re, J., Kaewphan, S., and Salakoski, T. (2013, January 14\u201315). UTurku: Drug named entity detection and drug-drug interaction extraction using SVM classification and domain knowledge. Proceedings of the 7th International Workshop on Semantic Evaluation, Atlanta, GA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Finkel, J., Grenager, T., and Manning, C. (2005, January 25\u201330). Incorporating non-local information into information extraction systems by gibbs sampling. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics, Ann Arbor, MI, USA.","DOI":"10.3115\/1219840.1219885"},{"key":"ref_8","unstructured":"Tkachenko, M., and Simanovsky, A. (2012, January 19\u201321). Named entity recognition: Exploring features. Proceedings of the KONVENS 2012, Vienna, Austria."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Settles, B. (2004, January 23\u201327). Biomedical named entity recognition using conditional random fields and rich feature sets. Proceedings of the COLING 2004 International Joint Workshop on Natural Language Processing in Biomedicine and its Applications, Geneva, Switzerland.","DOI":"10.3115\/1567594.1567618"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"S6","DOI":"10.1186\/1471-2105-6-S1-S6","article-title":"Identifying gene and protein mentions in text using conditional random fields","volume":"6","author":"McDonald","year":"2005","journal-title":"BMC Bioinform."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1136\/jamia.2010.003939","article-title":"High accuracy information extraction of medication information from clinical notes: 2009 i2b2 medication extraction challenge","volume":"17","author":"Patrick","year":"2010","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1136\/amiajnl-2011-000163","article-title":"A study of machine-learning-based approaches to extract clinical entities and their assertions from discharge summaries","volume":"18","author":"Jiang","year":"2011","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_13","unstructured":"Turian, J., Ratinov, L., and Bengio, Y. (2010, January 11\u201316). Word representations: A simple and general method for semi-supervised learning. Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, Uppsala, Sweden."},{"key":"ref_14","first-page":"2493","article-title":"Natural language processing (almost) from scratch","volume":"12","author":"Collobert","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Tang, B., Cao, H., Wang, X., Chen, Q., and Xu, H. (2014). Evaluating word representation features in biomedical named entity recognition tasks. Biomed. Res. Int., 2014.","DOI":"10.1155\/2014\/240403"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Passos, A., Kumar, V., and McCallum, A. (2014, January 26\u201327). Lexicon Infused Phrase Embeddings for Named Entity Resolution. Proceedings of the 18th Conference on Computational Language Learning, Baltimore, MD, USA.","DOI":"10.3115\/v1\/W14-1609"},{"key":"ref_17","unstructured":"Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013, January 2\u20134). Efficient estimation of word representations in vector space. Proceedings of the Workshop at ICLR, Scottsdale, AZ, USA."},{"key":"ref_18","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G., and Dean, J. (2013, January 5\u201310). Distributed representations of words and phrases and their compositionality. Proceedings of the 27th Annual Conference on Neural Information Processing Systems, Lake Tahoe, CA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"D1035","DOI":"10.1093\/nar\/gkq1126","article-title":"DrugBank 3.0: A comprehensive resource for \u201comics\u201d research on drugs","volume":"39","author":"Knox","year":"2011","journal-title":"Nucleic Acids Res."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2983","DOI":"10.1093\/bioinformatics\/btp535","article-title":"A dictionary to identify small molecules and drugs in free text","volume":"25","author":"Hettne","year":"2009","journal-title":"Bioinformatics"},{"key":"ref_21","unstructured":"Aronson, A., Bodenreider, O., Chang, H., Humphrey, S., Mork, J., Nelson, S., Rindflesch, T., and Wilbur, W. (2000, January 4\u20138). The NLM indexing initiative. Proceedings of the AMIA Annual Symposium, Los Angeles, CA, USA."},{"key":"ref_22","unstructured":"Segura-Bedmar, I., Mart\u00ednez, P., and S\u00e1nchez-Cisneros, D. (2011, January 7). The 1st DDIExtraction-2011 challenge task: Extraction of drug-drug interactions from biomedical texts. Proceedings of the 1st Challenge Task on Drug-Drug Interaction Extraction, Huelva, Spain."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"S3","DOI":"10.1186\/1758-2946-7-S1-S3","article-title":"tmChem: A high performance approach for chemical named entity recognition and normalization","volume":"7","author":"Leaman","year":"2015","journal-title":"J. Cheminformatics"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"S8","DOI":"10.1186\/1758-2946-7-S1-S8","article-title":"A comparison of conditional random fields and structured support vector machines for chemical entity recognition in biomedical literature","volume":"7","author":"Tang","year":"2015","journal-title":"J. Cheminformatics"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"S4","DOI":"10.1186\/1758-2946-7-S1-S4","article-title":"CHEMDNER system with mixed conditional random fields and multi-scale word clustering","volume":"7","author":"Lu","year":"2015","journal-title":"J. Cheminformatics"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"S6","DOI":"10.1186\/1758-2946-7-S1-S6","article-title":"Optimising chemical named entity recognition with pre-processing analytics, knowledge-rich features and heuristics","volume":"7","author":"Rak","year":"2015","journal-title":"J. Cheminformatics"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"S7","DOI":"10.1186\/1758-2946-7-S1-S7","article-title":"A document processing pipeline for annotating chemical entities in scientific documents","volume":"7","author":"Campos","year":"2015","journal-title":"J. Cheminformatics"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1197\/jamia.M3378","article-title":"MedEx: A medication information extraction system for clinical narratives","volume":"17","author":"Xu","year":"2010","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Doan, S., Collier, N., Xu, H., Duy, P., and Phuong, T. (2012). Recognition of medication information from discharge summaries using ensembles of classifiers. BMC Med. Inform. Decis. Mak., 12.","DOI":"10.1186\/1472-6947-12-36"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"S2","DOI":"10.1186\/2041-1480-2-S3-S2","article-title":"A cascade of classifiers for extracting medication information from discharge summaries","volume":"2","author":"Halgrim","year":"2011","journal-title":"J. Biomed. Semant."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.jbi.2015.08.013","article-title":"Identifying adverse drug event information in clinical notes with distributional semantic representations of context","volume":"57","author":"Henriksson","year":"2015","journal-title":"J. Biomed. Inform."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.jbi.2014.01.012","article-title":"Automatic recognition of disorders, findings, pharmaceuticals and body structures from clinical text: An annotation and machine learning study","volume":"49","author":"Skeppstedt","year":"2014","journal-title":"J. Biomed. Inform."},{"key":"ref_33","first-page":"467","article-title":"Class-based n-gram models of natural language","volume":"18","author":"Brown","year":"1992","journal-title":"Comput. Linguist."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1080\/01638539809545028","article-title":"An introduction to latent semantic analysis","volume":"25","author":"Landauer","year":"1998","journal-title":"Discourse Process."},{"key":"ref_35","unstructured":"Lund, K., Burgess, C., and Atchley, R. (1995, January 22\u201325). Semantic and associative priming in high dimensional semantic space. Proceedings of the 17th Annual Conference of the Cognitive Science Society, Pittsburgh, PA, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.jbi.2011.10.007","article-title":"Enhancing clinical concept extraction with distributional semantics","volume":"45","author":"Jonnalagadda","year":"2012","journal-title":"J. Biomed. Inform."},{"key":"ref_37","first-page":"1137","article-title":"A neural probabilistic language model","volume":"3","author":"Bengio","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_38","unstructured":"Morin, F., and Bengio, Y. (2005, January 6\u20138). Hierarchical probabilistic neural network language model. Proceedings of the 10th International Workshop on Artificial Intelligence and Statistics, Bridgetown, Barbados."},{"key":"ref_39","unstructured":"Mnih, A., and Hinton, G. (2008, January 8\u201311). A scalable hierarchical distributed language model. Proceedings of the 22nd Annual Conference on Neural Information Processing Systems, Vancouver, Canada."},{"key":"ref_40","unstructured":"Huang, E., Socher, R., Manning, C., and Ng, A. (2012, January 8\u201314). Improving word representations via global context and multiple word prototypes. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Jeju, Korea."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Mikolov, T., Karafi\u00e1t, M., Burget, L., Cernocky, J., and Khudanpur, S. (2010, January 26\u201330). Recurrent neural network based language model. Proceedings of the 11th Annual Conference of the International Speech Communication Association, Makuhari, Japan.","DOI":"10.21437\/Interspeech.2010-343"},{"key":"ref_42","unstructured":"Natural Language Toolkit. Available online: http:\/\/www.nltk.org\/."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ratinov, L., and Roth, D. (2009, January 4). Design challenges and misconceptions in named entity recognition. Proceedings of the 13th Conference on Computational Natural Language Learning, Boulder, CO, USA.","DOI":"10.3115\/1596374.1596399"},{"key":"ref_44","unstructured":"Lafferty, J., McCallum, A., and Pereira, F. (July, January 28). Conditional random fields: Probabilistic models for segmenting and labeling sequence data. Proceedings of the 18th International Conference on Machine Learning, Williamstown, MA, USA."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"McCallum, A., and Li, W. (2003, January 23\u201327). Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. Proceedings of the 7th Conference on Natural Language Learning, Geneva, Switzerland.","DOI":"10.3115\/1119176.1119206"},{"key":"ref_46","first-page":"693","article-title":"Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence data","volume":"8","author":"Sutton","year":"2007","journal-title":"J. Mach. Learn. Res."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Peng, F., Feng, F., and McCallum, A. (2004, January 23\u201327). Chinese segmentation and new word detection using conditional random fields. Proceedings of the 20th International Conference on Computational Linguistics, Geneva, Switzerland.","DOI":"10.3115\/1220355.1220436"},{"key":"ref_48","unstructured":"CRFsuite. Available online: http:\/\/www.chokkan.org\/software\/crfsuite\/."},{"key":"ref_49","unstructured":"word2vec. Available online: https:\/\/code.google.com\/p\/word2vec\/."},{"key":"ref_50","unstructured":"GENIA Tagger. Available online: http:\/\/www.nactem.ac.uk\/tsujii\/GENIA\/tagger\/."},{"key":"ref_51","first-page":"313","article-title":"Building a large annotated corpus of English: The penn treebank","volume":"19","author":"Marcus","year":"1993","journal-title":"Comput. Linguist."},{"key":"ref_52","unstructured":"Sang, E., and Buchholz, S. (2000, January 13\u201314). Introduction to the CoNLL-2000 shared task: Chunking. Proceedings of the CoNLL-2000, Lisbon, Portugal."},{"key":"ref_53","unstructured":"DrugBank. Available online: http:\/\/www.drugbank.ca\/downloads."},{"key":"ref_54","unstructured":"Drugs@FDA Data Files, Available online: http:\/\/www.fda.gov\/Drugs\/InformationOnDrugs\/ ucm079750.htm."},{"key":"ref_55","unstructured":"Leasing Journal Citations (MEDLINE\u00ae\/PubMed\u00ae including OLDMEDLINE), Available online: http:\/\/www.nlm.nih.gov\/databases\/journal.html."},{"key":"ref_56","unstructured":"Lai, S., Liu, K., Xu, L., and Zhao, J. (2015). How to generate a good word embedding?."},{"key":"ref_57","unstructured":"Rockt\u00e4schel, T., Huber, T., Weidlich, M., and Leser, U. (2013, January 14\u201315). WBI-NER: The impact of domain-specific features on the performance of identifying and classifying mentions of drugs. Proceedings of the 7th International Workshop on Semantic Evaluation, Atlanta, GA, USA."},{"key":"ref_58","unstructured":"Grego, T., Pinto, F., and Couto, F. (2013, January 14\u201315). LASIGE: Using conditional random fields and ChEBI ontology. Proceedings of the 7th International Workshop on Semantic Evaluation, Atlanta, GA, USA."},{"key":"ref_59","unstructured":"Sanchez-Cisneros, D., and Gali, F. (2013, January 14\u201315). UEM-UC3M: An ontology-based named entity recognition system for biomedical texts. Proceedings of the 7th International Workshop on Semantic Evaluation, Atlanta, GA, USA."},{"key":"ref_60","unstructured":"Collazo, A., Ceballo, A., Puig, D., Guti\u00e9rrez, Y., Abreu, J., P\u00e9rez, R., Orqu\u00edn, A., Montoyo, A., Mu\u00f1oz, R., and Camara, F. (2013, January 14\u201315). UMCC_DLSI: Semantic and lexical features for detection and classification drugs in biomedical texts. Proceedings of the 7th International Workshop on Semantic Evaluation, Atlanta, GA, USA."},{"key":"ref_61","unstructured":"Sang, E., and Meulder, F. (June, January 31). Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition. Proceedings of the 7th Conference on Natural Language Learning, Edmonton, Canada."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/6\/4\/848\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:53:54Z","timestamp":1760216034000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/6\/4\/848"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,12,11]]},"references-count":61,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2015,12]]}},"alternative-id":["info6040848"],"URL":"https:\/\/doi.org\/10.3390\/info6040848","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2015,12,11]]}}}