{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T10:12:15Z","timestamp":1773655935007,"version":"3.50.1"},"reference-count":46,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2019,10,11]],"date-time":"2019-10-11T00:00:00Z","timestamp":1570752000000},"content-version":"vor","delay-in-days":283,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Philip Morris International R&D"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Knowledge of the molecular interactions of biological and chemical entities and their involvement in biological processes or clinical phenotypes is important for data interpretation. Unfortunately, this knowledge is mostly embedded in the literature in such a way that it is unavailable for automated data analysis procedures. Biological expression language (BEL) is a syntax representation allowing for the structured representation of a broad range of biological relationships. It is used in various situations to extract such knowledge and transform it into BEL networks. To support the tedious and time-intensive extraction work of curators with automated methods, we developed the BEL track within the framework of BioCreative Challenges. Within the BEL track, we provide training data and an evaluation environment to encourage the text mining community to tackle the automatic extraction of complex BEL relationships. In 2017 BioCreative VI, the 2015 BEL track was repeated with new test data. Although only minor improvements in text snippet retrieval for given statements were achieved during this second BEL task iteration, a significant increase of BEL statement extraction performance from provided sentences could be seen. The best performing system reached a 32% F-score for the extraction of complete BEL statements and with the given named entities this increased to 49%. This time, besides rule-based systems, new methods involving hierarchical sequence labeling and neural networks were applied for BEL statement extraction.<\/jats:p>","DOI":"10.1093\/database\/baz084","type":"journal-article","created":{"date-parts":[[2019,6,7]],"date-time":"2019-06-07T19:10:32Z","timestamp":1559934632000},"source":"Crossref","is-referenced-by-count":13,"title":["The extraction of complex relationships and their conversion to biological expression language (BEL) overview of the BioCreative VI (2017) BEL track"],"prefix":"10.1093","volume":"2019","author":[{"given":"Sumit","family":"Madan","sequence":"first","affiliation":[{"name":"Fraunhofer Institute for Algorithms and Scientific Computing, Schloss Birlinghoven, 53754 Sankt Augustin, Germany"}]},{"given":"Justyna","family":"Szostak","sequence":"additional","affiliation":[{"name":"Philip Morris International R&D, Philip Morris Products S.A., Quai Jeanrenaud 5, 2000 Neuchatel, Switzerland"}]},{"given":"Ravikumar","family":"Komandur Elayavilli","sequence":"additional","affiliation":[{"name":"Department of Health Sciences Research, Mayo Clinic, 200 First St. SW, Rochester, MN 55905, USA"}]},{"given":"Richard Tzong-Han","family":"Tsai","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Central University, Taiwan, R.O.C., Taiwan 320"}]},{"given":"Mehdi","family":"Ali","sequence":"additional","affiliation":[{"name":"Friedrich Wilhelm University of Bonn, 53012 Bonn, Germany"}]},{"given":"Longhua","family":"Qian","sequence":"additional","affiliation":[{"name":"NLP Lab, School of Computer Science and Technology, Soochow University, Suzhou, 215006 Suzhou, China"}]},{"given":"Majid","family":"Rastegar-Mojarad","sequence":"additional","affiliation":[{"name":"Department of Health Sciences Research, Mayo Clinic, 200 First St. SW, Rochester, MN 55905, USA"}]},{"given":"Julia","family":"Hoeng","sequence":"additional","affiliation":[{"name":"Philip Morris International R&D, Philip Morris Products S.A., Quai Jeanrenaud 5, 2000 Neuchatel, Switzerland"}]},{"given":"Juliane","family":"Fluck","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Algorithms and Scientific Computing, Schloss Birlinghoven, 53754 Sankt Augustin, Germany"}]}],"member":"286","published-online":{"date-parts":[[2019,10,11]]},"reference":[{"key":"2019101104284201200_ref1","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1093\/bioinformatics\/btg015","article-title":"The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models","volume":"19","author":"Hucka","year":"2003","journal-title":"Bioinformatics"},{"key":"2019101104284201200_ref2","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1038\/nbt.1666","article-title":"The BioPAX community standard for pathway data sharing","volume":"28","author":"Demir","year":"2010","journal-title":"Nat. Biotechnol."},{"key":"2019101104284201200_ref3","first-page":"75","article-title":"Saved by the BEL: ringing in a common language for the life sciences","author":"Slater","year":"2012"},{"key":"2019101104284201200_ref4","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1186\/1471-2105-15-238","article-title":"Quantification of biological network perturbations for mechanistic insight and diagnostics using two-layer causal models","volume":"15","author":"Martin","year":"2014","journal-title":"BMC Bioinformatics"},{"key":"2019101104284201200_ref5","doi-asserted-by":"crossref","first-page":"307","DOI":"10.4137\/BBI.S12932","article-title":"On crowd-verification of biological networks","volume":"7","author":"Ansari","year":"2013","journal-title":"Bioinform. Biol. Insights"},{"key":"2019101104284201200_ref6","first-page":"80","article-title":"BEL networks derived from qualitative translations of BioNLP shared task annotations","volume-title":"Proceedings of the 2013 Workshop on Biomedical Natural Language Processing","author":"Fluck","year":"2013"},{"key":"2019101104284201200_ref7","article-title":"Track 4 overview: extraction of causal network information in biological expression language (BEL)","volume-title":"Proceedings of the Fifth BioCreative Challenge Evaluation Workshop","author":"Fluck","year":"2015"},{"key":"2019101104284201200_ref8","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baw067","article-title":"BioCreative V track 4: a shared task for the extraction of causal network information using the biological expression language","volume":"2016","author":"Rinaldi","year":"2016","journal-title":"Database (Oxford)"},{"key":"2019101104284201200_ref9","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baw113","article-title":"Training and evaluation corpora for the extraction of causal relationships encoded in biological expression language (BEL)","volume":"2016","author":"Fluck","year":"2016","journal-title":"Database (Oxford)"},{"key":"2019101104284201200_ref10","doi-asserted-by":"crossref","first-page":"baw136","DOI":"10.1093\/database\/baw136","article-title":"The BEL information extraction workflow (BELIEF): evaluation in the BioCreative V BEL and IAT track","volume":"2016","author":"Madan","year":"2016","journal-title":"Database"},{"key":"2019101104284201200_ref11","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1038\/ncpgasthep0528","article-title":"Mechanisms of disease: pathogenesis of Crohn\u2019s disease and ulcerative colitis","volume":"3","author":"Sartor","year":"2006","journal-title":"Nat. Clin. Pract. Gastroenterol. Hepatol."},{"key":"2019101104284201200_ref12","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1016\/j.cppeds.2014.10.003","article-title":"Inflammatory bowel disease: the classic gastrointestinal autoimmune disease","volume":"44","author":"Kaistha","year":"2014","journal-title":"Curr. Probl. Pediatr. Adolesc. Health Care"},{"key":"2019101104284201200_ref13","article-title":"BELMiner-information extraction system to extract BEL relationships","volume-title":"Proceedings of the BioCreative VI","author":"Elayavilli","year":"2017"},{"key":"2019101104284201200_ref14","doi-asserted-by":"crossref","first-page":"2839","DOI":"10.1093\/bioinformatics\/btw343","article-title":"TaggerOne: joint named entity recognition and normalization with semi-Markov models","volume":"32","author":"Leaman","year":"2016","journal-title":"Bioinformatics"},{"key":"2019101104284201200_ref15","doi-asserted-by":"crossref","first-page":"1915","DOI":"10.1093\/bioinformatics\/btt317","article-title":"BeCAS: biomedical concept recognition services and visualization","volume":"29","author":"Nunes","year":"2013","journal-title":"Bioinformatics"},{"key":"2019101104284201200_ref16","article-title":"A domain-independent rule-based framework for event extraction, Assoc","author":"Valenzuela-Esc\u00e1rcega","year":"2015","journal-title":"Comput. Linguist"},{"key":"2019101104284201200_ref17","doi-asserted-by":"crossref","first-page":"55","DOI":"10.3115\/v1\/P14-5010","article-title":"The Stanford CoreNLP natural language processing toolkit","volume-title":"Proceedings of 52nd Annual Meeting of the Association for Computational Linguistic: Systems Demonstrations","author":"Manning","year":"2014"},{"key":"2019101104284201200_ref18","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1186\/s12859-015-0609-x","article-title":"Text mining facilitates database curation-extraction of mutation-disease associations from bio-medical literature","volume":"16","author":"Ravikumar","year":"2015","journal-title":"BMC Bioinformatics"},{"key":"2019101104284201200_ref19","article-title":"Generating biological expression language statements with pipeline approach and different parsers","volume-title":"Proceedings of the BioCreative VI Challenge Workshop","author":"Lai","year":"2017"},{"key":"2019101104284201200_ref20","article-title":"Statistical principle-based approach for gene and Protein related object recognition","volume-title":"Proceedings of the BioCreative V.5 Challenge Evaluation Workshop","author":"Lai","year":"2017"},{"key":"2019101104284201200_ref21","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baw135","article-title":"NERChem: adapting NERBio to chemical patents via full-token features and named entity feature with chemical sub-class composition","volume":"2016","author":"Tsai","year":"2016","journal-title":"Database"},{"key":"2019101104284201200_ref22","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1186\/1471-2105-15-160","article-title":"A resource-saving collective approach to biomedical semantic role labeling","volume":"15","author":"Tsai","year":"2014","journal-title":"BMC Bioinformatics"},{"key":"2019101104284201200_ref23","first-page":"1671","article-title":"Efficient HPSG parsing with supertagging and CFG-filtering","author":"Matsuzaki","year":"2007","journal-title":"Internation Joint Conferences on Artificial Intelligence"},{"key":"2019101104284201200_ref24","doi-asserted-by":"crossref","first-page":"S18","DOI":"10.1186\/1471-2105-9-S12-S18","article-title":"Semi-automatic conversion of BioProp semantic annotation to PASBio annotation","volume":"9","author":"Tsai","year":"2008","journal-title":"BMC Bioinformatics"},{"key":"2019101104284201200_ref25","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baw064","article-title":"BelSmile: a biomedical semantic role labeling approach for extracting biological expression language from text","volume":"2016","author":"Lai","year":"2016","journal-title":"Database (Oxford)"},{"key":"2019101104284201200_ref26","article-title":"A hierarchical sequence labeling system for BioCreative VI BEL task","volume-title":"Proceedings of the BioCreative VI Challenge Workshop","author":"Liu","year":"2017"},{"key":"2019101104284201200_ref27","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1155\/2015\/918710","article-title":"GNormPlus: an integrative approach for tagging genes, gene families, and protein domains","volume":"2015","author":"Wei","year":"2015","journal-title":"Biomed. Res. Int."},{"key":"2019101104284201200_ref28","doi-asserted-by":"crossref","first-page":"S3","DOI":"10.1186\/1758-2946-7-S1-S3","article-title":"TmChem: a high performance approach for chemical named entity recognition and normalization","volume":"7","author":"Leaman","year":"2015","journal-title":"J. Cheminform."},{"key":"2019101104284201200_ref29","doi-asserted-by":"crossref","first-page":"2909","DOI":"10.1093\/bioinformatics\/btt474","article-title":"DNorm: disease name normalization with pairwise learning to rank","volume":"29","author":"Leaman","year":"2013","journal-title":"Bioinformatics"},{"key":"2019101104284201200_ref30","volume-title":"GIZA++: Training of statistical translation models","author":"Casacuberta","year":"2007"},{"key":"2019101104284201200_ref31","article-title":"CRF++: yet another CRF toolkit","author":"Kudo","year":"2005"},{"key":"2019101104284201200_ref32","article-title":"Automatic extraction of BEL-statements based on neural networks","volume-title":"Proceedings of the BioCreative VI Challenge Workshop","author":"Ali","year":"2017"},{"key":"2019101104284201200_ref33","doi-asserted-by":"crossref","first-page":"S14","DOI":"10.1186\/1471-2105-6-S1-S14","article-title":"ProMiner: rule-based protein and gene entity recognition","volume":"6","author":"Hanisch","year":"2005","journal-title":"BMC Bioinformatics"},{"key":"2019101104284201200_ref34","first-page":"1","article-title":"Multi-channel convolutional neural network for biological relation extraction","volume":"2016","author":"Quan","year":"2016","journal-title":"Biomed. Res. Int."},{"key":"2019101104284201200_ref35","first-page":"1","article-title":"A shortest dependency path based convolutional neural network for protein\u2013protein relation extraction","volume":"2016","author":"Hua","year":"2016","journal-title":"Biomed. Res. Int."},{"key":"2019101104284201200_ref36","article-title":"Distributional semantics resources for biomedical text processing","volume-title":"Proceedings of Languages in Biology and Medicine 2013","author":"Pyysalo","year":"2013"},{"key":"2019101104284201200_ref37","article-title":"Semantic information retrieval: exploring dependency and word embedding features in biomedical information retrieval","volume-title":"Proceedings of the BioCreative VI","author":"Rastegar-Mojarad","year":"2017"},{"key":"2019101104284201200_ref38","doi-asserted-by":"crossref","first-page":"3158","DOI":"10.1093\/bioinformatics\/bts591","article-title":"SemMedDB: a PubMed-scale repository of biomedical semantic predications","volume":"28","author":"Kilicoglu","year":"2012","journal-title":"Bioinformatics"},{"key":"2019101104284201200_ref39","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baw079","article-title":"BELTracker: evidence sentence retrieval for BEL statements","volume":"2016","author":"Rastegar-Mojarad","year":"2016","journal-title":"Database (Oxford)"},{"key":"2019101104284201200_ref40","first-page":"36","volume-title":"Proceedings of the 8th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics\u2014ACM-BCB\u201917","author":"Wang","year":"2017"},{"key":"2019101104284201200_ref41","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.molimm.2016.05.011","article-title":"Sam68 modulates apoptosis of intestinal epithelial cells via mediating NF-\u03baB activation in ulcerative colitis","volume":"75","author":"Qian","year":"2016","journal-title":"Mol. Immunol."},{"key":"2019101104284201200_ref42","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1016\/j.lfs.2008.01.008","article-title":"Endothelin-1 enhances proliferation of lung cancer cells by increasing intracellular free Ca2+","volume":"82","author":"Zhang","year":"2008","journal-title":"Life Sci"},{"key":"2019101104284201200_ref43","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1186\/1479-5876-12-185","article-title":"A vascular biology network model focused on inflammatory processes to investigate atherogenesis and plaque instability","volume":"12","author":"De Le\u00f3n","year":"2014","journal-title":"J. Transl. Med."},{"key":"2019101104284201200_ref44","doi-asserted-by":"crossref","first-page":"bav030","DOI":"10.1093\/database\/bav030","article-title":"Causal biological network database: a comprehensive platform of causal biological network models focused on the pulmonary and vascular systems","volume":"2015","author":"Bou\u00e9","year":"2015","journal-title":"Database (Oxford)"},{"key":"2019101104284201200_ref45","doi-asserted-by":"crossref","first-page":"97","DOI":"10.4137\/BBI.S11154","article-title":"Construction of a computable network model for DNA damage, autophagy, cell death, and senescence","volume":"7","author":"Gebel","year":"2013","journal-title":"Bioinform. Biol. Insights"},{"key":"2019101104284201200_ref46","doi-asserted-by":"crossref","first-page":"6596","DOI":"10.4049\/jimmunol.1201876","article-title":"Mechanism of IL-1 modulation of intestinal epithelial barrier involves p38 kinase and activating transcription factor-2 activation","volume":"190","author":"Al-Sadi","year":"2013","journal-title":"J. Immunol."}],"container-title":["Database"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/database\/article-pdf\/doi\/10.1093\/database\/baz084\/30131322\/baz084.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/database\/article-pdf\/doi\/10.1093\/database\/baz084\/30131322\/baz084.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,10,11]],"date-time":"2019-10-11T08:52:39Z","timestamp":1570783959000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/database\/article\/doi\/10.1093\/database\/baz084\/5585579"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,1]]},"references-count":46,"URL":"https:\/\/doi.org\/10.1093\/database\/baz084","relation":{},"ISSN":["1758-0463"],"issn-type":[{"value":"1758-0463","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019]]},"published":{"date-parts":[[2019,1,1]]},"article-number":"baz084"}}