{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T09:37:07Z","timestamp":1762508227336,"version":"3.37.3"},"reference-count":29,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2020,10,1]],"date-time":"2020-10-01T00:00:00Z","timestamp":1601510400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>We explored how knowledge embeddings (KEs) learned from the Unified Medical Language System (UMLS) Metathesaurus impact the quality of relation extraction on 2 diverse sets of biomedical texts.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Two forms of KEs were learned for concepts and relation types from the UMLS Metathesaurus, namely lexicalized knowledge embeddings (LKEs) and unlexicalized KEs. A knowledge embedding encoder (KEE) enabled learning either LKEs or unlexicalized KEs as well as neural models capable of producing LKEs for mentions of biomedical concepts in texts and relation types that are not encoded in the UMLS Metathesaurus. This allowed us to design the relation extraction with knowledge embeddings (REKE) system, which incorporates either LKEs or unlexicalized KEs produced for relation types of interest and their arguments.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The incorporation of either LKEs or unlexicalized KE in REKE advances the state of the art in relation extraction on 2 relation extraction datasets: the 2010 i2b2\/VA dataset and the 2013 Drug-Drug Interaction Extraction Challenge corpus. Moreover, the impact of LKEs is superior, achieving F1 scores of 78.2 and 82.0, respectively.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>REKE not only highlights the importance of incorporating knowledge encoded in the UMLS Metathesaurus in a novel way, through 2 possible forms of KEs, but it also showcases the subtleties of incorporating KEs in relation extraction systems.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Incorporating LKEs informed by the UMLS Metathesaurus in a relation extraction system operating on biomedical texts shows significant promise. We present the REKE system, which establishes new state-of-the-art results for relation extraction on 2 datasets when using LKEs.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocaa205","type":"journal-article","created":{"date-parts":[[2020,8,7]],"date-time":"2020-08-07T11:35:53Z","timestamp":1596800153000},"page":"1556-1567","source":"Crossref","is-referenced-by-count":6,"title":["The impact of learning Unified Medical Language System knowledge embeddings in relation extraction from biomedical texts"],"prefix":"10.1093","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8049-7453","authenticated-orcid":false,"given":"Maxwell A","family":"Weinzierl","sequence":"first","affiliation":[{"name":"Human Language Technology Research Institute, Department of Computer Science, Erik Jonsson School of Engineering & Computer Science, University of Texas at Dallas, Richardson, Texas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ramon","family":"Maldonado","sequence":"additional","affiliation":[{"name":"Human Language Technology Research Institute, Department of Computer Science, Erik Jonsson School of Engineering & Computer Science, University of Texas at Dallas, Richardson, Texas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sanda M","family":"Harabagiu","sequence":"additional","affiliation":[{"name":"Human Language Technology Research Institute, Department of Computer Science, Erik Jonsson School of Engineering & Computer Science, University of Texas at Dallas, Richardson, Texas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,10,8]]},"reference":[{"author":"Maldonado","key":"2020110613121559600_ocaa205-B1"},{"author":"Peng","key":"2020110613121559600_ocaa205-B2","first-page":"58"},{"issue":"1","key":"2020110613121559600_ocaa205-B3","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1093\/bib\/bbw001","article-title":"Bridging semantics and syntax with graph algorithms-state-of-the-art of extracting biomedical relations","volume":"18","author":"Luo","year":"2017","journal-title":"Brief Bioinform"},{"issue":"5","key":"2020110613121559600_ocaa205-B4","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1136\/amiajnl-2011-000153","article-title":"Automatic extraction of relations between medical concepts in clinical texts","volume":"18","author":"Rink","year":"2011","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2020110613121559600_ocaa205-B5","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1197\/jamia.M3378","article-title":"MedEx: a medication information extraction system for clinical narratives","volume":"17","author":"Xu","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2020110613121559600_ocaa205-B6","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1136\/amiajnl-2011-000150","article-title":"Machine-learned solutions for three stages of clinical information extraction: the state of the art at i2b2 2010","volume":"18","author":"de Bruijn","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613121559600_ocaa205-B7","first-page":"67","volume-title":"AMIA Jt Summits Transl Sci Proc","author":"Luo","year":"2014"},{"key":"2020110613121559600_ocaa205-B8","first-page":"17","volume-title":"Proc AMIA Symp","author":"Aronson","year":"2001"},{"key":"2020110613121559600_ocaa205-B9","first-page":"4171","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","author":"Devlin","year":"2019"},{"author":"D\u2019Souza","key":"2020110613121559600_ocaa205-B10","first-page":"82"},{"issue":"5","key":"2020110613121559600_ocaa205-B11","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1136\/amiajnl-2011-000203","article-title":"2010 i2b2\/VA challenge on concepts, assertions, and relations in clinical text","volume":"18","author":"Uzuner","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613121559600_ocaa205-B12","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.artmed.2018.05.001","article-title":"Classifying medical relations in clinical text via convolutional neural networks","volume":"93","author":"He","year":"2019","journal-title":"Artif Intell Med"},{"issue":"1","key":"2020110613121559600_ocaa205-B13","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1093\/jamia\/ocx090","article-title":"Segment convolutional neural networks (Seg-CNNs) for classifying relations in clinical notes","volume":"25","author":"Luo","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2020110613121559600_ocaa205-B14","doi-asserted-by":"crossref","first-page":"828","DOI":"10.1093\/bioinformatics\/btx659","article-title":"Drug\u2013drug interaction extraction via hierarchical RNNs on sequence and shortest dependency paths","volume":"34","author":"Zhang","year":"2018","journal-title":"Bioinformatics"},{"author":"Li","key":"2020110613121559600_ocaa205-B15","first-page":"28"},{"author":"Faruqui","key":"2020110613121559600_ocaa205-B16","first-page":"1606"},{"author":"Alawad","key":"2020110613121559600_ocaa205-B17","first-page":"2838"},{"key":"2020110613121559600_ocaa205-B18","doi-asserted-by":"crossref","first-page":"D267","DOI":"10.1093\/nar\/gkh061","article-title":"The Unified Medical Language System (UMLS): integrating biomedical terminology","volume":"32","author":"Bodenreider","year":"2004","journal-title":"Nucleic Acids Res"},{"issue":"5","key":"2020110613121559600_ocaa205-B19","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1016\/j.jbi.2013.07.011","article-title":"The DDI corpus: An annotated corpus with pharmacological substances and drug\u2013drug interactions","volume":"46","author":"Herrero-Zazo","year":"2013","journal-title":"J Biomed Inform"},{"author":"Ji","key":"2020110613121559600_ocaa205-B20","first-page":"687"},{"author":"Nickel","key":"2020110613121559600_ocaa205-B21","first-page":"1955"},{"author":"Bordes","key":"2020110613121559600_ocaa205-B22","first-page":"2787"},{"year":"2015","author":"Yang","key":"2020110613121559600_ocaa205-B23"},{"author":"Cai","key":"2020110613121559600_ocaa205-B24","first-page":"1470"},{"first-page":"2672","year":"2014","author":"Goodfellow","key":"2020110613121559600_ocaa205-B25"},{"first-page":"2673","year":"1997","author":"Schuster","key":"2020110613121559600_ocaa205-B26"},{"issue":"3\u20134","key":"2020110613121559600_ocaa205-B27","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1007\/BF00992696","article-title":"Simple statistical gradient-following algorithms for connectionist reinforcement learning","volume":"8","author":"Williams","year":"1992","journal-title":"Mach Learn"},{"author":"Neumann","key":"2020110613121559600_ocaa205-B28","first-page":"319"},{"key":"2020110613121559600_ocaa205-B29","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"van der Maaten","year":"2008","journal-title":"J Mach Learn Res"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/10\/1556\/34153877\/ocaa205.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/10\/1556\/34153877\/ocaa205.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T19:39:00Z","timestamp":1604691540000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/10\/1556\/5919217"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,1]]},"references-count":29,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,10,8]]},"published-print":{"date-parts":[[2020,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa205","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2020,10]]},"published":{"date-parts":[[2020,10,1]]}}}