{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T06:28:56Z","timestamp":1778826536407,"version":"3.51.4"},"reference-count":37,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2019,4,2]],"date-time":"2019-04-02T00:00:00Z","timestamp":1554163200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["5R01HL125089"],"award-info":[{"award-number":["5R01HL125089"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Health Services Research"},{"name":"U.S. Department of Veterans Affairs Investigator-Initiated Research","award":["1I01HX001457-01"],"award-info":[{"award-number":["1I01HX001457-01"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>We aim to evaluate the effectiveness of advanced deep learning models (eg, capsule network [CapNet], adversarial training [ADV]) for single-domain and multidomain relation extraction from electronic health record (EHR) notes.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We built multiple deep learning models with increased complexity, namely a multilayer perceptron (MLP) model and a CapNet model for single-domain relation extraction and fully shared (FS), shared-private (SP), and adversarial training (ADV) modes for multidomain relation extraction. Our models were evaluated in 2 ways: first, we compared our models using our expert-annotated cancer (the MADE1.0 corpus) and cardio corpora; second, we compared our models with the systems in the MADE1.0 and i2b2 challenges.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Multidomain models outperform single-domain models by 0.7%-1.4% in F1 (t test P\u2009&amp;lt;\u2009.05), but the results of FS, SP, and ADV modes are mixed. Our results show that the MLP model generally outperforms the CapNet model by 0.1%-1.0% in F1. In the comparisons with other systems, the CapNet model achieves the state-of-the-art result (87.2% in F1) in the cancer corpus and the MLP model generally outperforms MedEx in the cancer, cardiovascular diseases, and i2b2 corpora.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Our MLP or CapNet model generally outperforms other state-of-the-art systems in medication and adverse drug event relation extraction. Multidomain models perform better than single-domain models. However, neither the SP nor the ADV mode can always outperform the FS mode significantly. Moreover, the CapNet model is not superior to the MLP model for our corpora.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocz018","type":"journal-article","created":{"date-parts":[[2019,1,31]],"date-time":"2019-01-31T20:14:59Z","timestamp":1548965699000},"page":"646-654","source":"Crossref","is-referenced-by-count":23,"title":["An investigation of single-domain and multidomain medication and adverse drug event relation extraction from electronic health record notes using advanced deep learning models"],"prefix":"10.1093","volume":"26","author":[{"given":"Fei","family":"Li","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Massachusetts Lowell, Lowell, Massachusetts, USA"},{"name":"Center for Healthcare Organization and Implementation Research, Bedford Veterans Affairs Medical Center, Bedford, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hong","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Massachusetts Lowell, Lowell, Massachusetts, USA"},{"name":"Center for Healthcare Organization and Implementation Research, Bedford Veterans Affairs Medical Center, Bedford, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2019,4,2]]},"reference":[{"issue":"3","key":"2020110613064704600_ocz018-B1","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1197\/jamia.M2777","article-title":"Comparison of information content of structured and narrative text data sources on the example of medication intensification","volume":"16","author":"Turchin","year":"2009","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613064704600_ocz018-B2","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.jbi.2015.08.013","article-title":"Identifying adverse drug event information in clinical notes with distributional semantic representations of context","volume":"57","author":"Henriksson","year":"2015","journal-title":"J Biomed Inform"},{"issue":"5","key":"2020110613064704600_ocz018-B3","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1136\/amiajnl-2011-000203","article-title":"2010 i2b2\/VA challenge on concepts, assertions, and relations in clinical text","volume":"18","author":"Uzuner","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613064704600_ocz018-B4","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baw032","article-title":"Assessing the state of the art in biomedical relation extraction: overview of the BioCreative V chemical-disease relation (CDR) task","volume":"2016","author":"Wei","year":"2016","journal-title":"Database"},{"issue":"5","key":"2020110613064704600_ocz018-B5","doi-asserted-by":"crossref","first-page":"954","DOI":"10.1136\/amiajnl-2012-001431","article-title":"Development and evaluation of an ensemble resource linking medications to their indications","volume":"20","author":"Wei","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613064704600_ocz018-B6","doi-asserted-by":"crossref","first-page":"12","DOI":"10.18653\/v1\/W16-3002","volume-title":"Proceedings of the 4th BioNLP Shared Task Workshop","author":"Del\u00e9ger","year":"2016"},{"key":"2020110613064704600_ocz018-B7","first-page":"341","volume-title":"Seventh International Workshop on Semantic Evaluation (SemEval 2013)","author":"Segura-Bedmar","year":"2013"},{"key":"2020110613064704600_ocz018-B8","doi-asserted-by":"crossref","first-page":"i180","DOI":"10.1093\/bioinformatics\/btg1023","article-title":"GENIA corpus\u2014a semantically annotated corpus for bio-textmining","volume":"19 (Suppl 1)","author":"Kim","year":"2003","journal-title":"Bioinformatics"},{"key":"2020110613064704600_ocz018-B9","first-page":"141","volume-title":"Proceedings of the BioCreative VI Workshop","author":"Krallinger","year":"2017"},{"issue":"5","key":"2020110613064704600_ocz018-B10","doi-asserted-by":"crossref","first-page":"885","DOI":"10.1016\/j.jbi.2012.04.008","article-title":"Development of a benchmark corpus to support the automatic extraction of drug-related adverse effects from medical case reports","volume":"45","author":"Gurulingappa","year":"2012","journal-title":"J Biomed Inform"},{"key":"2020110613064704600_ocz018-B11","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baw036","article-title":"CD-REST: a system for extracting chemical-induced disease relation in literature","volume":"2016","author":"Xu","year":"2016","journal-title":"Database"},{"issue":"2","key":"2020110613064704600_ocz018-B12","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1136\/amiajnl-2013-002051","article-title":"Determining molecular predictors of adverse drug reactions with causality analysis based on structure learning","volume":"21","author":"Liu","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613064704600_ocz018-B13","doi-asserted-by":"crossref","DOI":"10.1186\/s12859-016-1009-6","article-title":"Sortal anaphora resolution to enhance relation extraction from biomedical literature","volume":"17","author":"Kilicoglu","year":"2016","journal-title":"BMC Bioinformatics"},{"issue":"2","key":"2020110613064704600_ocz018-B14","doi-asserted-by":"crossref","first-page":"e29.","DOI":"10.2196\/publichealth.9361","article-title":"Clinical relation extraction toward drug safety surveillance using electronic health record narratives: classical learning versus deep learning","volume":"4","author":"Munkhdalai","year":"2018","journal-title":"JMIR Public Health Surveill"},{"issue":"1","key":"2020110613064704600_ocz018-B15","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1093\/jamia\/ocx090","article-title":"Segment convolutional neural networks (Seg-CNNs) for classifying relations in clinical notes","volume":"25","author":"Luo","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613064704600_ocz018-B16","first-page":"3856","volume-title":"Advances in Neural Information Processing Systems","author":"Sabour","year":"2017"},{"key":"2020110613064704600_ocz018-B17","first-page":"1226","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics","author":"Chen","year":"2018"},{"key":"2020110613064704600_ocz018-B18","doi-asserted-by":"crossref","DOI":"10.1093\/bioinformatics\/bty190","article-title":"Generalizing biomedical relation classification with neural adversarial domain adaptation","volume":"34","author":"Rios","year":"2018","journal-title":"Bioinformatics"},{"key":"2020110613064704600_ocz018-B19","first-page":"872","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics","author":"Verga","year":"2018"},{"key":"2020110613064704600_ocz018-B20","doi-asserted-by":"crossref","first-page":"80","DOI":"10.18653\/v1\/W17-2310","volume-title":"BioNLP 2017","author":"Mehryary","year":"2017"},{"key":"2020110613064704600_ocz018-B21","first-page":"1105","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics","author":"Miwa","year":"2016"},{"issue":"1","key":"2020110613064704600_ocz018-B22","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1186\/s12859-017-1609-9","article-title":"A neural joint model for entity and relation extraction from biomedical text","volume":"18","author":"Li","year":"2017","journal-title":"BMC Bioinformatics"},{"key":"2020110613064704600_ocz018-B23","first-page":"856","article-title":"Structured prediction models for RNN based sequence labeling in clinical text","volume":"2016","author":"Jagannatha","year":"2016","journal-title":"Proc Conf Empir Methods Nat Lang Process"},{"key":"2020110613064704600_ocz018-B24","first-page":"1","volume-title":"International Conference on Learning Representations","author":"Hinton","year":"2018"},{"key":"2020110613064704600_ocz018-B25","first-page":"1","volume-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Articles)","author":"Liu","year":"2017"},{"issue":"1","key":"2020110613064704600_ocz018-B26","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1197\/jamia.M3378","article-title":"MedEx: a medication information extraction system for clinical narratives","volume":"17","author":"Xu","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2020110613064704600_ocz018-B27","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/s40264-018-0762-z","article-title":"Overview of the first natural language processing challenge for extracting medication, indication, and adverse drug events from electronic health record notes (MADE 1.0)","volume":"42","author":"Jagannatha","year":"2019","journal-title":"Drug Saf"},{"issue":"5","key":"2020110613064704600_ocz018-B28","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1136\/jamia.2010.003947","article-title":"Extracting medication information from clinical text","volume":"17","author":"Uzuner","year":"2010","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613064704600_ocz018-B29","first-page":"2335","volume-title":"Proceedings of COLING 2014","author":"Zeng","year":"2014"},{"key":"2020110613064704600_ocz018-B30","doi-asserted-by":"crossref","first-page":"1746","DOI":"10.3115\/v1\/D14-1181","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Kim","year":"2014"},{"key":"2020110613064704600_ocz018-B31","doi-asserted-by":"crossref","first-page":"1412","DOI":"10.18653\/v1\/D15-1166","volume-title":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing","author":"Luong","year":"2015"},{"key":"2020110613064704600_ocz018-B32","first-page":"16","volume-title":"International Workshop on Medication and Adverse Drug Event Detection","author":"Chapman","year":"2018"},{"key":"2020110613064704600_ocz018-B33","first-page":"39","article-title":"IBM research system at MADE 2018: detecting adverse drug events from electronic health","volume-title":"International Workshop on Medication and Adverse Drug Event Detection","author":"Dandala","year":"2018"},{"key":"2020110613064704600_ocz018-B34","first-page":"57","volume-title":"International Workshop on Medication and Adverse Drug Event Detection","author":"Xu","year":"2018"},{"key":"2020110613064704600_ocz018-B35","first-page":"1","volume-title":"Advances in Neural Information Processing Systems","author":"Salimans","year":"2016"},{"issue":"5","key":"2020110613064704600_ocz018-B36","doi-asserted-by":"crossref","first-page":"806","DOI":"10.1136\/amiajnl-2013-001628","article-title":"Evaluating temporal relations in clinical text: 2012 i2b2 challenge","volume":"20","author":"Sun","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2020110613064704600_ocz018-B37","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/s40264-014-0145-z","article-title":"Dose-specific adverse drug reaction identification in electronic patient records: temporal data mining in an inpatient psychiatric population","volume":"37","author":"Eriksson","year":"2014","journal-title":"Drug Saf"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/7\/646\/34151520\/ocz018.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/7\/646\/34151520\/ocz018.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T19:10:31Z","timestamp":1604689831000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/26\/7\/646\/5426087"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,2]]},"references-count":37,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2019,4,2]]},"published-print":{"date-parts":[[2019,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocz018","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,7]]},"published":{"date-parts":[[2019,4,2]]}}}