{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T03:45:58Z","timestamp":1787024758851,"version":"build-2736575974"},"reference-count":87,"publisher":"JMIR Publications Inc.","issue":"7","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Med Inform"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>An adverse drug event (ADE) is commonly defined as \u201can injury resulting from medical intervention related to a drug.\u201d Providing information related to ADEs and alerting caregivers at the point of care can reduce the risk of prescription and diagnostic errors and improve health outcomes. ADEs captured in structured data in electronic health records (EHRs) as either coded problems or allergies are often incomplete, leading to underreporting. Therefore, it is important to develop capabilities to process unstructured EHR data in the form of clinical notes, which contain a richer documentation of a patient\u2019s ADE. Several natural language processing (NLP) systems have been proposed to automatically extract information related to ADEs. However, the results from these systems showed that significant improvement is still required for the automatic extraction of ADEs from clinical notes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aims to improve the automatic extraction of ADEs and related information such as drugs, their attributes, and reason for administration from the clinical notes of patients.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This research was conducted using discharge summaries from the Medical Information Mart for Intensive Care III (MIMIC-III) database obtained through the 2018 National NLP Clinical Challenges (n2c2) annotated with drugs, drug attributes (ie, strength, form, frequency, route, dosage, duration), ADEs, reasons, and relations between drugs and other entities. We developed a deep learning\u2013based system for extracting these drug-centric concepts and relations simultaneously using a joint method enhanced with contextualized embeddings, a position-attention mechanism, and knowledge representations. The joint method generated different sentence representations for each drug, which were then used to extract related concepts and relations simultaneously. Contextualized representations trained on the MIMIC-III database were used to capture context-sensitive meanings of words. The position-attention mechanism amplified the benefits of the joint method by generating sentence representations that capture long-distance relations. Knowledge representations were obtained from graph embeddings created using the US Food and Drug Administration Adverse Event Reporting System database to improve relation extraction, especially when contextual clues were insufficient.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Our system achieved new state-of-the-art results on the n2c2 data set, with significant improvements in recognizing crucial drug\u2212reason (F1=0.650 versus F1=0.579) and drug\u2212ADE (F1=0.490 versus F1=0.476) relations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This study presents a system for extracting drug-centric concepts and relations that outperformed current state-of-the-art results and shows that contextualized embeddings, position-attention mechanisms, and knowledge graph embeddings effectively improve deep learning\u2013based concepts and relation extraction. This study demonstrates the potential for deep learning\u2013based methods to help extract real-world evidence from unstructured patient data for drug safety surveillance.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/18417","type":"journal-article","created":{"date-parts":[[2020,5,13]],"date-time":"2020-05-13T09:44:25Z","timestamp":1589363065000},"page":"e18417","source":"Crossref","is-referenced-by-count":30,"title":["Extraction of Information Related to Drug Safety Surveillance From Electronic Health Record Notes: Joint Modeling of Entities and Relations Using Knowledge-Aware Neural Attentive Models"],"prefix":"10.2196","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9643-991X","authenticated-orcid":false,"given":"Bharath","family":"Dandala","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8426-3219","authenticated-orcid":false,"given":"Venkata","family":"Joopudi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1273-5904","authenticated-orcid":false,"given":"Ching-Huei","family":"Tsou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5197-1590","authenticated-orcid":false,"given":"Jennifer J","family":"Liang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8619-2976","authenticated-orcid":false,"given":"Parthasarathy","family":"Suryanarayanan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2020,7,10]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.7.1.e3"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.4338\/ACI-2010-03-RA-0019"},{"issue":"1","key":"ref3","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1001\/jama.1995.03530010043033","volume":"274","author":"Bates, DW","year":"1995","journal-title":"J Am Med Assoc"},{"issue":"18","key":"ref4","doi-asserted-by":"crossref","first-page":"1949","DOI":"10.1001\/archinte.1995.00430180043006","volume":"155","author":"Johnson, JA","year":"1995","journal-title":"Arch Intern Med"},{"issue":"4","key":"ref5","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1001\/jama.1997.03540280039031","volume":"277","author":"Classen, DC","year":"1997","journal-title":"J Am Med Assoc"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1007\/BF03319105"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1046\/j.1525-1497.2003.20130.x"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.2165\/00002018-200629050-00003"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000214"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.329.7456.15"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1038\/clpt.2012.54"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1186\/2041-1480-3-S1-S5"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1038\/clpt.2013.47"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.26"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1038\/clpt.2012.50"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-153-9-201011020-00010"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.02.004"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocu041"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1007\/s40264-014-0155-x"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1007\/s40264-014-0218-z"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1142\/9789814644730_0030"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1038\/clpt.2014.77"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1038\/clpt.2011.55"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1038\/clpt.2008.274"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000417"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000203"},{"key":"ref27","unstructured":"RobertsKDemner-FushmanDTonningJMOverview of the TAC 2017 Adverse Reaction Extraction from Drug Labels TrackSemantic Scholar20172020-06-22https:\/\/pdfs.semanticscholar.org\/5b8a\/7b11b987ddeb865dbf3aaa7b745a86ea5bf0.pdf"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1093\/database\/baw068"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1007\/s40264-018-0762-z"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz166"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.1093\/database\/baw036"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-6-S1-S5"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1093\/database\/baw032"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2012.04.008"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1561\/2200000013"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1108\/k.2001.30.1.103.6"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1007\/s40264-018-0764-x"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz063"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.2196\/12159"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz075"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz120"},{"key":"ref42","doi-asserted-by":"publisher","DOI":"10.1007\/s40264-018-0765-9"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.1007\/s40264-018-0763-y"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz144"},{"key":"ref45","author":"Chalapathy, R","year":"2016","journal-title":"arXiv"},{"key":"ref46","unstructured":"KimYJerniteYSontagDRushACharacter-Aware Neural Language ModelsProceedings of the Thirtieth AAAI Conference on Artificial Intelligence2016AAAI'16February 12-17, 2016Phoenix, Arizona, USA"},{"key":"ref47","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-017-1609-9"},{"key":"ref48","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-5529-2_5"},{"key":"ref49","unstructured":"BahdanauDChoKBengioYNeural Machine Translation by Jointly Learning to Align and TranslateProceedings of the 3rd International Conference for Learning Representations2015ICLR'15May 7-9, 2015San Diego, CA, USA"},{"key":"ref50","first-page":"5998","author":"Vaswani, A","year":"2017","journal-title":"Adv Neural Inf Process Syst"},{"key":"ref51","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/p17-1018"},{"key":"ref52","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/p16-2034"},{"key":"ref53","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d17-1004"},{"key":"ref54","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016300"},{"key":"ref55","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz101"},{"key":"ref56","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-019-2873-7"},{"key":"ref57","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1141"},{"key":"ref58","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210081"},{"key":"ref59","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1022"},{"key":"ref60","doi-asserted-by":"publisher","DOI":"10.5555\/2999792.2999923"},{"key":"ref61","unstructured":"WangZZhangJFengJChenZKnowledge Graph Embedding by Translating on HyperplanesProceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence2014AAAI'14July 27-31, 2014Qu\u00e9bec City, Qu\u00e9bec, Canada"},{"key":"ref62","unstructured":"LinYLiuZSunMLiuYZhuXLearning Entity and Relation Embeddings for Knowledge Graph CompletionProceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence2015AAAI'15January 25-30, 2015Austin, Texas, USA"},{"key":"ref63","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623732"},{"key":"ref64","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939754"},{"key":"ref65","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741093"},{"key":"ref66","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3209987"},{"key":"ref67","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz141"},{"key":"ref68","unstructured":"LoperEBirdSNLTK: The Natural Language Toolkit20022020-06-22https:\/\/www.nltk.org\/"},{"key":"ref69","unstructured":"HonnibalMMontaniIspaCy v2GitHub20172020-06-22https:\/\/github.com\/explosion\/spaCy\/issues\/1555"},{"key":"ref70","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/p14-5010"},{"key":"ref71","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.07.010"},{"key":"ref72","unstructured":"MikolovTSutskeverIChenKCorradoGDeanJDistributed Representations of Words and Phrases and their CompositionalityNIPS Proceedings20132020-06-22https:\/\/papers.nips.cc\/paper\/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf"},{"key":"ref73","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/d14-1162"},{"key":"ref74","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/e17-2068"},{"key":"ref75","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1149"},{"key":"ref76","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.35"},{"key":"ref77","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/n18-1202"},{"key":"ref78","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1423"},{"key":"ref79","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz096"},{"key":"ref80","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkh061"},{"key":"ref81","author":"Huang, Z","year":"2015","journal-title":"arXiv"},{"key":"ref82","unstructured":"ZengDLiuKLaiSZhouGZhaoJRelation Classification via Convolutional Deep Neural NetworkProceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers2014COLING'14August 23-29, 2014Dublin, Ireland"},{"key":"ref83","doi-asserted-by":"publisher","DOI":"10.1080\/00223980.1969.10543491"},{"key":"ref84","doi-asserted-by":"publisher","DOI":"10.1109\/tcss.2018.2877083"},{"key":"ref85","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz682"},{"key":"ref86","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2018.07.025"},{"key":"ref87","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00049"}],"container-title":["JMIR Medical Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/medinform.jmir.org\/2020\/7\/e18417","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:23:20Z","timestamp":1782840200000},"score":1,"resource":{"primary":{"URL":"https:\/\/medinform.jmir.org\/2020\/7\/e18417"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,10]]},"references-count":87,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2020]]}},"URL":"https:\/\/doi.org\/10.2196\/18417","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.18417","asserted-by":"object"}]},"ISSN":["2291-9694"],"issn-type":[{"value":"2291-9694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,10]]}}}