{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T12:15:47Z","timestamp":1761394547108},"reference-count":34,"publisher":"Oxford University Press (OUP)","issue":"e1","content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2015,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Objective To evaluate the contribution of the MEDication Indication (MEDI) resource and SemRep for identifying treatment relations in clinical text.<\/jats:p>\n               <jats:p>Materials and methods We first processed clinical documents with SemRep to extract the Unified Medical Language System (UMLS) concepts and the treatment relations between them. Then, we incorporated MEDI into a simple algorithm that identifies treatment relations between two concepts if they match a medication-indication pair in this resource. For a better coverage, we expanded MEDI using ontology relationships from RxNorm and UMLS Metathesaurus. We also developed two ensemble methods, which combined the predictions of SemRep and the MEDI algorithm. We evaluated our selected methods on two datasets, a Vanderbilt corpus of 6864 discharge summaries and the 2010 Informatics for Integrating Biology and the Bedside (i2b2)\/Veteran's Affairs (VA) challenge dataset.<\/jats:p>\n               <jats:p>Results The Vanderbilt dataset included 958 manually annotated treatment relations. A double annotation was performed on 25% of relations with high agreement (Cohen's \u03ba = 0.86). The evaluation consisted of comparing the manual annotated relations with the relations identified by SemRep, the MEDI algorithm, and the two ensemble methods. On the first dataset, the best F1-measure results achieved by the MEDI algorithm and the union of the two resources (78.7 and 80, respectively) were significantly higher than the SemRep results (72.3). On the second dataset, the MEDI algorithm achieved better precision and significantly lower recall values than the best system in the i2b2 challenge. The two systems obtained comparable F1-measure values on the subset of i2b2 relations with both arguments in MEDI.<\/jats:p>\n               <jats:p>Conclusions Both SemRep and MEDI can be used to extract treatment relations from clinical text. Knowledge-based extraction with MEDI outperformed use of SemRep alone, but superior performance was achieved by integrating both systems. The integration of knowledge-based resources such as MEDI into information extraction systems such as SemRep and the i2b2 relation extractors may improve treatment relation extraction from clinical text.<\/jats:p>","DOI":"10.1136\/amiajnl-2014-002954","type":"journal-article","created":{"date-parts":[[2014,10,22]],"date-time":"2014-10-22T03:14:01Z","timestamp":1413947641000},"page":"e162-e176","update-policy":"http:\/\/dx.doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":13,"title":["Assessing the role of a medication-indication resource in the treatment relation extraction from clinical text"],"prefix":"10.1093","volume":"22","author":[{"given":"Cosmin Adrian","family":"Bejan","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University, Nashville, Tennessee, USA"}]},{"given":"Wei-Qi","family":"Wei","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University, Nashville, Tennessee, USA"}]},{"given":"Joshua C","family":"Denny","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University, Nashville, Tennessee, USA"},{"name":"Department of Medicine, Vanderbilt University, Nashville, Tennessee, USA"}]}],"member":"286","published-online":{"date-parts":[[2014,10,21]]},"reference":[{"key":"2020110612592732600_R1","doi-asserted-by":"crossref","first-page":"825","DOI":"10.1056\/NEJMsa1102519","article-title":"Electronic health records and quality of diabetes care","volume":"365","author":"Cebul","year":"2011","journal-title":"N Engl J Med"},{"key":"2020110612592732600_R2","doi-asserted-by":"crossref","first-page":"125","DOI":"10.2147\/SAR.S23030","article-title":"Improving drug abuse treatment delivery through adoption of harmonized electronic health record systems","volume":"2011","author":"Ghitza","year":"2011","journal-title":"Subst Abuse Rehabil"},{"key":"2020110612592732600_R3","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1136\/amiajnl-2011-000699","article-title":"Large-scale prediction of adverse drug reactions using chemical, biological, and phenotypic properties of drugs","volume":"19","author":"Liu","year":"2012","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612592732600_R4","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1177\/1062860609336627","article-title":"The challenge of measuring quality of care from the electronic health record","volume":"24","author":"Roth","year":"2009","journal-title":"Am J Med Qual"},{"key":"2020110612592732600_R5","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.1111\/j.1532-5415.2009.02243.x","article-title":"Measuring the quality of medication use in older adults","volume":"57","author":"Roth","year":"2009","journal-title":"J Am Geriatr Soc"},{"key":"2020110612592732600_R6","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1016\/j.jbi.2003.11.003","article-title":"The interaction of domain knowledge and linguistic structure in natural language processing: interpreting hypernymic propositions in biomedical text","volume":"36","author":"Rindflesch","year":"2003","journal-title":"J Biomed Inform"},{"key":"2020110612592732600_R7","doi-asserted-by":"crossref","first-page":"954","DOI":"10.1136\/amiajnl-2012-001431","article-title":"Development and evaluation of an ensemble resource linking medications to their indications","volume":"20","author":"Wei","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612592732600_R8","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1136\/amiajnl-2011-000203","article-title":"2010 i2b2\/VA challenge on concepts, assertions, and relations in clinical text","volume":"18","author":"Uzuner","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612592732600_R9","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1136\/amiajnl-2011-000153","article-title":"Automatic extraction of relations between medical concepts in clinical texts","volume":"18","author":"Rink","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612592732600_R10","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1136\/amiajnl-2011-000150","article-title":"Machine-learned solutions for three stages of clinical information extraction: the state of the art at i2b2 2010","volume":"18","author":"De Bruijn","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612592732600_R11","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1136\/amiajnl-2011-000154","article-title":"Hybrid methods for improving information access in clinical documents: concept, assertion, and relation identification","volume":"18","author":"Minard","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612592732600_R12","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1136\/amiajnl-2011-000302","article-title":"A knowledge discovery and reuse pipeline for information extraction in clinical notes","volume":"18","author":"Patrick","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612592732600_R13","first-page":"17","article-title":"Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program","author":"Aronson","year":"2001"},{"key":"2020110612592732600_R14","first-page":"239","article-title":"Integrating a hypernymic proposition interpreter into a semantic processor for biomedical texts","author":"Fiszman","year":"2003"},{"key":"2020110612592732600_R15","first-page":"634","article-title":"Medical facts to support inferencing in natural language processing","author":"Rindflesch","year":"2005"},{"key":"2020110612592732600_R16","first-page":"76","article-title":"Abstraction summarization for managing the biomedical research literature","author":"Fiszman","year":"2004"},{"key":"2020110612592732600_R17","first-page":"1514","article-title":"Graph-based methods for discovery browsing with semantic predications","author":"Wilkowski","year":"2011"},{"key":"2020110612592732600_R18","first-page":"349","article-title":"Exploiting semantic relations for literature-based discovery","author":"Hristovski","year":"2006"},{"key":"2020110612592732600_R19","first-page":"587","article-title":"Using SemRep to label semantic relations extracted from clinical text","author":"Liu","year":"2012"},{"key":"2020110612592732600_R20","doi-asserted-by":"crossref","DOI":"10.1038\/msb.2009.98","article-title":"A side effect resource to capture phenotypic effects of drugs","volume":"6","author":"Kuhn","year":"2010","journal-title":"Mol Syst Biol"},{"key":"2020110612592732600_R21","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1197\/jamia.M1176","article-title":"\u2018Understanding\u2019 medical school curriculum content using KnowledgeMap","volume":"10","author":"Denny","year":"2003","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612592732600_R22","first-page":"196","article-title":"Identifying UMLS concepts from ECG impressions using KnowledgeMap","author":"Denny","year":"2005"},{"key":"2020110612592732600_R23","first-page":"102","article-title":"BRAT: a web-based tool for NLP-assisted text annotation","author":"Stenetorp","year":"2012"},{"key":"2020110612592732600_R24","volume-title":"Computer-intensive methods for testing hypotheses: an introduction","author":"Noreen","year":"1989","edition":"1st edn."},{"key":"2020110612592732600_R25","doi-asserted-by":"crossref","DOI":"10.1007\/0-387-25739-X_14","article-title":"Semantic interpretation for the biomedical research literature","volume-title":"Medical Informatics: Knowledge Management and Data Mining in Biomedicine. New York: Springer, 2005:399\u2013422","author":"Rindflesch"},{"key":"2020110612592732600_R26","first-page":"209","article-title":"Extracting semantic predications from Medline citations for pharmacogenomics","author":"Ahlers","year":"2007"},{"key":"2020110612592732600_R27","first-page":"1448","article-title":"Validation and enhancement of a Computable Medication Indication Resource (MEDI) using a large practice-based dataset","author":"Wei","year":"2013"},{"key":"2020110612592732600_R28","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1136\/bmj.321.7258.429","article-title":"A taxonomy of generic clinical questions: classification study","volume":"321","author":"Ely","year":"2000","journal-title":"BMJ"},{"key":"2020110612592732600_R29","doi-asserted-by":"crossref","first-page":"79re1","DOI":"10.1126\/scitranslmed.3001807","article-title":"Electronic medical records for genetic research: results of the eMERGE consortium","volume":"3:","author":"Kho","year":"2011","journal-title":"Sci Transl Med"},{"key":"2020110612592732600_R30","doi-asserted-by":"crossref","first-page":"e1002823","DOI":"10.1371\/journal.pcbi.1002823","article-title":"Chapter 13: Mining electronic health records in the genomics era","volume":"8","author":"Denny","year":"2012","journal-title":"PLoS Comput Biol"},{"key":"2020110612592732600_R31","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1136\/amiajnl-2012-000896","article-title":"Validation of electronic medical record-based phenotyping algorithms: results and lessons learned from the eMERGE network","volume":"20","author":"Newton","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612592732600_R32","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.jbi.2012.09.001","article-title":"Assertion modeling and its role in clinical phenotype identification","volume":"46","author":"Bejan","year":"2013","journal-title":"J Biomed Inform"},{"key":"2020110612592732600_R33","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1136\/amiajnl-2011-000752","article-title":"Pneumonia identification using statistical feature selection","volume":"19","author":"Bejan","year":"2012","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612592732600_R34","doi-asserted-by":"crossref","first-page":"e69932","DOI":"10.1371\/journal.pone.0069932","article-title":"Automatic prediction of rheumatoid arthritis disease activity from the electronic medical records","volume":"8","author":"Lin","year":"2013","journal-title":"PLoS One"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/22\/e1\/e162\/34146344\/amiajnl-2014-002954.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/22\/e1\/e162\/34146344\/amiajnl-2014-002954.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T18:37:41Z","timestamp":1604687861000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/22\/e1\/e162\/702228"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,10,21]]},"references-count":34,"journal-issue":{"issue":"e1","published-online":{"date-parts":[[2014,10,21]]},"published-print":{"date-parts":[[2015,4,1]]}},"URL":"https:\/\/doi.org\/10.1136\/amiajnl-2014-002954","relation":{},"ISSN":["1527-974X","1067-5027"],"issn-type":[{"value":"1527-974X","type":"electronic"},{"value":"1067-5027","type":"print"}],"subject":[],"published-other":{"date-parts":[[2015,4]]},"published":{"date-parts":[[2014,10,21]]}}}