{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,8]],"date-time":"2025-07-08T15:31:36Z","timestamp":1751988696071},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2013,4,24]],"date-time":"2013-04-24T00:00:00Z","timestamp":1366761600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2013,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Cincinnati Children\u2019s Hospital Medical Center (CCHMC) has built the initial Natural Language Processing (NLP) component to extract medications with their corresponding medical conditions (Indications, Contraindications, Overdosage, and Adverse Reactions) as triples of medication-related information ([(1) drug name]-[(2) medical condition]-[(3) LOINC section header]) for an intelligent database system, in order to improve patient safety and the quality of health care. The Food and Drug Administration\u2019s (FDA) drug labels are used to demonstrate the feasibility of building the triples as an intelligent database system task.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>This paper discusses a hybrid NLP system, called AutoMCExtractor, to collect medical conditions (including disease\/disorder and sign\/symptom) from drug labels published by the FDA. Altogether, 6,611 medical conditions in a manually-annotated gold standard were used for the system evaluation. The pre-processing step extracted the plain text from XML file and detected eight related LOINC sections (e.g. Adverse Reactions, Warnings and Precautions) for medical condition extraction. Conditional Random Fields (CRF) classifiers, trained on token, linguistic, and semantic features, were then used for medical condition extraction. Lastly, dictionary-based post-processing corrected boundary-detection errors of the CRF step. We evaluated the AutoMCExtractor on manually-annotated FDA drug labels and report the results on both token and span levels.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>Precision, recall, and F-measure were 0.90, 0.81, and 0.85, respectively, for the span level exact match; for the token-level evaluation, precision, recall, and F-measure were 0.92, 0.73, and 0.82, respectively.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions<\/jats:title>\n            <jats:p>The results demonstrate that (1) medical conditions can be extracted from FDA drug labels with high performance; and (2) it is feasible to develop a framework for an intelligent database system.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/1472-6947-13-53","type":"journal-article","created":{"date-parts":[[2013,4,24]],"date-time":"2013-04-24T17:22:12Z","timestamp":1366824132000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Mining FDA drug labels for medical conditions"],"prefix":"10.1186","volume":"13","author":[{"given":"Qi","family":"Li","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Louise","family":"Deleger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Todd","family":"Lingren","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haijun","family":"Zhai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Megan","family":"Kaiser","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laura","family":"Stoutenborough","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anil G","family":"Jegga","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kevin Bretonnel","family":"Cohen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Imre","family":"Solti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2013,4,24]]},"reference":[{"key":"671_CR1","unstructured":"Why learn about Adverse Drug Reactions (ADR)?.http:\/\/www.fda.gov\/Drugs\/DevelopmentApprovalProcess\/DevelopmentResources\/DrugInteractionsLabeling\/ucm114848.htm,"},{"issue":"2","key":"671_CR2","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1542\/peds.2005-2429","volume":"118","author":"J Le","year":"2006","unstructured":"Le J, Nguyen T, Law AV, Hodding J: Adverse drug reactions among children over a 10-year period. Pediatrics. 2006, 118 (2): 555-562. 10.1542\/peds.2005-2429.","journal-title":"Pediatrics"},{"issue":"5","key":"671_CR3","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1136\/qshc.2008.031393","volume":"19","author":"SE Muething","year":"2010","unstructured":"Muething SE, Conway PH, Kloppenborg E, Lesko A, Schoettker PJ, Seid M, Kotagal U: Identifying causes of adverse events detected by an automated trigger tool through in-depth analysis. Qual Saf Health Care. 2010, 19 (5): 435-439. 10.1136\/qshc.2008.031393.","journal-title":"Qual Saf Health Care"},{"key":"671_CR4","unstructured":"Adverse Event Reporting System (AERS).http:\/\/www.fda.gov\/Drugs\/GuidanceComplianceRegulatoryInformation\/Surveillance\/AdverseDrugEffects\/,"},{"key":"671_CR5","unstructured":"FDA Label.http:\/\/www.fda.gov\/ScienceResearch\/BioinformaticsTools\/ucm289739.htm,"},{"key":"671_CR6","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1145\/1882992.1883070","volume-title":"Proceedings of the First ACM International Health Informatics Symposium: November 11 - 12, 2010","author":"R Boyce","year":"2010","unstructured":"Boyce R, Harkema H, Conway M:Leveraging the semantic web and natural language processing to enhance drug-mechanism knowledge in drug product labels. Proceedings of the First ACM International Health Informatics Symposium: November 11 - 12, 2010. 2010, Arlington, VA, USA, 492-496."},{"key":"671_CR7","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1016\/j.drudis.2011.05.007","volume":"16","author":"M Chen","year":"2011","unstructured":"Chen M, Vijay V, Shi Q, Liu Z, Fang H, Tong W: FDA-approved drug labelling for the study of drug-induced liver injury. Drug Discov Today. 2011, 16: 697-703. 10.1016\/j.drudis.2011.05.007.","journal-title":"Drug Discov Today"},{"issue":"1","key":"671_CR8","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.jaci.2005.10.031","volume":"117","author":"S Murphy","year":"2006","unstructured":"Murphy S, Roberts R: \u201cBlack box\u201d 101: How the Food and Drug Administration evaluates, communicates, and manages drug benefit\/risk. J Allergy Clin Immunol. 2006, 117 (1): 34-39. 10.1016\/j.jaci.2005.10.031.","journal-title":"J Allergy Clin Immunol"},{"issue":"3","key":"671_CR9","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1136\/jamia.1998.0050305","volume":"5","author":"AK Jha","year":"1998","unstructured":"Jha AK, Kuperman GJ, Teich JM, Leape L, Shea B, Rittenberg E, Burdick E, Seger DL, Vander Vliet M, Bates DW: Identifying adverse drug events: development of a computer-based monitor and comparison with chart review and stimulated voluntary report. J Am Med Inform Assoc. 1998, 5 (3): 305-314. 10.1136\/jamia.1998.0050305.","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"671_CR10","doi-asserted-by":"publisher","first-page":"842","DOI":"10.2146\/ajhp060335","volume":"64","author":"S Phansalkar","year":"2007","unstructured":"Phansalkar S, Hoffman JM, Nebeker JR, Hurdle JF: Pharmacists versus nonpharmacists in adverse drug event detection: a meta-analysis and systematic review. Am J Health Syst Pharm. 2007, 64 (8): 842-849. 10.2146\/ajhp060335.","journal-title":"Am J Health Syst Pharm"},{"key":"671_CR11","unstructured":"U.S National Library of Medicine.Coding Symbols for Thesaurus of Adverse Reaction Terms (COSTART) Source Information. (2010, November 23).http:\/\/www.nlm.nih.gov\/research\/umls\/sourcereleasedocs\/current\/CST\/,"},{"issue":"1","key":"671_CR12","doi-asserted-by":"publisher","first-page":"19","DOI":"10.2165\/00002018-200528010-00002","volume":"28","author":"C Bousquet","year":"2005","unstructured":"Bousquet C, Lagier G, Louet AL, Beller C, Venot A, Jaulent M: Appraisal of the MedDRA Conceptual Structure for Describing and Grouping Adverse Drug Reactions. Drug Saf. 2005, 28 (1): 19-34. 10.2165\/00002018-200528010-00002.","journal-title":"Drug Saf"},{"key":"671_CR13","first-page":"309","volume-title":"Proceedings of International Conference on Biomedical Ontology (ICBO): July 24-26, 2009","author":"Y He","year":"2009","unstructured":"He Y, Xiang Z, Sarnitivijai S, Toldo L, Ceusters W:AEO: a realism-based biomedical ontology for the representation of adverse events.Proceedings of International Conference on Biomedical Ontology (ICBO): July 24-26, 2009. 2009, Amherst, New York, USA, 309-315."},{"key":"671_CR14","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1186\/1472-6947-8-S1-S4","volume":"8","author":"I Alecu","year":"2008","unstructured":"Alecu I, Bousquet C, Jaulent MC: A case report: using SNOMED CT for grouping adverse drug reactions terms. BMC Med Inform Decis Mak. 2008, 8: 54-10.1186\/1472-6947-8-54.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"Suppl 1","key":"671_CR15","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1136\/amiajnl-2011-000351","volume":"18","author":"S Sohn","year":"2011","unstructured":"Sohn S, Kocher JPA, Chute CG, Savova GK: Drug side effect extraction from clinical narratives of psychiatry and psychology patients. J Am Med Inform Assoc. 2011, 18 (Suppl 1): 144-149. 10.1136\/amiajnl-2011-000351.","journal-title":"J Am Med Inform Assoc"},{"key":"671_CR16","first-page":"177","volume-title":"Proceedings of AMIA Annual Symposium","author":"JD Duke","year":"2010","unstructured":"Duke JD, Friedlin J:ADESSA: a real-time decision support service for delivery of semantically coded adverse drug event data.Proceedings of AMIA Annual Symposium. 2010, Washington, DC, USA, 177-181."},{"issue":"5","key":"671_CR17","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1136\/jamia.2009.001560","volume":"17","author":"GK Savova","year":"2010","unstructured":"Savova GK, Masanz JJ, Ogren PV, Zheng J, Shon S, Kipper-Schuler KC, Chute CG: Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): Architecture, component evaluation and applications. J Am Med Inform Assoc. 2010, 17 (5): 507-513. 10.1136\/jamia.2009.001560.","journal-title":"J Am Med Inform Assoc"},{"issue":"Suppl 10","key":"671_CR18","doi-asserted-by":"publisher","first-page":"S11","DOI":"10.1186\/1471-2105-12-S10-S11","volume":"12","author":"H Bisgin","year":"2011","unstructured":"Bisgin H, Liu Z, Fang H, Xu X, Tong W: Mining FDA drug labels using an unsupervised learning technique - topic modeling. BMC Bioinforma. 2011, 12 (Suppl 10): S11-10.1186\/1471-2105-12-S10-S11.","journal-title":"BMC Bioinforma"},{"key":"671_CR19","first-page":"203","volume-title":"Proceeding of International Conference on Semantic Computing","author":"Q Li","year":"2009","unstructured":"Li Q, He D, Mao M:A study of relation annotation in business environments using web mining.Proceeding of International Conference on Semantic Computing. 2009, Berkeley, CA, USA, 203-209."},{"issue":"1","key":"671_CR20","first-page":"739","volume":"160","author":"E Aramaki","year":"2010","unstructured":"Aramaki E, Miura Y, Tonoike M, Ohkuma T, Masuichi H, Wakiki K, Ohe K: Extraction of adverse drug effects from clinical records. Stud Health Technol Inform. 2010, 160 (1): 739-743.","journal-title":"Stud Health Technol Inform"},{"key":"671_CR21","unstructured":"DailyMed.http:\/\/dailymed.nlm.nih.gov\/dailymed\/about.cfm,"},{"key":"671_CR22","unstructured":"Pharmaceutical Sales. 2010,http:\/\/www.drugs.com\/top200.htm, . - Top U.S. Drugs by Sales,"},{"key":"671_CR23","unstructured":"Structured Product Labeling, Section Headings (LOINC).http:\/\/www.fda.gov\/ForIndustry\/DataStandards\/StructuredProductLabeling\/ucm162057.htm,"},{"key":"671_CR24","unstructured":"SHARPn annotation guidelines. [www.sharpn.org]. (Oral communication from SHARPn\u2019s NLP PI)"},{"issue":"2","key":"671_CR25","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/j.ijmedinf.2007.01.002","volume":"77","author":"WW Chapman","year":"2008","unstructured":"Chapman WW, Dowling JN, Hripcsak G: Evaluation of training with an annotation schema for manual annotation of clinical conditions from emergency department reports. Int J Med Inform. 2008, 77 (2): 107-113. 10.1016\/j.ijmedinf.2007.01.002.","journal-title":"Int J Med Inform"},{"key":"671_CR26","first-page":"144","volume-title":"Proceedings of AMIA Annual Symposium","author":"L Deleger","year":"2012","unstructured":"Deleger L, Li Q, Lingren T, Kaiser M, Molnar K, Zhai H, Stoutenborough L, Solti I:Building Gold standard Corpora for Medical Natural Language Processing Tasks.Proceedings of AMIA Annual Symposium. 2012, Chicago, USA, 144-153."},{"issue":"5","key":"671_CR27","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1136\/jamia.2010.003947","volume":"17","author":"O Uzuner","year":"2010","unstructured":"Uzuner O, Solti I, Cadag E: Extracting medication information from clinical text. J Am Med Inform Assoc. 2010, 17 (5): 514-518. 10.1136\/jamia.2010.003947.","journal-title":"J Am Med Inform Assoc"},{"issue":"4\u20135","key":"671_CR28","first-page":"334","volume":"37","author":"C Friedman","year":"1998","unstructured":"Friedman C, Hripcsak G: Evaluating natural language processors in the clinical domain. Methods Inf Med. 1998, 37 (4\u20135): 334-344.","journal-title":"Methods Inf Med"},{"issue":"3","key":"671_CR29","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1197\/jamia.M1733","volume":"12","author":"G Hripcsak","year":"2005","unstructured":"Hripcsak G, Rothschild AS: Agreement, the f-measure, and reliability in information retrieval. J Am Med Inform Assoc. 2005, 12 (3): 296-308. 10.1197\/jamia.M1733.","journal-title":"J Am Med Inform Assoc"},{"key":"671_CR30","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1186\/1471-2105-7-92","volume":"7","author":"R Tsai","year":"2006","unstructured":"Tsai R, Wu S, Chou W, Lin Y, He D, Hsiang J, Sung T, Hsu W: Various criteria in the evaluation of biomedical named entity recognition. BMI Bioinformatics. 2006, 7: 92-100. 10.1186\/1471-2105-7-92.","journal-title":"BMI Bioinformatics"},{"key":"671_CR31","volume-title":"Computer-Intensive Methods for Testing Hypotheses: an Introduction","author":"EW Noreen","year":"1989","unstructured":"Noreen EW: Computer-Intensive Methods for Testing Hypotheses: an Introduction. 1989, New York: Wiley"},{"key":"671_CR32","unstructured":"MALLET: A MAchine Learning for Language Toolkit.http:\/\/mallet.cs.umass.edu\/,"},{"issue":"6973","key":"671_CR33","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1136\/bmj.310.6973.170","volume":"310","author":"JM Bland","year":"1995","unstructured":"Bland JM, Altman DG: Multiple significance tests: the Bonferroni method. BMJ. 1995, 310 (6973): 170-10.1136\/bmj.310.6973.170.","journal-title":"BMJ"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-13-53.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/1472-6947-13-53\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-13-53","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-13-53.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T23:35:47Z","timestamp":1630539347000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/1472-6947-13-53"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,4,24]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,12]]}},"alternative-id":["671"],"URL":"https:\/\/doi.org\/10.1186\/1472-6947-13-53","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,4,24]]},"assertion":[{"value":"16 November 2012","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 April 2013","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2013","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"53"}}