{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T02:54:31Z","timestamp":1782788071806,"version":"3.54.5"},"reference-count":35,"publisher":"Oxford University Press (OUP)","issue":"23","funder":[{"DOI":"10.13039\/100000092","name":"the National Library of Medicine","doi-asserted-by":"crossref","award":["R01 LM009623"],"award-info":[{"award-number":["R01 LM009623"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,12,1]]},"abstract":"<jats:p>Motivation: Automatically quantifying semantic similarity and relatedness between clinical terms is an important aspect of text mining from electronic health records, which are increasingly recognized as valuable sources of phenotypic information for clinical genomics and bioinformatics research. A key obstacle to development of semantic relatedness measures is the limited availability of large quantities of clinical text to researchers and developers outside of major medical centers. Text from general English and biomedical literature are freely available; however, their validity as a substitute for clinical domain to represent semantics of clinical terms remains to be demonstrated.<\/jats:p><jats:p>Results: We constructed neural network representations of clinical terms found in a publicly available benchmark dataset manually labeled for semantic similarity and relatedness. Similarity and relatedness measures computed from text corpora in three domains (Clinical Notes, PubMed Central articles and Wikipedia) were compared using the benchmark as reference. We found that measures computed from full text of biomedical articles in PubMed Central repository (rho\u2009=\u20090.62 for similarity and 0.58 for relatedness) are on par with measures computed from clinical reports (rho\u2009=\u20090.60 for similarity and 0.57 for relatedness). We also evaluated the use of neural network based relatedness measures for query expansion in a clinical document retrieval task and a biomedical term word sense disambiguation task. We found that, with some limitations, biomedical articles may be used in lieu of clinical reports to represent the semantics of clinical terms and that distributional semantic methods are useful for clinical and biomedical natural language processing applications.<\/jats:p><jats:p>Availability and Implementation: The software and reference standards used in this study to evaluate semantic similarity and relatedness measures are publicly available as detailed in the article.<\/jats:p><jats:p>Contact: \u00a0pakh0002@umn.edu<\/jats:p><jats:p>Supplementary information: \u00a0Supplementary data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btw529","type":"journal-article","created":{"date-parts":[[2016,8,17]],"date-time":"2016-08-17T02:39:40Z","timestamp":1471401580000},"page":"3635-3644","source":"Crossref","is-referenced-by-count":75,"title":["Corpus domain effects on distributional semantic modeling of medical terms"],"prefix":"10.1093","volume":"32","author":[{"given":"Serguei V.S.","family":"Pakhomov","sequence":"first","affiliation":[{"name":"1College of Pharmacy, University of Minnesota, Minneapolis, MN 55455, USA"},{"name":"2Institute for Health Informatics, University of Minnesota, Minneapolis, MN 55455, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Greg","family":"Finley","sequence":"additional","affiliation":[{"name":"2Institute for Health Informatics, University of Minnesota, Minneapolis, MN 55455, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Reed","family":"McEwan","sequence":"additional","affiliation":[{"name":"2Institute for Health Informatics, University of Minnesota, Minneapolis, MN 55455, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Wang","sequence":"additional","affiliation":[{"name":"2Institute for Health Informatics, University of Minnesota, Minneapolis, MN 55455, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Genevieve B.","family":"Melton","sequence":"additional","affiliation":[{"name":"2Institute for Health Informatics, University of Minnesota, Minneapolis, MN 55455, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2016,8,16]]},"reference":[{"key":"2023020114073164300_btw529-B1","first-page":"238","volume-title":"Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics","author":"Baroni","year":"2014"},{"key":"2023020114073164300_btw529-B2","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1197\/j.aem.2005.07.038","article-title":"Accuracy of mild traumatic brain injury case ascertainment using ICD-9 codes","volume":"13","author":"Bazarian","year":"2006","journal-title":"Acad. Emerg. Med"},{"key":"2023020114073164300_btw529-B3","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1162\/coli.2006.32.1.13","article-title":"Evaluating WordNet-based measures of semantic distance","volume":"32","author":"Budanitsky","year":"2006","journal-title":"Comput. Linguist"},{"key":"2023020114073164300_btw529-B4","doi-asserted-by":"crossref","first-page":"2209","DOI":"10.1001\/jama.296.18.2209","article-title":"Systolic and diastolic heart failure in the community","volume":"296","author":"Bursi","year":"2006","journal-title":"JAMA"},{"key":"2023020114073164300_btw529-B5","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1016\/j.jbi.2009.02.002","article-title":"Empirical distributional semantics: methods and biomedical applications","volume":"42","author":"Cohen","year":"2009","journal-title":"J. Biomed. Inf"},{"key":"2023020114073164300_btw529-B6","doi-asserted-by":"crossref","first-page":"e349","DOI":"10.1136\/amiajnl-2013-001827","article-title":"Billing code algorithms to identify cases of peripheral artery disease from administrative data","volume":"20","author":"Fan","year":"2013","journal-title":"J. Am. Med. Inf. Assoc"},{"key":"2023020114073164300_btw529-B7","first-page":"156","volume-title":"Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (System Demonstration)","author":"Faruqui","year":"2014"},{"key":"2023020114073164300_btw529-B8","doi-asserted-by":"crossref","first-page":"2781","DOI":"10.1093\/bioinformatics\/btt491","article-title":"Exploiting disjointness axioms to improve semantic similarity measures","volume":"29","author":"Ferreira","year":"2013","journal-title":"Bioinformatics"},{"key":"2023020114073164300_btw529-B9","doi-asserted-by":"crossref","first-page":"261.","DOI":"10.1186\/1471-2105-13-261","article-title":"Semantic similarity in the biomedical domain: an evaluation across knowledge sources","volume":"13","author":"Garla","year":"2012","journal-title":"BMC Bioinf"},{"key":"2023020114073164300_btw529-B10","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1136\/amiajnl-2012-001350","article-title":"Knowledge-based biomedical word sense disambiguation: an evaluation and application to clinical document classification","volume":"20","author":"Garla","year":"2013","journal-title":"J. Am. Med. Inf. Assoc. JAMIA"},{"key":"2023020114073164300_btw529-B11","doi-asserted-by":"crossref","first-page":"223.","DOI":"10.1186\/1471-2105-12-223","article-title":"Exploiting MeSH indexing in MEDLINE to generate a data set for word sense disambiguation","volume":"12","author":"Jimeno-Yepes","year":"2011","journal-title":"BMC Bioinf"},{"key":"2023020114073164300_btw529-B12","volume-title":"Handbook of Latent Semantic Analysis","author":"Landauer","year":"2006"},{"key":"2023020114073164300_btw529-B13","doi-asserted-by":"crossref","first-page":"265","DOI":"10.7551\/mitpress\/7287.003.0018","volume-title":"WordNet: An Electronic Lexical Database","author":"Leacock","year":"1998"},{"key":"2023020114073164300_btw529-B14","unstructured":"Lee \u00a0W.-N. \u00a0et al.. (2008) Comparison of ontology-based semantic-similarity measures. AMIA Annual Symposium Proceedings\/AMIA Symposium.AMIA Symposium, pp. 384\u2013388."},{"key":"2023020114073164300_btw529-B15","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1162\/tacl_a_00134","article-title":"Improving distributional similarity with lessons learned from word embeddings","volume":"3","author":"Levy","year":"2015","journal-title":"Trans. Assoc. Comput. Linguist"},{"key":"2023020114073164300_btw529-B16","first-page":"296","volume-title":"ICML \u201998 Proceedings of the Fifteenth International Conference on Machine Learning","author":"Lin","year":"1998"},{"key":"2023020114073164300_btw529-B17","first-page":"363","article-title":"Semantic Relatedness Study Using Second Order Co-Occurrence Vectors Computed from Biomedical Corpora, UMLS and WordNet","volume-title":"Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium, Miami, Florida, January 2012","author":"Liu","year":"2012"},{"key":"2023020114073164300_btw529-B18","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1093\/bioinformatics\/btg153","article-title":"Investigating semantic similarity measures across the Gene Ontology: the relationship between sequence and annotation","volume":"19","author":"Lord","year":"2003","journal-title":"Bioinformatics"},{"key":"2023020114073164300_btw529-B19","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1093\/bioinformatics\/btv590","article-title":"A-DaGO-Fun: an adaptable Gene Ontology semantic similarity-based functional analysis tool","volume":"32","author":"Mazandu","year":"2016","journal-title":"Bioinformatics"},{"key":"2023020114073164300_btw529-B20","doi-asserted-by":"crossref","first-page":"e104519.","DOI":"10.1371\/journal.pone.0104519","article-title":"Validity of heart failure diagnoses in administrative databases: a systematic review and meta-analysis","volume":"9","author":"McCormick","year":"2014","journal-title":"PLoS ONE"},{"key":"2023020114073164300_btw529-B21","first-page":"150","volume-title":"Proceedings of the 2016 Joint Summits of the American Medical Informatics Association (in press)","author":"McEwan","year":"2016"},{"key":"2023020114073164300_btw529-B22","unstructured":"McInnes \u00a0B. \u00a0et al.. (2011) Using second-order vectors in a knowledge-based method for acronym disambiguation. In: Proceedings of the Fifteenth Conference on Computational Natural Language Learning. Portland, Oregon, USA, pp. 145\u2013153."},{"key":"2023020114073164300_btw529-B23","doi-asserted-by":"crossref","first-page":"1116","DOI":"10.1016\/j.jbi.2013.08.008","article-title":"Evaluating measures of semantic similarity and relatedness to disambiguate terms in biomedical text","volume":"46","author":"McInnes","year":"2013","journal-title":"J. Biomed. Inf"},{"key":"2023020114073164300_btw529-B24","first-page":"3111","volume-title":"Advances in Neural Information Processing Systems","author":"Mikolov","year":"2013"},{"key":"2023020114073164300_btw529-B25","first-page":"158","volume-title":"Proceedings of the 2015 Workshop on Biomedical Natural Language Processing (BioNLP 2015)","author":"Muneeb","year":"2015"},{"key":"2023020114073164300_btw529-B26","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.jbi.2004.11.016","article-title":"Prospective recruitment of patients with congestive heart failure using an ad-hoc binary classifier","volume":"38","author":"Pakhomov","year":"2005","journal-title":"J. Biomed. Inf"},{"key":"2023020114073164300_btw529-B27","first-page":"572","article-title":"Semantic Similarity and Relatedness between Clinical Terms: An Experimental Study","author":"Pakhomov","year":"2010","journal-title":"AMIA Annual Symposium Proceedings\/AMIA Symposium. AMIA Symposium, 2010"},{"key":"2023020114073164300_btw529-B28","first-page":"281","article-title":"Electronic medical records for clinical research: application to the identification of heart failure","volume":"13","author":"Pakhomov","year":"2007","journal-title":"Am. J. Manag. Care"},{"key":"2023020114073164300_btw529-B29","first-page":"1","volume-title":"Proceedings of the EACL 2006 Workshop on Making Sense of Sense: Bringing Computational Linguistics and Psycholinguistics Together","author":"Patwardhan","year":"2006"},{"key":"2023020114073164300_btw529-B30","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1016\/j.jbi.2006.06.004","article-title":"Measures of semantic similarity and relatedness in the biomedical domain","volume":"40","author":"Pedersen","year":"2007","journal-title":"J. Biomed. Inf"},{"key":"2023020114073164300_btw529-B31","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1613\/jair.514","article-title":"Semantic similarity in a taxonomy: an information-based measure and its application to problems of ambiguity in natural language","volume":"11","author":"Resnik","year":"1999","journal-title":"J. Artif. Intell. Res"},{"key":"2023020114073164300_btw529-B32","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1007\/978-3-319-06483-3_42","volume-title":"Advances in Artificial Intelligence","author":"Sajadi","year":"2014"},{"key":"2023020114073164300_btw529-B33","doi-asserted-by":"crossref","first-page":"1274","DOI":"10.1093\/bioinformatics\/btm087","article-title":"A new method to measure the semantic similarity of GO terms","volume":"23","author":"Wang","year":"2007","journal-title":"Bioinformatics"},{"key":"2023020114073164300_btw529-B34","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1162\/089120105775299122","article-title":"Co-occurrence retrieval: a flexible framework for lexical distributional similarity","volume":"31","author":"Weeds","year":"2005","journal-title":"Comput. Linguist"},{"key":"2023020114073164300_btw529-B35","doi-asserted-by":"crossref","first-page":"1383","DOI":"10.1093\/bioinformatics\/bts129","article-title":"Improving GO semantic similarity measures by exploring the ontology beneath the terms and modelling uncertainty","volume":"28","author":"Yang","year":"2012","journal-title":"Bioinformatics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/32\/23\/3635\/49027059\/bioinformatics_32_23_3635.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/32\/23\/3635\/49027059\/bioinformatics_32_23_3635.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T18:39:12Z","timestamp":1749062352000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/32\/23\/3635\/2525643"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,8,16]]},"references-count":35,"journal-issue":{"issue":"23","published-print":{"date-parts":[[2016,12,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btw529","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2016,12,1]]},"published":{"date-parts":[[2016,8,16]]}}}