{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T10:14:50Z","timestamp":1782296090868,"version":"3.54.5"},"reference-count":50,"publisher":"Oxford University Press (OUP)","issue":"21","license":[{"start":{"date-parts":[[2021,7,2]],"date-time":"2021-07-02T00:00:00Z","timestamp":1625184000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,11,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Clinical trials are the essential stage of every drug development program for the treatment to become available to patients. Despite the importance of well-structured clinical trial databases and their tremendous value for drug discovery and development such instances are very rare. Presently large-scale information on clinical trials is stored in clinical trial registers which are relatively structured, but the mappings to external databases of drugs and diseases are increasingly lacking. The precise production of such links would enable us to interrogate richer harmonized datasets for invaluable insights.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We present a neural approach for medical concept normalization of diseases and drugs. Our two-stage approach is based on Bidirectional Encoder Representations from Transformers (BERT). In the training stage, we optimize the relative similarity of mentions and concept names from a terminology via triplet loss. In the inference stage, we obtain the closest concept name representation in a common embedding space to a given mention representation. We performed a set of experiments on a dataset of abstracts and a real-world dataset of trial records with interventions and conditions mapped to drug and disease terminologies. The latter includes mentions associated with one or more concepts (in-KB) or zero (out-of-KB, nil prediction). Experiments show that our approach significantly outperforms baseline and state-of-the-art architectures. Moreover, we demonstrate that our approach is effective in knowledge transfer from the scientific literature to clinical trial data.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>We make code and data freely available at https:\/\/github.com\/insilicomedicine\/DILBERT.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btab474","type":"journal-article","created":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T19:52:24Z","timestamp":1625169144000},"page":"3856-3864","source":"Crossref","is-referenced-by-count":28,"title":["Medical concept normalization in clinical trials with drug and disease representation learning"],"prefix":"10.1093","volume":"37","author":[{"given":"Zulfat","family":"Miftahutdinov","sequence":"first","affiliation":[{"name":"R&D department, Insilico Medicine Hong Kong , 999077 Pak Shek Kok, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Artur","family":"Kadurin","sequence":"additional","affiliation":[{"name":"R&D department, Insilico Medicine Hong Kong , 999077 Pak Shek Kok, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roman","family":"Kudrin","sequence":"additional","affiliation":[{"name":"R&D department, Insilico Medicine Hong Kong , 999077 Pak Shek Kok, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7936-0284","authenticated-orcid":false,"given":"Elena","family":"Tutubalina","sequence":"additional","affiliation":[{"name":"R&D department, Insilico Medicine Hong Kong , 999077 Pak Shek Kok, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,7,2]]},"reference":[{"key":"2023051608250717900_btab474-B1","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1186\/s12859-016-1247-7","article-title":"Automatic classification of registered clinical trials towards the global burden of diseases taxonomy of diseases and injuries","volume":"17","author":"Atal","year":"2016","journal-title":"BMC Bioinformatics"},{"key":"2023051608250717900_btab474-B2","doi-asserted-by":"crossref","first-page":"382","DOI":"10.3414\/ME12-01-0092","article-title":"Feasibility of feature-based indexing, clustering, and search of clinical trials","volume":"52","author":"Boland","year":"2013","journal-title":"Methods Inf. Med"},{"key":"2023051608250717900_btab474-B3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/sdata.2017.29","article-title":"A standard database for drug repositioning","volume":"4","author":"Brown","year":"2017","journal-title":"Sci. Data"},{"key":"2023051608250717900_btab474-B4","doi-asserted-by":"crossref","first-page":"bar065","DOI":"10.1093\/database\/bar065","article-title":"Medic: a practical disease vocabulary used at the comparative toxicogenomics database","volume":"2012","author":"Davis","year":"2012","journal-title":"Database"},{"key":"2023051608250717900_btab474-B5","doi-asserted-by":"crossref","first-page":"D948","DOI":"10.1093\/nar\/gky868","article-title":"The comparative toxicogenomics database: update 2019","volume":"47","author":"Davis","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2023051608250717900_btab474-B6","first-page":"4171","author":"Devlin","year":"2019"},{"key":"2023051608250717900_btab474-B7","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1038\/d41573-019-00074-z","article-title":"Trends in clinical success rates and therapeutic focus","volume":"18","author":"Dowden","year":"2019","journal-title":"Nat. Rev. Drug Discov"},{"key":"2023051608250717900_btab474-B8","doi-asserted-by":"crossref","first-page":"1294","DOI":"10.1016\/j.chembiol.2016.07.023","article-title":"A data-driven approach to predicting successes and failures of clinical trials","volume":"23","author":"Gayvert","year":"2016","journal-title":"Cell Chem. Biol"},{"key":"2023051608250717900_btab474-B9","doi-asserted-by":"crossref","first-page":"115","DOI":"10.4103\/2229-3485.184782","article-title":"Emerging role of bioinformatics tools and software in evolution of clinical research","volume":"7","author":"Gill","year":"2016","journal-title":"Perspect. Clin. Res"},{"key":"2023051608250717900_btab474-B10","first-page":"528","author":"Gillick","year":"2019"},{"key":"2023051608250717900_btab474-B11","author":"Gu","year":"2020"},{"key":"2023051608250717900_btab474-B12","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.jbi.2014.01.009","article-title":"Clustering clinical trials with similar eligibility criteria features","volume":"52","author":"Hao","year":"2014","journal-title":"J. Biomed. Inf"},{"key":"2023051608250717900_btab474-B13","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1038\/nbt.2786","article-title":"Clinical development success rates for investigational drugs","volume":"32","author":"Hay","year":"2014","journal-title":"Nat. Biotechnol"},{"key":"2023051608250717900_btab474-B14","first-page":"84","author":"Hoffer","year":"2015"},{"key":"2023051608250717900_btab474-B15","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1093\/bib\/bbv024","article-title":"Community challenges in biomedical text mining over 10 years: success, failure and the future","volume":"17","author":"Huang","year":"2016","journal-title":"Brief. Bioinf"},{"key":"2023051608250717900_btab474-B16","first-page":"2333","author":"Huang","year":"2013"},{"key":"2023051608250717900_btab474-B17","first-page":"2","article-title":"Poly-encoders: transformer architectures and pre-training strategies for fast and accurate multi-sentence scoring","volume":"2","author":"Humeau","year":"2019","journal-title":"CoRR"},{"key":"2023051608250717900_btab474-B18","first-page":"269","article-title":"Bert-based ranking for biomedical entity normalization","volume":"2020","author":"Ji","year":"2020","journal-title":"AMIA Summits Transl. Sci. Proc"},{"key":"2023051608250717900_btab474-B19","author":"Johnson","year":"2019"},{"key":"2023051608250717900_btab474-B20","doi-asserted-by":"crossref","first-page":"2839","DOI":"10.1093\/bioinformatics\/btw343","article-title":"Taggerone: joint named entity recognition and normalization with semi-Markov models","volume":"32","author":"Leaman","year":"2016","journal-title":"Bioinformatics"},{"key":"2023051608250717900_btab474-B21","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"Biobert: pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee","year":"2019","journal-title":"Bioinformatics"},{"key":"2023051608250717900_btab474-B22","author":"Leveling","year":"2017"},{"key":"2023051608250717900_btab474-B23","doi-asserted-by":"crossref","first-page":"e14830","DOI":"10.2196\/14830","article-title":"Fine-tuning bidirectional encoder representations from transformers (BERT)-based models on large-scale electronic health record notes: an empirical study","volume":"7","author":"Li","year":"2019","journal-title":"JMIR Med. Inf"},{"key":"2023051608250717900_btab474-B24","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1186\/s12859-017-1805-7","article-title":"Cnn-based ranking for biomedical entity normalization","volume":"18","author":"Li","year":"2017","journal-title":"BMC Bioinformatics"},{"key":"2023051608250717900_btab474-B25","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1016\/j.jbi.2012.04.005","article-title":"Systematic identification of pharmacogenomics information from clinical trials","volume":"45","author":"Li","year":"2012","journal-title":"J. Biomed. Inf"},{"key":"2023051608250717900_btab474-B26","doi-asserted-by":"crossref","first-page":"baw068","DOI":"10.1093\/database\/baw068","article-title":"Biocreative V CDR task corpus: a resource for chemical disease relation extraction","volume":"2016","author":"Li","year":"2016","journal-title":"Database"},{"key":"2023051608250717900_btab474-B27","first-page":"4107","author":"Liu","year":"2017"},{"key":"2023051608250717900_btab474-B28","article-title":"Machine learning with statistical imputation for predicting drug approvals","volume":"1","author":"Lo","year":"2019","journal-title":"Harvard Data Sci. Rev"},{"key":"2023051608250717900_btab474-B29","doi-asserted-by":"crossref","first-page":"6281","DOI":"10.1038\/s41598-019-42806-6","article-title":"Drug prioritization using the semantic properties of a knowledge graph","volume":"9","author":"Malas","year":"2019","journal-title":"Sci. Rep"},{"key":"2023051608250717900_btab474-B30","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1007\/BF02295996","article-title":"Note on the sampling error of the difference between correlated proportions or percentages","volume":"12","author":"McNemar","year":"1947","journal-title":"Psychometrika"},{"key":"2023051608250717900_btab474-B31","first-page":"393","author":"Miftahutdinov","year":"2019"},{"key":"2023051608250717900_btab474-B32","author":"Miftahutdinov","year":"2021"},{"key":"2023051608250717900_btab474-B33","first-page":"3111","author":"Mikolov","year":"2013"},{"key":"2023051608250717900_btab474-B34","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/W19-1912","article-title":"Medical entity linking using triplet network","author":"Mondal","year":"2019"},{"key":"2023051608250717900_btab474-B35","first-page":"3275","author":"Phan","year":"2019"},{"key":"2023051608250717900_btab474-B36","first-page":"54","author":"Pradhan","year":"2014"},{"key":"2023051608250717900_btab474-B37","first-page":"3973","author":"Reimers","year":"2019"},{"key":"2023051608250717900_btab474-B38","first-page":"815","author":"Schroff","year":"2015"},{"key":"2023051608250717900_btab474-B39","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1093\/jamia\/ocx091","article-title":"The representativeness of eligible patients in type 2 diabetes trials: a case study using gist 2.0","volume":"25","author":"Sen","year":"2018","journal-title":"J. Am. Med. Inf. Assoc"},{"key":"2023051608250717900_btab474-B40","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2020.acl-main.335","article-title":"Biomedical entity representations with synonym marginalization","author":"Sung","year":"2020"},{"key":"2023051608250717900_btab474-B41","first-page":"212","author":"Suominen","year":"2013"},{"key":"2023051608250717900_btab474-B42","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.jbi.2018.06.006","article-title":"Medical concept normalization in social media posts with recurrent neural networks","volume":"84","author":"Tutubalina","year":"2018","journal-title":"J. Biomed. Inf"},{"key":"2023051608250717900_btab474-B43","first-page":"6710","author":"Tutubalina","year":"2020"},{"key":"2023051608250717900_btab474-B44","first-page":"46","article-title":"Drugbank 5.0: a major update to the drugbank database for 2018","volume":"4","author":"Wishart","year":"2018","journal-title":"Nucleic Acids Research"},{"key":"2023051608250717900_btab474-B45","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1093\/biostatistics\/kxx069","article-title":"Estimation of clinical trial success rates and related parameters","volume":"20","author":"Wong","year":"2019","journal-title":"Biostatistics"},{"key":"2023051608250717900_btab474-B46","author":"Wright","year":"2019"},{"key":"2023051608250717900_btab474-B47","first-page":"153","author":"Wu","year":"2013"},{"key":"2023051608250717900_btab474-B48","first-page":"8452","author":"Xu","year":"2020"},{"key":"2023051608250717900_btab474-B49","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1609\/aaai.v33i01.3301817","article-title":"A neural multi-task learning framework to jointly model medical named entity recognition and normalization","volume":"33","author":"Zhao","year":"2019","journal-title":"Proc. AAAI Conference Artif. Intell"},{"key":"2023051608250717900_btab474-B50","author":"Zhu","year":"2020"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btab474\/39554494\/btab474.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/37\/21\/3856\/50336623\/btab474.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/37\/21\/3856\/50336623\/btab474.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,16]],"date-time":"2023-05-16T08:35:02Z","timestamp":1684226102000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/37\/21\/3856\/6313159"}},"subtitle":[],"editor":[{"given":"Jonathan","family":"Wren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,7,2]]},"references-count":50,"journal-issue":{"issue":"21","published-print":{"date-parts":[[2021,11,5]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btab474","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,11,1]]},"published":{"date-parts":[[2021,7,2]]}}}