{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T20:48:41Z","timestamp":1783457321112,"version":"3.55.0"},"reference-count":17,"publisher":"Oxford University Press (OUP)","issue":"9","license":[{"start":{"date-parts":[[2021,4,24]],"date-time":"2021-04-24T00:00:00Z","timestamp":1619222400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R56AI150272"],"award-info":[{"award-number":["R56AI150272"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01AI130460"],"award-info":[{"award-number":["R01AI130460"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Cancer Research","award":["RR180012"],"award-info":[{"award-number":["RR180012"]}]},{"name":"Christopher Sarofim Family Professorship, UT Stars award"},{"name":"National Institute of Health","award":["R01AG066749"],"award-info":[{"award-number":["R01AG066749"]}]},{"name":"National Institute of Health","award":["R01AG066749-S1"],"award-info":[{"award-number":["R01AG066749-S1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,8,13]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Clinical trials are an essential part of the effort to find safe and effective prevention and treatment for COVID-19. Given the rapid growth of COVID-19 clinical trials, there is an urgent need for a better clinical trial information retrieval tool that supports searching by specifying criteria, including both eligibility criteria and structured trial information.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We built a linked graph for registered COVID-19 clinical trials: the COVID-19 Trial Graph, to facilitate retrieval of clinical trials. Natural language processing tools were leveraged to extract and normalize the clinical trial information from both their eligibility criteria free texts and structured information from ClinicalTrials.gov. We linked the extracted data using the COVID-19 Trial Graph and imported it to a graph database, which supports both\u00a0querying and visualization. We evaluated trial graph using case queries and graph embedding.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The graph currently (as of October 5, 2020) contains 3392 registered COVID-19 clinical trials, with 17\u00a0480 nodes and 65\u00a0236 relationships. Manual evaluation of case queries found high precision and recall scores on retrieving relevant clinical trials searching from both eligibility criteria and trial-structured information. We observed clustering in clinical trials via graph embedding, which also showed superiority over the baseline (0.870 vs 0.820) in evaluating whether a trial can complete its recruitment successfully.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>The COVID-19 Trial Graph is a novel representation of clinical trials that allows diverse search queries and provides a graph-based visualization of COVID-19 clinical trials. High-dimensional vectors mapped by graph embedding for clinical trials would be potentially beneficial for many downstream applications, such as trial end recruitment status prediction and trial similarity comparison. Our methodology also is generalizable to other clinical trials.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocab078","type":"journal-article","created":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T22:24:07Z","timestamp":1618871047000},"page":"1964-1969","source":"Crossref","is-referenced-by-count":5,"title":["COVID-19 trial graph: a linked graph for COVID-19 clinical trials"],"prefix":"10.1093","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0322-4566","authenticated-orcid":false,"given":"Jingcheng","family":"Du","sequence":"first","affiliation":[{"name":"School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qing","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingqi","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Prerana","family":"Ramesh","sequence":"additional","affiliation":[{"name":"School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1395-6805","authenticated-orcid":false,"given":"Yang","family":"Xiang","sequence":"additional","affiliation":[{"name":"School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9933-2205","authenticated-orcid":false,"given":"Xiaoqian","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cui","family":"Tao","sequence":"additional","affiliation":[{"name":"School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,4,24]]},"reference":[{"key":"2021081407013545700_ocab078-B1","year":"2020"},{"key":"2021081407013545700_ocab078-B2","year":"2020"},{"key":"2021081407013545700_ocab078-B3","year":"2020"},{"issue":"6","key":"2021081407013545700_ocab078-B4","doi-asserted-by":"crossref","first-page":"e286","DOI":"10.1016\/S2589-7500(20)30086-8","article-title":"A real-time dashboard of clinical trials for COVID-19","volume":"2","author":"Thorlund","year":"2020","journal-title":"Lancet Digit Heal"},{"key":"2021081407013545700_ocab078-B5","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1093\/jamia\/ocy178","article-title":"Criteria2Query: a natural language interface to clinical databases for cohort definition","volume":"26","author":"Yuan","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2021081407013545700_ocab078-B6","year":"2020"},{"key":"2021081407013545700_ocab078-B7","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1093\/jamia\/ocx132","article-title":"CLAMP: a toolkit for efficiently building customized clinical natural language processing pipelines","volume":"25","author":"Soysal","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2021081407013545700_ocab078-B8","year":"2020"},{"key":"2021081407013545700_ocab078-B9","year":"2020"},{"key":"2021081407013545700_ocab078-B10","first-page":"3111","article-title":"Distributed representations of words and phrases and their compositionality","author":"Mikolov","year":"2013","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2021081407013545700_ocab078-B11","year":"2020"},{"issue":"8","key":"2021081407013545700_ocab078-B12","doi-asserted-by":"crossref","first-page":"1259","DOI":"10.1093\/jamia\/ocaa117","article-title":"Constructing co-occurrence network embeddings to assist association extraction for COVID-19 and other coronavirus infectious diseases","volume":"27","author":"Oniani","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2021081407013545700_ocab078-B13","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1145\/2939672.2939754","article-title":"Node2vec: scalable feature learning for networks","author":"Grover","year":"2016","journal-title":"proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining"},{"issue":"6","key":"2021081407013545700_ocab078-B14","doi-asserted-by":"crossref","first-page":"e1006907","DOI":"10.1371\/journal.pcbi.1006907","article-title":"Ten quick tips for effective dimensionality reduction","volume":"15","author":"Nguyen","year":"2019","journal-title":"PLoS Comput Biol"},{"issue":"S1","key":"2021081407013545700_ocab078-B15","doi-asserted-by":"crossref","DOI":"10.1186\/s12864-018-5370-x","article-title":"Gene2vec: distributed representation of genes based on co-expression","volume":"20","author":"Du","year":"2019","journal-title":"BMC Genomics"},{"key":"2021081407013545700_ocab078-B16","author":"Ulyanov","year":"2016"},{"issue":"9","key":"2021081407013545700_ocab078-B17","doi-asserted-by":"crossref","first-page":"1616","DOI":"10.1109\/TKDE.2018.2807452","article-title":"A comprehensive survey of graph embedding: problems, techniques, and applications","volume":"30","author":"Cai","year":"2018","journal-title":"IEEE Trans Knowl Data Eng"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocab078\/37351354\/ocab078.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/9\/1964\/39731811\/ocab078.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/9\/1964\/39731811\/ocab078.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T07:06:07Z","timestamp":1628924767000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/9\/1964\/6251361"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,24]]},"references-count":17,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,4,24]]},"published-print":{"date-parts":[[2021,8,13]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab078","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,9,1]]},"published":{"date-parts":[[2021,4,24]]}}}