{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T08:19:24Z","timestamp":1772525964018,"version":"3.50.1"},"reference-count":30,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2021,3,1]],"date-time":"2021-03-01T00:00:00Z","timestamp":1614556800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["R44TR003254"],"award-info":[{"award-number":["R44TR003254"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100016220","name":"CTSA","doi-asserted-by":"publisher","award":["UL1TR002366"],"award-info":[{"award-number":["UL1TR002366"]}],"id":[{"id":"10.13039\/100016220","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,6,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The COVID-19 pandemic swept across the world rapidly, infecting millions of people. An efficient tool that can accurately recognize important clinical concepts of COVID-19 from free text in electronic health records (EHRs) will be valuable to accelerate COVID-19 clinical research. To this end, this study aims at adapting the existing CLAMP natural language processing tool to quickly build COVID-19 SignSym, which can extract COVID-19 signs\/symptoms and their 8 attributes (body location, severity, temporal expression, subject, condition, uncertainty, negation, and course) from clinical text. The extracted information is also mapped to standard concepts in the Observational Medical Outcomes Partnership common data model. A hybrid approach of combining deep learning-based models, curated lexicons, and pattern-based rules was applied to quickly build the COVID-19 SignSym from CLAMP, with optimized performance. Our extensive evaluation using 3 external sites with clinical notes of COVID-19 patients, as well as the online medical dialogues of COVID-19, shows COVID-19 SignSym can achieve high performance across data sources. The workflow used for this study can be generalized to other use cases, where existing clinical natural language processing tools need to be customized for specific information needs within a short time. COVID-19 SignSym is freely accessible to the research community as a downloadable package (https:\/\/clamp.uth.edu\/covid\/nlp.php) and has been used by 16 healthcare organizations to support clinical research of COVID-19.<\/jats:p>","DOI":"10.1093\/jamia\/ocab015","type":"journal-article","created":{"date-parts":[[2021,1,30]],"date-time":"2021-01-30T12:14:40Z","timestamp":1612008880000},"page":"1275-1283","source":"Crossref","is-referenced-by-count":51,"title":["COVID-19 SignSym: a fast adaptation of a general clinical NLP tool to identify and normalize COVID-19 signs and symptoms to OMOP common data model"],"prefix":"10.1093","volume":"28","author":[{"given":"Jingqi","family":"Wang","sequence":"first","affiliation":[{"name":"Melax Technologies, Inc, Houston, Texas, USA"},{"name":"School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Noor","family":"Abu-el-Rub","sequence":"additional","affiliation":[{"name":"Division of Medical Informatics, University of Kansas Medical Center, Kansas City, Kansas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3388-5867","authenticated-orcid":false,"given":"Josh","family":"Gray","sequence":"additional","affiliation":[{"name":"Johns Hopkins University School of Medicine, Baltimore, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huy Anh","family":"Pham","sequence":"additional","affiliation":[{"name":"Melax Technologies, Inc, Houston, Texas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0889-2261","authenticated-orcid":false,"given":"Yujia","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Frank J.","family":"Manion","sequence":"additional","affiliation":[{"name":"Melax Technologies, Inc, Houston, Texas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8036-2110","authenticated-orcid":false,"given":"Mei","family":"Liu","sequence":"additional","affiliation":[{"name":"Division of Medical Informatics, University of Kansas Medical Center, Kansas City, Kansas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xing","family":"Song","sequence":"additional","affiliation":[{"name":"University of Missouri School of Medicine, Columbia, Missouri, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5274-4672","authenticated-orcid":false,"given":"Hua","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Masoud","family":"Rouhizadeh","sequence":"additional","affiliation":[{"name":"Johns Hopkins University School of Medicine, Baltimore, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9220-3101","authenticated-orcid":false,"given":"Yaoyun","family":"Zhang","sequence":"additional","affiliation":[{"name":"Melax Technologies, Inc, Houston, Texas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2021,3,1]]},"reference":[{"key":"2021061318582130100_ocab015-B1"},{"key":"2021061318582130100_ocab015-B2"},{"key":"2021061318582130100_ocab015-B3","author":"Kupferschmidt","year":"2020"},{"key":"2021061318582130100_ocab015-B4"},{"key":"2021061318582130100_ocab015-B5"},{"key":"2021061318582130100_ocab015-B6"},{"key":"2021061318582130100_ocab015-B7","author":"Wang","year":"2020"},{"key":"2021061318582130100_ocab015-B8"},{"key":"2021061318582130100_ocab015-B9","author":"AlRahman AlMomani","year":"2020"},{"key":"2021061318582130100_ocab015-B10","author":"Wagner","year":"2020"},{"key":"2021061318582130100_ocab015-B11"},{"key":"2021061318582130100_ocab015-B12","year":"2020"},{"key":"2021061318582130100_ocab015-B13"},{"issue":"9","key":"2021061318582130100_ocab015-B14","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1093\/jamia\/ocaa145","article-title":"COVID-19 TestNorm: a tool to normalize COVID-19 testing names to LOINC codes","volume":"27","author":"Dong","year":"2020","journal-title":"J. Am. Med. Inform. Assoc"},{"issue":"1","key":"2021061318582130100_ocab015-B15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-019-0208-8","article-title":"Desiderata for delivering NLP to accelerate healthcare AI advancement and a Mayo Clinic NLP-as-a-service implementation","volume":"2","author":"Wen","year":"2019","journal-title":"NPJ Digit Med"},{"key":"2021061318582130100_ocab015-B16"},{"issue":"3","key":"2021061318582130100_ocab015-B17","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1093\/jamia\/ocx132","article-title":"CLAMP\u2014a toolkit for efficiently building customized clinical natural language processing pipelines","volume":"25","author":"Soysal","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2021061318582130100_ocab015-B18","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1136\/jamia.2009.001560","article-title":"Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation, and applications","volume":"17","author":"Savova","year":"2010","journal-title":"J Am Med Inform Assoc"},{"key":"2021061318582130100_ocab015-B19"},{"key":"2021061318582130100_ocab015-B20","article-title":"Patient trajectories among persons hospitalized for COVID-19: a cohort study","author":"Garibaldi","year":"2020","journal-title":"Ann Intern Med"},{"key":"2021061318582130100_ocab015-B21"},{"key":"2021061318582130100_ocab015-B22","author":"Elhadad"},{"key":"2021061318582130100_ocab015-B23"},{"key":"2021061318582130100_ocab015-B24","year":"2020"},{"issue":"5","key":"2021061318582130100_ocab015-B25","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1136\/amiajnl-2011-000203","article-title":"2010 i2b2\/VA challenge on concepts, assertions, and relations in clinical text","volume":"18","author":"Uzuner","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2021061318582130100_ocab015-B26","author":"Huang","year":"2015"},{"issue":"1","key":"2021061318582130100_ocab015-B27","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1093\/jamia\/ocz063","article-title":"A study of deep learning approaches for medication and adverse drug event extraction from clinical text","volume":"27","author":"Wei","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2021061318582130100_ocab015-B28","author":"Ezen-Can","year":"2020"},{"key":"2021061318582130100_ocab015-B29","author":"Zhang"},{"key":"2021061318582130100_ocab015-B30"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/6\/1275\/38615346\/ocab015.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/6\/1275\/38615346\/ocab015.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,13]],"date-time":"2021-06-13T18:58:36Z","timestamp":1623610716000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/6\/1275\/6155732"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,1]]},"references-count":30,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,3,1]]},"published-print":{"date-parts":[[2021,6,12]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab015","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,6,1]]},"published":{"date-parts":[[2021,3,1]]}}}