{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T20:12:06Z","timestamp":1769976726604,"version":"3.49.0"},"reference-count":25,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2024,5,8]],"date-time":"2024-05-08T00:00:00Z","timestamp":1715126400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,6,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Social media-based public health research is crucial for epidemic surveillance, but most studies identify relevant corpora with keyword-matching. This study develops a system to streamline the process of curating colloquial medical dictionaries. We demonstrate the pipeline by curating a Unified Medical Language System (UMLS)-colloquial symptom dictionary from COVID-19-related tweets as proof of concept.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>COVID-19-related tweets from February 1, 2020, to April 30, 2022 were used. The pipeline includes three modules: a named entity recognition module to detect symptoms in tweets; an entity normalization module to aggregate detected entities; and a mapping module that iteratively maps entities to Unified Medical Language System concepts. A random 500 entity samples were drawn from the final dictionary for accuracy validation. Additionally, we conducted a symptom frequency distribution analysis to compare our dictionary to a pre-defined lexicon from previous research.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We identified 498\u00a0480 unique symptom entity expressions from the tweets. Pre-processing reduces the number to 18\u00a0226. The final dictionary contains 38\u00a0175 unique expressions of symptoms that can be mapped to 966 UMLS concepts (accuracy\u2009=\u200995%). Symptom distribution analysis found that our dictionary detects more symptoms and is effective at identifying psychiatric disorders like anxiety and depression, often missed by pre-defined lexicons.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>This study advances public health research by implementing a novel, systematic pipeline for curating symptom lexicons from social media data. The final lexicon's high accuracy, validated by medical professionals, underscores the potential of this methodology to reliably interpret, and categorize vast amounts of unstructured social media data into actionable medical insights across diverse linguistic and regional landscapes.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae118","type":"journal-article","created":{"date-parts":[[2024,5,8]],"date-time":"2024-05-08T18:24:41Z","timestamp":1715192681000},"page":"1569-1577","source":"Crossref","is-referenced-by-count":9,"title":["Streamlining social media information retrieval for public health research with deep learning"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7779-1208","authenticated-orcid":false,"given":"Yining","family":"Hua","sequence":"first","affiliation":[{"name":"Department of Epidemiology, Harvard Chan School of Public Health , Boston, MA 02115, United States"},{"name":"Department of Biomedical Informatics, Harvard Medical School , Boston, MA 02115, United States"},{"name":"Division of General Internal Medicine and Primary Care, Department of Medicine, Brigham and Women\u2019s Hospital and Harvard Medical School , Boston, MA 02145, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiageng","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Public Health, Zhejiang University School of Medicine , Hangzhou, Zhejiang, 310058, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shixu","family":"Lin","sequence":"additional","affiliation":[{"name":"School of Public Health, Zhejiang University School of Medicine , Hangzhou, Zhejiang, 310058, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Minghui","family":"Li","sequence":"additional","affiliation":[{"name":"School of Public Health, Zhejiang University School of Medicine , Hangzhou, Zhejiang, 310058, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yujie","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Public Health, Zhejiang University School of Medicine , Hangzhou, Zhejiang, 310058, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dinah","family":"Foer","sequence":"additional","affiliation":[{"name":"Division of General Internal Medicine and Primary Care, Department of Medicine, Brigham and Women\u2019s Hospital and Harvard Medical School , Boston, MA 02145, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5605-2016","authenticated-orcid":false,"given":"Siwen","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Epidemiology, Harvard Chan School of Public Health , Boston, MA 02115, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peilin","family":"Zhou","sequence":"additional","affiliation":[{"name":"Thrust of Data Science and Analytics, The Hong Kong University of Science and Technology (Guangzhou) , Guangzhou, Guangdong, 511458, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Yang","sequence":"additional","affiliation":[{"name":"Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School , Boston, MA 02120, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li","family":"Zhou","sequence":"additional","affiliation":[{"name":"Division of General Internal Medicine and Primary Care, Department of Medicine, Brigham and Women\u2019s Hospital and Harvard Medical School , Boston, MA 02145, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2024,5,8]]},"reference":[{"key":"2024062007512142500_ocae118-B1","volume-title":"The Future of Public Health","author":"Institute of Medicine (US) Committee for the Study of the Future of Public Health. Washington (DC)","year":"1988"},{"issue":"10","key":"2024062007512142500_ocae118-B2","doi-asserted-by":"crossref","first-page":"e39676","DOI":"10.2196\/39676","article-title":"Tracking the impact of COVID-19 and lockdown policies on public mental health using social media: infoveillance study","volume":"24","author":"Li","year":"2022","journal-title":"J Med Internet Res"},{"issue":"10","key":"2024062007512142500_ocae118-B3","doi-asserted-by":"crossref","first-page":"1668","DOI":"10.1093\/jamia\/ocac114","article-title":"Using Twitter data to understand public perceptions of approved versus off-label use for COVID-19-related medications","volume":"29","author":"Hua","year":"2022","journal-title":"J Am Med Inform Assoc"},{"key":"2024062007512142500_ocae118-B4","volume-title":"Disease Control Priorities: Improving Health and Reducing Poverty","author":"Madhav","year":"2017","edition":"3rd ed"},{"issue":"3","key":"2024062007512142500_ocae118-B5","doi-asserted-by":"crossref","first-page":"e175","DOI":"10.1016\/S2589-7500(20)30315-0","article-title":"What social media told us in the time of COVID-19: a scoping review","volume":"3","author":"Tsao","year":"2021","journal-title":"Lancet Digit Health"},{"issue":"1","key":"2024062007512142500_ocae118-B6","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1080\/10410236.2018.1536955","article-title":"Big data, computational social science, and health communication: a review and agenda for advancing theory","volume":"35","author":"Rains","year":"2020","journal-title":"Health Commun"},{"issue":"6507","key":"2024062007512142500_ocae118-B7","doi-asserted-by":"crossref","first-page":"1060","DOI":"10.1126\/science.aaz8170","article-title":"Computational social science: obstacles and opportunities","volume":"369","author":"Lazer","year":"2020","journal-title":"Science"},{"key":"2024062007512142500_ocae118-B8","doi-asserted-by":"crossref","article-title":"Is Twitter enough? Investigating situational awareness in social and print media during the second COVID-19 wave in India","author":"Vohra","DOI":"10.1109\/ASONAM55673.2022.10068667"},{"key":"2024062007512142500_ocae118-B9","first-page":"3968","author":"Wu","year":"2023"},{"issue":"Database issue","key":"2024062007512142500_ocae118-B10","doi-asserted-by":"crossref","first-page":"D267","DOI":"10.1093\/nar\/gkh061","article-title":"The Unified Medical Language System (UMLS): integrating biomedical terminology","volume":"32","author":"Bodenreider","year":"2004","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"2024062007512142500_ocae118-B11","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1007\/s13278-021-00825-0","article-title":"An augmented multilingual Twitter dataset for studying the COVID-19 infodemic","volume":"11","author":"Lopez","year":"2021","journal-title":"Soc Netw Anal Min"},{"key":"2024062007512142500_ocae118-B12","article-title":"BERT: pre-training of deep bidirectional transformers for language understanding","author":"Devlin","year":"2019","journal-title":"ArXiv181004805 Cs"},{"key":"2024062007512142500_ocae118-B13","author":"Zhou","year":"2022"},{"key":"2024062007512142500_ocae118-B14","doi-asserted-by":"crossref","DOI":"10.3389\/frai.2023.1023281","article-title":"COVID-Twitter-BERT: a natural language processing model to analyse COVID-19 content on Twitter","volume-title":"Front Artif Intell","author":"M\u00fcller","year":"2023"},{"key":"2024062007512142500_ocae118-B15","first-page":"7199","author":"Jiang","year":"2022"},{"key":"2024062007512142500_ocae118-B16","doi-asserted-by":"crossref","first-page":"103983","DOI":"10.1016\/j.jbi.2021.103983","article-title":"CODER: knowledge-infused cross-lingual medical term embedding for term normalization","volume":"126","author":"Yuan","year":"2022","journal-title":"J Biomed Inform"},{"key":"2024062007512142500_ocae118-B17","doi-asserted-by":"crossref","first-page":"103951","DOI":"10.1016\/j.jbi.2021.103951","article-title":"PASCLex: a comprehensive post-acute sequelae of COVID-19 (PASC) symptom lexicon derived from electronic health record clinical notes","volume":"125","author":"Wang","year":"2022","journal-title":"J Biomed Inform"},{"key":"2024062007512142500_ocae118-B18","author":"Reimers","year":"2019"},{"issue":"1","key":"2024062007512142500_ocae118-B19","doi-asserted-by":"crossref","first-page":"e45419","DOI":"10.2196\/45419","article-title":"Trend and co-occurrence network of COVID-19 symptoms from large-scale social media data: infoveillance study","volume":"25","author":"Wu","year":"2023","journal-title":"J Med Internet Res"},{"key":"2024062007512142500_ocae118-B20","author":"Report of the WHO-China Joint Mission on Coronavirus Disease","year":"2019"},{"issue":"1","key":"2024062007512142500_ocae118-B21","doi-asserted-by":"crossref","first-page":"12005","DOI":"10.1038\/s41598-023-38761-y","article-title":"A deep semantic matching approach for identifying relevant messages for social media analysis","volume":"13","author":"Biggers","year":"2023","journal-title":"Sci Rep"},{"key":"2024062007512142500_ocae118-B22","author":"Zhu","year":"2024"},{"key":"2024062007512142500_ocae118-B23","doi-asserted-by":"crossref","article-title":"GreenPLM: cross-lingual transfer of monolingual pre-trained language models at almost no cost","author":"Zeng","DOI":"10.24963\/ijcai.2023\/698"},{"key":"2024062007512142500_ocae118-B24","author":"Zhou","year":"2023"},{"key":"2024062007512142500_ocae118-B25","author":"Hua","year":"2024"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocae118\/57830303\/ocae118.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/7\/1569\/58243716\/ocae118.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/7\/1569\/58243716\/ocae118.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,20]],"date-time":"2024-06-20T07:53:50Z","timestamp":1718870030000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/7\/1569\/7667306"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,8]]},"references-count":25,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,5,8]]},"published-print":{"date-parts":[[2024,6,20]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae118","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,7]]},"published":{"date-parts":[[2024,5,8]]}}}