{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"Research Square"}],"indexed":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T00:36:55Z","timestamp":1792888615330,"version":"4.5.0"},"posted":{"date-parts":[[2025,3,17]]},"group-title":"In Review","reference-count":71,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2025,3,17]],"date-time":"2025-03-17T00:00:00Z","timestamp":1742169600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2025,3,11]]},"abstract":"<title>Abstract<\/title>\n        <p>Objective\n The rapid evolution of the COVID-19 virus has led to the development of different vaccine shots, each designed to combat specific variants and enhance overall efficacy. While vaccines have been crucial in controlling the spread of the virus, they can also cause adverse events (AEs). Understanding these relationships is vital for vaccine safety monitoring and surveillance.\nMethods\n In our study, we collected data from the Vaccine Adverse Event Reporting System (VAERS) and social media platforms (Twitter and Reddit) to extract relationships between COVID-19 vaccine shots and adverse events. The dataset comprised 771 relation pairs, enabling a comprehensive analysis of adverse event patterns. We employed state-of-the-art GPT models, including GPT-3.5 and GPT-4, alongside traditional models such as Recurrent Neural Networks (RNNs) and BioBERT, to extract these relationships. Additionally, we used two sets of post-processing rules to further refine the extracted relations. Evaluation metrics including precision, recall, and F1-score were used to assess the performance of our models in extracting these relationships accurately.\nResults\n The most commonly reported AEs following the primary series of COVID-19 vaccines include arm soreness, fatigue, and headache, while the spectrum of AEs following boosters is more diverse. In relation extraction, fine-tuned GPT-3.5 with Sentence-based Relation Identification achieved the highest precision of 0.94 and a perfect recall of 1, resulting in an impressive F1 score of 0.97.\nConclusion\n This study advances biomedical informatics by showing how large language models and deep learning models can extract relationships between vaccine shots and adverse events from VAERS and social media. These findings improve vaccine safety monitoring and clinical practice by enhancing our understanding of post-vaccination symptoms. The study sets a precedent for future research in natural language processing and biomedical informatics, with potential applications in pharmacovigilance and clinical decision-making.<\/p>","DOI":"10.21203\/rs.3.rs-6201919\/v1","type":"posted-content","created":{"date-parts":[[2025,3,17]],"date-time":"2025-03-17T04:34:41Z","timestamp":1742186081000},"source":"Crossref","is-referenced-by-count":13,"title":["Enhancing Relation Extraction for COVID-19 Vaccine Shot-Adverse Event Associations with Large Language Models"],"prefix":"10.21203","author":[{"given":"Yiming","family":"Li","sequence":"first","affiliation":[{"name":"The University of Texas Health Science Center at Houston"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deepthi","family":"Viswaroopan","sequence":"additional","affiliation":[{"name":"The University of Texas Health Science Center at Houston"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William","family":"He","sequence":"additional","affiliation":[{"name":"Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianfu","family":"Li","sequence":"additional","affiliation":[{"name":"Mayo Clinic"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xu","family":"Zuo","sequence":"additional","affiliation":[{"name":"The University of Texas Health Science Center at Houston"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hua","family":"Xu","sequence":"additional","affiliation":[{"name":"Yale University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cui","family":"Tao","sequence":"additional","affiliation":[{"name":"Mayo Clinic"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.1080\/22221751.2021.1898291","author":"To KK-W","year":"2021","unstructured":"To KK-W (2021) Lessons learned 1 year after SARS-CoV\u20132 emergence leading to COVID\u201319 pandemic, Emerging Microbes & Infections, Jan. Accessed: May 08, 2024. [Online]. Available: https:\/\/www.tandfonline.com\/doi\/abs\/10.1080\/22221751.2021.1898291"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1080\/21645515.2020.1810496","author":"Barbuddhe SB","year":"2020","unstructured":"Barbuddhe SB, Rawool DB, Gaonkar PP, Vergis J, Dhama K, Malik SS (2020) Global scenario, public health concerns and mitigation strategies to counter current ongoing SARS-CoV\u20132 \/ COVID\u201319 pandemic, Human Vaccines & Immunotherapeutics, vol. 16, no. 12, pp. 3023\u20133033, Dec. 10.1080\/21645515.2020.1810496"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1093\/cid\/ciab079","author":"Moghadas SM","year":"2021","unstructured":"Moghadas SM et al (2021) The Impact of Vaccination on Coronavirus Disease 2019 (COVID\u201319) Outbreaks in the United States, Clinical Infectious Diseases, vol. 73, no. 12, pp. 2257\u20132264, Dec. 10.1093\/cid\/ciab079"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs\u20134876692\/v1","author":"Tao C","year":"2024","unstructured":"Tao C et al (2024) Sep., VaxBot-HPV: A GPT-based Chatbot for Answering HPV Vaccine-related Questions, Research Square, p. rs.3.rs. 10.21203\/rs.3.rs\u20134876692\/v1"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1038\/s41577-021-00592\u20131","author":"Tregoning JS","year":"2021","unstructured":"Tregoning JS, Flight KE, Higham SL, Wang Z, Pierce BF (2021) Progress of the COVID\u201319 vaccine effort: viruses, vaccines and variants versus efficacy, effectiveness and escape, Nat Rev Immunol, vol. 21, no. 10, pp. 626\u2013636, Oct. 10.1038\/s41577-021-00592\u20131"},{"issue":"1","key":"ref6","doi-asserted-by":"publisher","first-page":"ooaf005","DOI":"10.1093\/jamiaopen\/ooaf005","article-title":"VaxBot-HPV: a GPT-based chatbot for answering HPV vaccine-related questions","volume":"8","author":"Li Y","unstructured":"Li Y et al (Feb. 2025) VaxBot-HPV: a GPT-based chatbot for answering HPV vaccine-related questions. JAMIA Open 8(1):ooaf005. 10.1093\/jamiaopen\/ooaf005","journal-title":"JAMIA Open"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.3389\/fimmu.2020.01817","author":"Frederiksen LSF","year":"2020","unstructured":"Frederiksen LSF, Zhang Y, Foged C, Thakur A (2020) The Long Road Toward COVID\u201319 Herd Immunity: Vaccine Platform Technologies and Mass Immunization Strategies, Front. Immunol., vol. 11, Jul. 10.3389\/fimmu.2020.01817"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.3390\/vaccines10081256","article-title":"Fast Tracking\u2014Vaccine Safety, Efficacy, and Lessons Learned: A Narrative Review","volume":"10","author":"Wong JC","unstructured":"Wong JC, Lao CT, Yousif MM, Luga JM (Aug. 2022) Fast Tracking\u2014Vaccine Safety, Efficacy, and Lessons Learned: A Narrative Review. Vaccines 10 8, Art. 8. 10.3390\/vaccines10081256","journal-title":"Vaccines"},{"issue":"1","key":"ref9","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1186\/s13326-024-00318-x","article-title":"Mapping vaccine names in clinical trials to vaccine ontology using cascaded fine-tuned domain-specific language models","volume":"15","author":"Li J","unstructured":"Li J et al (Aug. 2024) Mapping vaccine names in clinical trials to vaccine ontology using cascaded fine-tuned domain-specific language models. J Biomed Semant 15(1):14. 10.1186\/s13326-024-00318-x","journal-title":"J Biomed Semant"},{"issue":"3","key":"ref10","first-page":"441","article-title":"Assessing COVID\u201319 Emergency Use Authorizations","volume":"76","author":"Parasidis E","year":"2021","unstructured":"Parasidis E, Berman ML, Zettler PJ (2021) Assessing COVID\u201319 Emergency Use Authorizations. Food Drug Law J 76(3):441\u2013501","journal-title":"Food Drug Law J"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0300919","author":"Li Y","year":"2024","unstructured":"Li Y, Li J, He J, Tao C (2024) AE-GPT: Using Large Language Models to extract adverse events from surveillance reports-A use case with influenza vaccine adverse events, PLOS ONE, vol. 19, no. 3, p. e0300919, Mar. 10.1371\/journal.pone.0300919"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"e51007","DOI":"10.2196\/51007","article-title":"Adverse Events of COVID\u201319 Vaccines in the United States: Temporal and Spatial Analysis","volume":"10","author":"Li Y","unstructured":"Li Y, Li J, Dang Y, Chen Y, Tao C (Jul. 2024) Adverse Events of COVID\u201319 Vaccines in the United States: Temporal and Spatial Analysis. JMIR Public Health Surveill 10:e51007. 10.2196\/51007","journal-title":"JMIR Public Health Surveill"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1038\/s41558-024-02192-y","author":"Zhang K","year":"2024","unstructured":"Zhang K, Dang Y, Li Y, Tao C, Hur J, He Y (2024) Impact of climate change on vaccine responses and inequity, Nat. Clim. Chang., vol. 14, no. 12, pp. 1216\u20131218, Dec. 10.1038\/s41558-024-02192-y"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1080\/14760584.2023.2292203","author":"Li Y","year":"2024","unstructured":"Li Y et al (2024) Unpacking adverse events and associations post COVID\u201319 vaccination: a deep dive into vaccine adverse event reporting system data, Expert Review of Vaccines, vol. 23, no. 1, pp. 53\u201359, Dec. 10.1080\/14760584.2023.2292203"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.2196\/preprints.51007","article-title":"Temporal and Spatial Analysis of COVID\u201319 Vaccines Using Reports from Vaccine Adverse Event Reporting System","author":"Li Y","unstructured":"Li Y, Li J, Dang Y, Chen Y, Tao C Temporal and Spatial Analysis of COVID\u201319 Vaccines Using Reports from Vaccine Adverse Event Reporting System. JMIR Preprints, 10.2196\/preprints.51007","journal-title":"JMIR Preprints"},{"key":"ref16","doi-asserted-by":"crossref","first-page":"e51007","DOI":"10.2196\/51007","article-title":"COVID\u201319 Vaccine Adverse Events in the United States: A Temporal and Spatial Analysis","volume":"10","author":"Li Y","year":"2024","unstructured":"Li Y, Li J, Dang Y, Chen Y, Tao C (2024) COVID\u201319 Vaccine Adverse Events in the United States: A Temporal and Spatial Analysis. JMIR Public Health Surveill 10:e51007","journal-title":"JMIR Public Health Surveill"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs\u20136096098\/v1","author":"Li Y","year":"2025","unstructured":"Li Y, Tao W, Dang Y, Chen Y, Tao C (2025) Exploring Temporal and Spatial Characteristics of Serious Adverse Event Reports Following COVID\u201319 Bivalent Vaccines, Mar. 03, Research Square. 10.21203\/rs.3.rs\u20136096098\/v1"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.2196\/preprints.51007","article-title":"Temporal and Spatial Analysis of COVID\u201319 Vaccines Using Reports from Vaccine Adverse Event Reporting System","author":"Li Y","unstructured":"Li Y, Li J, Dang Y, Chen Y, Tao C (Sep. 2023) Temporal and Spatial Analysis of COVID\u201319 Vaccines Using Reports from Vaccine Adverse Event Reporting System. JMIR Preprints. 10.2196\/preprints.51007","journal-title":"JMIR Preprints"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs\u20136152825\/v1","author":"Li Y","year":"2025","unstructured":"Li Y et al (2025) Exploring Associations Between COVID\u201319 Bivalent Vaccines and Their Related Adverse Events: A Correlational Study, Mar. 10, Research Square. 10.21203\/rs.3.rs\u20136152825\/v1"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1080\/14760584.2023.2209177","author":"Shabu A","year":"2023","unstructured":"Shabu A, Nishtala PS (2023) Safety outcomes associated with the moderna COVID\u201319 vaccine (mRNA\u20131273): a literature review, Expert Review of Vaccines, vol. 22, no. 1, pp. 393\u2013409, Dec. 10.1080\/14760584.2023.2209177"},{"issue":"4","key":"ref21","doi-asserted-by":"publisher","first-page":"24","DOI":"10.58729\/1941\u20136679.1521","article-title":"An Analysis of Covid\u201319 Vaccine Allergic Reactions","volume":"30","author":"Schumaker R","unstructured":"Schumaker R, Veronin M, Rohm T, Dixit R, Aljawarneh S, Lara J (Jan. 2021) An Analysis of Covid\u201319 Vaccine Allergic Reactions. J Int Technol Inform Manage 30(4):24\u201340. 10.58729\/1941\u20136679.1521","journal-title":"J Int Technol Inform Manage"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1007\/s13181-023-00931\u20139","author":"Chary M","year":"2023","unstructured":"Chary M, Barbuto AF, Izadmehr S, Tarsillo M, Fleischer E, Burns MM (2023) COVID\u201319 Therapeutics: Use, Mechanism of Action, and Toxicity (Vaccines, Monoclonal Antibodies, and Immunotherapeutics), J. Med. Toxicol., vol. 19, no. 2, pp. 205\u2013218, Apr. 10.1007\/s13181-023-00931\u20139"},{"issue":"37","key":"ref23","doi-asserted-by":"publisher","first-page":"5351","DOI":"10.1016\/j.vaccine.2023.07.013","article-title":"Thrombosis with thrombocytopenia syndrome: A database review of clinical trial and post-marketing experience with Ad26.COV2.S","volume":"41","author":"Struyf F","unstructured":"Struyf F et al (Aug. 2023) Thrombosis with thrombocytopenia syndrome: A database review of clinical trial and post-marketing experience with Ad26.COV2.S. Vaccine 41(37):5351\u20135359. 10.1016\/j.vaccine.2023.07.013","journal-title":"Vaccine"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2022.08.036","author":"Fraiman J","year":"2022","unstructured":"Fraiman J et al (2022) Sep., Serious adverse events of special interest following mRNA COVID\u201319 vaccination in randomized trials in adults, Vaccine, vol. 40, no. 40, pp. 5798\u20135805. 10.1016\/j.vaccine.2022.08.036"},{"issue":"1","key":"ref25","doi-asserted-by":"publisher","first-page":"1686","DOI":"10.1186\/s12889-021-11745\u20131","article-title":"Vaccine hesitancy: evidence from an adverse events following immunization database, and the role of cognitive biases","volume":"21","author":"Azarpanah H","unstructured":"Azarpanah H, Farhadloo M, Vahidov R, Pilote L (Sep. 2021) Vaccine hesitancy: evidence from an adverse events following immunization database, and the role of cognitive biases. BMC Public Health 21(1):1686. 10.1186\/s12889-021-11745\u20131","journal-title":"BMC Public Health"},{"issue":"24","key":"ref26","doi-asserted-by":"publisher","first-page":"2673","DOI":"10.1016\/j.vaccine.2013.04.009","article-title":"Who is unlikely to report adverse events after vaccinations to the Vaccine Adverse Event Reporting System (VAERS)?","volume":"31","author":"McNeil MM","unstructured":"McNeil MM, Li R, Pickering S, Real TM, Smith PJ, Pemberton MR (May 2013) Who is unlikely to report adverse events after vaccinations to the Vaccine Adverse Event Reporting System (VAERS)? Vaccine 31(24):2673\u20132679. 10.1016\/j.vaccine.2013.04.009","journal-title":"Vaccine"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.52547\/vacres.8.1.52","author":"Hozouri H","year":"2021","unstructured":"Hozouri H, Shamsian A, Aghasadeghi M, Doroud D (2021) Comparative Study of AEFI of Hepatitis B Vaccine between Iran Ministry of Health CDC and VAERS Data during 2015 to 2017, Vaccine Research, vol. 8, pp. 52\u201359, Jun. 10.52547\/vacres.8.1.52"},{"issue":"36","key":"ref28","doi-asserted-by":"publisher","first-page":"4398","DOI":"10.1016\/j.vaccine.2015.07.035","article-title":"Safety monitoring in the Vaccine Adverse Event Reporting System (VAERS)","volume":"33","author":"Shimabukuro TT","unstructured":"Shimabukuro TT, Nguyen M, Martin D, DeStefano F (Aug. 2015) Safety monitoring in the Vaccine Adverse Event Reporting System (VAERS). Vaccine 33(36):4398\u20134405. 10.1016\/j.vaccine.2015.07.035","journal-title":"Vaccine"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1055\/a\u20131975\u20134061","author":"Habibabadi SK","year":"2023","unstructured":"Habibabadi SK, Palmer C, Dimaguila GL, Javed M, Clothier HJ, Buttery J (2023) Australasian Institute of Digital Health Summit 2022\u2013Automated Social Media Surveillance for Detection of Vaccine Safety Signals: A Validation Study, Appl Clin Inform, vol. 14, no. 1, pp. 1\u201310, Jan. 10.1055\/a\u20131975\u20134061"},{"issue":"5","key":"ref30","doi-asserted-by":"publisher","first-page":"e35115","DOI":"10.2196\/35115","article-title":"Monitoring User Opinions and Side Effects on COVID\u201319 Vaccines in the Twittersphere: Infodemiology Study of Tweets","volume":"24","author":"Portelli B","unstructured":"Portelli B, Scaboro S, Tonino R, Chersoni E, Santus E, Serra G (May 2022) Monitoring User Opinions and Side Effects on COVID\u201319 Vaccines in the Twittersphere: Infodemiology Study of Tweets. J Med Internet Res 24(5):e35115. 10.2196\/35115","journal-title":"J Med Internet Res"},{"key":"ref31","unstructured":"VAERS - Data Accessed: Aug. 17, 2023. [Online]. Available: https:\/\/vaers.hhs.gov\/data.html"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"e42227","DOI":"10.2196\/42227","article-title":"One Year of COVID\u201319 Vaccine Misinformation on Twitter: Longitudinal Study","volume":"25","author":"Pierri F","unstructured":"Pierri F, DeVerna MR, Yang K-C, Axelrod D, Bryden J, Menczer F (Feb. 2023) One Year of COVID\u201319 Vaccine Misinformation on Twitter: Longitudinal Study. J Med Internet Res 25:e42227. 10.2196\/42227","journal-title":"J Med Internet Res"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1101\/2021.04.09.21255229","author":"Navin","year":"2021","unstructured":"Navin, Kumar et al (2021) COVID\u201319 vaccine perceptions: An observational study on Reddit, medRxiv, p. 2021.04.09.21255229, Jan. 10.1101\/2021.04.09.21255229"},{"key":"ref34","doi-asserted-by":"publisher","first-page":"103382","DOI":"10.1016\/j.jbi.2020.103382","article-title":"Multiple features for clinical relation extraction: A machine learning approach","volume":"103","author":"Alimova I","unstructured":"Alimova I, Tutubalina E (Mar. 2020) Multiple features for clinical relation extraction: A machine learning approach. J Biomed Inform 103:103382. 10.1016\/j.jbi.2020.103382","journal-title":"J Biomed Inform"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acl-long.868","author":"Wadhwa S","year":"2023","unstructured":"Wadhwa S, Amir S, Wallace BC (2023) Revisiting Relation Extraction in the era of Large Language Models, Proc Conf Assoc Comput Linguist Meet, vol. pp. 15566\u201315589, Jul. 2023. 10.18653\/v1\/2023.acl-long.868"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1007\/s41666-024-00162\u20139","author":"He J","year":"2024","unstructured":"He J et al (2024) Prompt Tuning in Biomedical Relation Extraction, J Healthc Inform Res, Feb. 10.1007\/s41666-024-00162\u20139"},{"key":"ref37","doi-asserted-by":"publisher","first-page":"104735","DOI":"10.1016\/j.jbi.2024.104735","article-title":"Improving tabular data extraction in scanned laboratory reports using deep learning models","volume":"159","author":"Li Y","unstructured":"Li Y, Wei Q, Chen X, Li J, Tao C, Xu H (Nov. 2024) Improving tabular data extraction in scanned laboratory reports using deep learning models. J Biomed Inform 159:104735. 10.1016\/j.jbi.2024.104735","journal-title":"J Biomed Inform"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI57859.2023.00053","author":"Li Y","year":"2023","unstructured":"Li Y et al (2023) Development of a Natural Language Processing Tool to Extract Acupuncture Point Location Terms, in., IEEE 11th International Conference on Healthcare Informatics (ICHI), Jun. 2023, pp. 344\u2013351. 10.1109\/ICHI57859.2023.00053"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2411.03805","article-title":"A Comparative Study of Recent Large Language Models on Generating Hospital Discharge Summaries for Lung Cancer Patients","author":"Li Y","year":"2024","unstructured":"Li Y, Li F, Roberts K, Cui L, Tao C, Xu H (2024) A Comparative Study of Recent Large Language Models on Generating Hospital Discharge Summaries for Lung Cancer Patients. arXiv org. 10.48550\/arXiv.2411.03805","journal-title":"arXiv org"},{"key":"ref40","doi-asserted-by":"publisher","first-page":"26839","DOI":"10.1109\/ACCESS.2024.3365742","article-title":"A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges","volume":"12","author":"Raiaan MAK","year":"2024","unstructured":"Raiaan MAK et al (2024) A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges. IEEE Access 12:26839\u201326874. 10.1109\/ACCESS.2024.3365742","journal-title":"IEEE Access"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocae129","author":"Li Y","year":"2024","unstructured":"Li Y et al (2024) Sep., RefAI: a GPT-powered retrieval-augmented generative tool for biomedical literature recommendation and summarization, Journal of the American Medical Informatics Association, vol. 31, no. 9, pp. 2030\u20132039. 10.1093\/jamia\/ocae129"},{"key":"ref42","author":"Li Y","year":"2024","unstructured":"Li Y (2024) Comprehensive Analysis of Adverse Events Following COVID\u201319 Vaccination: Insights from Diverse Data Sources, Dissertations & Theses (Open Access), Oct. [Online]. Available: https:\/\/digitalcommons.library.tmc.edu\/uthshis_dissertations\/66"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocae233","author":"Li Y","year":"2024","unstructured":"Li Y et al (2024) Relation extraction using large language models: a case study on acupuncture point locations, Journal of the American Medical Informatics Association, vol. 31, no. 11, pp. 2622\u20132631, Nov. 10.1093\/jamia\/ocae233"},{"key":"ref44","doi-asserted-by":"publisher","first-page":"104621","DOI":"10.1016\/j.jbi.2024.104621","article-title":"Artificial intelligence-powered pharmacovigilance: A review of machine and deep learning in clinical text-based adverse drug event detection for benchmark datasets","volume":"152","author":"Li Y","unstructured":"Li Y et al (Apr. 2024) Artificial intelligence-powered pharmacovigilance: A review of machine and deep learning in clinical text-based adverse drug event detection for benchmark datasets. J Biomed Inform 152:104621. 10.1016\/j.jbi.2024.104621","journal-title":"J Biomed Inform"},{"key":"ref45","author":"Alt C","year":"2019","unstructured":"Alt C, H\u00fcbner M, Hennig L (2019) Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extraction"},{"key":"ref46","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2303.16416","article-title":"Zero-shot Clinical Entity Recognition using ChatGPT","author":"Hu Y","year":"2023","unstructured":"Hu Y et al (2023) Zero-shot Clinical Entity Recognition using ChatGPT. arXiv org. 10.48550\/arXiv.2303.16416","journal-title":"arXiv org"},{"key":"ref47","author":"Wan Z","year":"2023","unstructured":"Wan Z et al (2023) GPT-RE: In-context Learning for Relation Extraction using Large Language Models"},{"key":"ref48","author":"Kanwal S","year":"2024","unstructured":"Kanwal S (2024) Exploring the potential of LLMs for biomedical relation extraction, Text, [Online]. Available: https:\/\/open.library.ubc.ca\/collections\/24\/items\/1.0440989"},{"key":"ref49","author":"Shi Z","year":"2024","unstructured":"Shi Z, Luo H (2024) CRE-LLM: A Domain-Specific Chinese Relation Extraction Framework with Fine-tuned Large Language Model"},{"key":"ref50","doi-asserted-by":"publisher","first-page":"104789","DOI":"10.1016\/j.jbi.2025.104789","article-title":"Improving entity recognition using ensembles of deep learning and fine-tuned large language models: A case study on adverse event extraction from VAERS and social media","volume":"163","author":"Li Y","unstructured":"Li Y et al (Mar. 2025) Improving entity recognition using ensembles of deep learning and fine-tuned large language models: A case study on adverse event extraction from VAERS and social media. J Biomed Inform 163:104789. 10.1016\/j.jbi.2025.104789","journal-title":"J Biomed Inform"},{"key":"ref51","doi-asserted-by":"publisher","DOI":"10.1080\/21645515.2018.1456598","author":"Miller ER","year":"2018","unstructured":"Miller ER et al (2018) Post-licensure safety surveillance of zoster vaccine live (Zostavax\u00ae) in the United States, Vaccine Adverse Event Reporting System (VAERS), 2006\u20132015, Human Vaccines & Immunotherapeutics, Aug. Accessed: May 10, 2024. [Online]. Available: https:\/\/www.tandfonline.com\/doi\/abs\/10.1080\/21645515.2018.1456598"},{"key":"ref52","doi-asserted-by":"publisher","DOI":"10.1080\/14740338.2016.1194823","author":"Moro PL","year":"2016","unstructured":"Moro PL, Li R, Haber P, Weintraub E, Cano M (2016) Surveillance systems and methods for monitoring the post-marketing safety of influenza vaccines at the Centers for Disease Control and Prevention, Expert Opinion on Drug Safety, vol. 15, no. 9, pp. 1175\u20131183, Sep. 10.1080\/14740338.2016.1194823"},{"key":"ref53","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1007\/978-981-99-8949-2_11","volume-title":"Pharmacovigilance Essentials: Advances, Challenges and Global Perspectives","author":"Amir M","year":"2024","unstructured":"Amir M, Nandave M, Kumar A (2024) Vaccine Safety Surveillance. In: Nandave M, Kumar A (eds) in Pharmacovigilance Essentials: Advances, Challenges and Global Perspectives. Springer Nature, Singapore, pp 227\u2013241. doi: 10.1007\/978-981-99\u20138949\u20132_11."},{"key":"ref54","author":"Accessed","unstructured":"Surveillance Manual | Vaccine Adverse Event Reporting System | VPDs | CDC., Accessed May 10, 2024. [Online]. Available: http:\/\/medbox.iiab.me\/modules\/en-cdc\/www.cdc.gov\/vaccines\/pubs\/surv-manual\/chpt21-surv-adverse-events.html"},{"issue":"2","key":"ref55","doi-asserted-by":"crossref","first-page":"154","DOI":"10.18267\/j.aip.138","article-title":"The Role of Twitter During the COVID\u201319 Crisis: A Systematic Literature Review","volume":"9","year":"2020","unstructured":"The Role of Twitter During the COVID\u201319 Crisis: A Systematic Literature Review. Acta Informatica Pragensia, 9, 2, pp. 154\u2013169, (2020)","journal-title":"Acta Informatica Pragensia"},{"key":"ref56","doi-asserted-by":"publisher","DOI":"10.1080\/21645515.2020.1780846","author":"Puri N","year":"2020","unstructured":"Puri N, Coomes EA, Haghbayan H, Gunaratne K (2020) Social media and vaccine hesitancy: new updates for the era of COVID\u201319 and globalized infectious diseases, Human Vaccines & Immunotherapeutics, Nov. Accessed: May 10, 2024. [Online]. Available: https:\/\/www.tandfonline.com\/doi\/abs\/10.1080\/21645515.2020.1780846"},{"key":"ref57","doi-asserted-by":"crossref","unstructured":"Listening to (2020) Twitter about Adverse Events of the Comirnaty COVID\u201319 Vaccine during first weeks of immunisation in Poland, e-methodology, vol. 7, no. 7, pp. 85\u201392","DOI":"10.15503\/emet2020.85.92"},{"key":"ref58","doi-asserted-by":"publisher","DOI":"10.2196\/32685","author":"Yan C","year":"2021","unstructured":"Yan C, Law M, Nguyen S, Cheung J, Kong J (2021) Comparing Public Sentiment Toward COVID\u201319 Vaccines Across Canadian Cities: Analysis of Comments on Reddit, Journal of Medical Internet Research, vol. 23, no. 9, p. e32685, Sep. 10.2196\/32685"},{"key":"ref59","doi-asserted-by":"publisher","DOI":"10.1016\/j.jiph.2021.08.010","author":"Melton CA","year":"2021","unstructured":"Melton CA, Olusanya OA, Ammar N, Shaban-Nejad A (2021) Public sentiment analysis and topic modeling regarding COVID\u201319 vaccines on the Reddit social media platform: A call to action for strengthening vaccine confidence, Journal of Infection and Public Health, vol. 14, no. 10, pp. 1505\u20131512, Oct. 10.1016\/j.jiph.2021.08.010"},{"key":"ref60","doi-asserted-by":"publisher","first-page":"54608","DOI":"10.1109\/ACCESS.2024.3389497","article-title":"GPT (Generative Pre-Trained Transformer)\u2014 A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions","volume":"12","author":"Yenduri G","year":"2024","unstructured":"Yenduri G et al (2024) GPT (Generative Pre-Trained Transformer)\u2014 A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions. IEEE Access 12:54608\u201354649. 10.1109\/ACCESS.2024.3389497","journal-title":"IEEE Access"},{"key":"ref61","doi-asserted-by":"publisher","DOI":"10.15439\/2020F20","author":"Gillioz A","year":"2020","unstructured":"Gillioz A, Casas J, Mugellini E, Khaled OA, Overview of the Transformer-based Models for NLP Tasks, in (2020) 15th Conference on Computer Science and Information Systems (FedCSIS), Sep. 2020, pp. 179\u2013183. 10.15439\/2020F20"},{"key":"ref62","doi-asserted-by":"publisher","DOI":"10.1145\/3109859.3109877","author":"Donkers T","year":"2017","unstructured":"Donkers T, Loepp B, Ziegler J (2017) Sequential User-based Recurrent Neural Network Recommendations, in Proceedings of the Eleventh ACM Conference on Recommender Systems, in RecSys \u201917. New York, NY, USA: Association for Computing Machinery, Aug. pp. 152\u2013160. 10.1145\/3109859.3109877"},{"key":"ref63","doi-asserted-by":"publisher","DOI":"10.9734\/ajrcos\/2021\/v11i230259","author":"Zeebaree DQ","year":"2021","unstructured":"Zeebaree DQ, Abdulazeez AM, Abdullrhman LM, Hasan DA, Kareem OS (2021) The Prediction Process Based on Deep Recurrent Neural Networks: A Review, AJRCoS, vol. 11, no. 2, pp. 29\u201345, Aug. 10.9734\/ajrcos\/2021\/v11i230259"},{"key":"ref64","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33015525","author":"Xu C","year":"2019","unstructured":"Xu C, Huang W, Wang H, Wang G, Liu T-Y (2019) Modeling Local Dependence in Natural Language with Multi-Channel Recurrent Neural Networks, Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, Art. no. 01, Jul. 10.1609\/aaai.v33i01.33015525"},{"key":"ref65","article-title":"Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks","author":"Das R","year":"2017","unstructured":"Das R, Neelakantan A, Belanger D, McCallum A (2017) Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks"},{"key":"ref66","doi-asserted-by":"publisher","first-page":"btz682","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","author":"Lee J","unstructured":"Lee J et al (Sep. 2019) BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics btz682. 10.1093\/bioinformatics\/btz682","journal-title":"Bioinformatics"},{"key":"ref67","doi-asserted-by":"publisher","DOI":"10.1080\/21645515.2021.1995283","author":"Joshi G","year":"2021","unstructured":"Joshi G, Borah P, Thakur S, Sharma P, Mayank, Poduri R (2021) Exploring the COVID\u201319 vaccine candidates against SARS-CoV\u20132 and its variants: where do we stand and where do we go? Human Vaccines & Immunotherapeutics, Dec. Accessed: May 13, 2024. [Online]. Available: https:\/\/www.tandfonline.com\/doi\/abs\/10.1080\/21645515.2021.1995283"},{"key":"ref68","article-title":"Rapid induction of antigen-specific CD4\u2009+\u2009T cells is associated with coordinated humoral and cellular immunity to SARS-CoV\u20132 mRNA vaccination","author":"Painter MM","unstructured":"Painter MM et al Rapid induction of antigen-specific CD4\u2009+\u2009T cells is associated with coordinated humoral and cellular immunity to SARS-CoV\u20132 mRNA vaccination"},{"key":"ref69","doi-asserted-by":"publisher","DOI":"10.3390\/vaccines10020140","author":"Shiri T","year":"2022","unstructured":"Shiri T et al (2022) The Population-Wide Risk-Benefit Profile of Extending the Primary COVID\u201319 Vaccine Course Compared with an mRNA Booster Dose Program, Vaccines, vol. 10, no. 2, Art. no. 2, Feb. 10.3390\/vaccines10020140"},{"key":"ref70","unstructured":"Data from NIHR-supported studies inform UK COVID\u201319 Booster Programme Accessed: May 13, 2024. [Online]. Available: https:\/\/www.nihr.ac.uk\/news\/data-from-nihr-supported-studies-inform-uk-covid\u201319-booster-programme\/28663"},{"key":"ref71","doi-asserted-by":"publisher","DOI":"10.3390\/microorganisms10030598","author":"Vo GV","year":"2022","unstructured":"Vo GV, Bagyinszky E, An SSA (2022) COVID\u201319 Genetic Variants and Their Potential Impact in Vaccine Development, Microorganisms, vol. 10, no. 3, Art. no. 3, Mar. 10.3390\/microorganisms10030598"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/www.researchsquare.com\/article\/rs-6201919\/v1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.researchsquare.com\/article\/rs-6201919\/v1.html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,17]],"date-time":"2025-03-17T04:34:46Z","timestamp":1742186086000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.researchsquare.com\/article\/rs-6201919\/v1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,17]]},"references-count":71,"URL":"https:\/\/doi.org\/10.21203\/rs.3.rs-6201919\/v1","relation":{},"subject":[],"published":{"date-parts":[[2025,3,17]]},"subtype":"preprint"}}