{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T02:33:43Z","timestamp":1787020423656,"version":"build-2736575974"},"reference-count":19,"publisher":"Springer Science and Business Media LLC","issue":"S4","license":[{"start":{"date-parts":[[2024,1,5]],"date-time":"2024-01-05T00:00:00Z","timestamp":1704412800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,1,5]],"date-time":"2024-01-05T00:00:00Z","timestamp":1704412800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01LM011829"],"award-info":[{"award-number":["R01LM011829"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01AI130460"],"award-info":[{"award-number":["R01AI130460"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Vaccine Adverse Events ReportingSystem (VAERS) is a promising resource of tracking adverse events following immunization. Medical Dictionary for Regulatory Activities (MedDRA) terminology used for coding adverse events in VAERS reports has several limitations. We focus on developing an automated system for semantic extraction of adverse events following vaccination and their temporal relationships for a better understanding of VAERS data and its integration into other applications. The aim of the present studyis to summarize the lessons learned during the initial phase of this project in annotating adverse events following influenza vaccination and related to Guillain-Barr\u00e9 syndrome (GBS). We emphasize on identifying the limitations of VAERS and MedDRA.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We collected 282 VAERS reports documented between 1990 and 2016 and shortlisted those with at least 1,100 characters in the report. We used a subset of 50 reports for the preliminary investigation and annotated all adverse events following influenza vaccination by mapping to representative MedDRA terms. Associated time expressions were annotated when available. We used 16 System Organ Class (SOC) level MedDRA terms to map GBS related adverse events and expanded some SOC terms to Lowest Level Terms (LLT) for granular representation. We annotated three broad categories of events such as problems, clinical investigations, and treatments\/procedures. The inter-annotator agreement of events achieved was 86%. Incomplete reports, typographical errors, lack of clarity and coherence, repeated texts, unavailability of associated temporal information, difficulty to interpret due to incorrect grammar, use of generalized terms to describe adverse events \/ symptoms, uncommon abbreviations, difficulty annotating multiple events with a conjunction \/ common phrase, irrelevant historical events and coexisting events were some of the challenges encountered. Some of the limitations we noted are in agreement with previous reports.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>We reported the challenges encountered and lessons learned during annotation of adverse events in VAERS reports following influenza vaccination and related to GBS. Though the challenges may be due to the inevitable limitations of public reporting systems and widely reported limitations of MedDRA, we emphasize the need to understand these limitations and extraction of other supportive information for a better understanding of adverse events following vaccination.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12911-023-02374-2","type":"journal-article","created":{"date-parts":[[2024,1,5]],"date-time":"2024-01-05T10:02:34Z","timestamp":1704448954000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Lessons learned from annotation of VAERS reports on adverse events following influenza vaccination and related to Guillain-Barr\u00e9 syndrome"],"prefix":"10.1186","volume":"23","author":[{"given":"Madhuri","family":"Sankaranarayanapillai","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Su","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hangyu","family":"Ji","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hsing-Yi","family":"Song","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4267-1924","authenticated-orcid":false,"given":"Cui","family":"Tao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,1,5]]},"reference":[{"issue":"9","key":"2374_CR1","doi-asserted-by":"publisher","first-page":"458","DOI":"10.5694\/j.1326-5377.1995.tb124691.x","volume":"163","author":"RM Wilson","year":"1995","unstructured":"Wilson RM, Runciman WB, Gibberd RW, Harrison BT, Newby L, Hamilton JD. The quality in Australian Health care study. Med J Aust. 1995;163(9):458.","journal-title":"Med J Aust"},{"key":"2374_CR2","doi-asserted-by":"publisher","first-page":"34318","DOI":"10.1038\/srep34318","volume":"6","author":"J Xie","year":"2016","unstructured":"Xie J, Zhao L, Zhou S, He Y. Statistical and ontological analysis of adverse events associated with monovalent and combination vaccines against hepatitis A and B diseases. Sci Rep. 2016;6:34318.","journal-title":"Sci Rep"},{"key":"2374_CR3","unstructured":"About VAERS;https:\/\/vaers.hhs.gov\/about.html. Accessed 9 Apr 2019."},{"issue":"36","key":"2374_CR4","doi-asserted-by":"publisher","first-page":"4398","DOI":"10.1016\/j.vaccine.2015.07.035","volume":"33","author":"TT Shimabukuro","year":"2015","unstructured":"Shimabukuro TT, Nguyen M, Martin D, DeStefano F. Safety monitoring in the Vaccine Adverse Event Reporting System (VAERS). Vaccine. 2015;33(36):4398\u2013405.","journal-title":"Vaccine"},{"key":"2374_CR5","unstructured":"Centers for Disease Control and Prevention Understanding the Vaccine Adverse Event Reporting System (VAERS). 2013.http:\/\/www.cdc.gov\/vaccines\/hcp\/patient-ed\/conversations\/downloads\/vacsafe-vaers-color-office.pdf."},{"key":"2374_CR6","volume-title":"Definition and Application of Terms for Vaccine Pharmacovigilance: Report of CIOMS\/WHO Working Group on Vaccine Pharmacovigilance","author":"Council for International Organizations of Medical Sciences (CIOMS)","year":"2012","unstructured":"Council for International Organizations of Medical Sciences (CIOMS). Definition and Application of Terms for Vaccine Pharmacovigilance: Report of CIOMS\/WHO Working Group on Vaccine Pharmacovigilance. Geneva: WHO Press, World Health Organization; 2012."},{"issue":"50","key":"2374_CR7","doi-asserted-by":"publisher","first-page":"7253","DOI":"10.1016\/j.vaccine.2012.09.074","volume":"30","author":"AM Loughlin","year":"2012","unstructured":"Loughlin AM, Marchant CD, Adams W, Barnett E, Baxter R, Black S, et al. Causality assessment of adverse events reported to the Vaccine Adverse Event Reporting System (VAERS). Vaccine. 2012;30(50):7253\u20139.","journal-title":"Vaccine"},{"issue":"1","key":"2374_CR8","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1186\/2041-1480-5-29","volume":"5","author":"Y He","year":"2014","unstructured":"He Y, Sarntivijai S, Lin Y, Xiang Z, Guo A, Zhang S, et al. OAE: The Ontology of Adverse Events. J Biomed Semant. 2014;5(1):29.","journal-title":"J Biomed Semant"},{"issue":"1","key":"2374_CR9","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1186\/2041-1480-3-13","volume":"3","author":"C Tao","year":"2012","unstructured":"Tao C, He Y, Yang H, Poland GA, Chute CG. Ontology-based time information representation of vaccine adverse events in VAERS for temporal analysis. J Biomed Semant. 2012;3(1):13.","journal-title":"J Biomed Semant"},{"issue":"S2","key":"2374_CR10","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1186\/s12911-017-0472-y","volume":"17","author":"Y Cai","year":"2017","unstructured":"Cai Y, Du J, Huang J, Ellenberg SS, Hennessy S, Tao C, et al. A signal detection method for temporal variation of adverse effect with vaccine adverse event reporting system data. BMC Med Inform Decis Mak. 2017;17(S2):76.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"2374_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13326-016-0056-2","volume":"7","author":"J Du","year":"2016","unstructured":"Du J, Cai Y, Chen Y, Tao C. Trivalent influenza vaccine adverse symptoms analysis based on MedDRA terminology using VAERS data in 2011. J Biomed Semant. 2016;7(1):1\u20137.","journal-title":"J Biomed Semant"},{"key":"2374_CR12","unstructured":"Guillain\u2013Barr\u00e9 syndrome; Available from:http:\/\/www.who.int\/news-room\/fact-sheets\/detail\/guillain-barr%C3%A9-syndrome. Accessed 9 Apr 2019."},{"key":"2374_CR13","doi-asserted-by":"publisher","unstructured":"Principi N, Esposito S. Vaccine-preventable diseases, vaccines and Guillain-Barre' syndrome. Vaccine. 2019;37(37):5544\u201350. https:\/\/doi.org\/10.1016\/j.vaccine.2018.05.119.","DOI":"10.1016\/j.vaccine.2018.05.119"},{"issue":"2","key":"2374_CR14","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1093\/cid\/cit222","volume":"57","author":"R Baxter","year":"2013","unstructured":"Baxter R, Bakshi N, Fireman B, Lewis E, Ray P, Vellozzi C, et al. Lack of association of Guillain-Barr\u00e9 syndrome with vaccinations. Clin Infect Dis. 2013;57(2):197\u2013204.","journal-title":"Clin Infect Dis"},{"issue":"8","key":"2374_CR15","doi-asserted-by":"publisher","first-page":"1149","DOI":"10.1093\/cid\/ciu005","volume":"58","author":"C Vellozzi","year":"2014","unstructured":"Vellozzi C, Iqbal S, Broder K. Guillain-Barre syndrome, influenza, and influenza vaccination: the epidemiologic evidence. Clin Infect Dis. 2014;58(8):1149\u201355.","journal-title":"Clin Infect Dis"},{"issue":"9","key":"2374_CR16","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1016\/S1473-3099(10)70140-7","volume":"10","author":"HC Lehmann","year":"2010","unstructured":"Lehmann HC, Hartung H, Kieseier BC, Hughes RA. Guillain-Barr\u00e9 syndrome after exposure to influenza virus. Lancet Infect Dis. 2010;10(9):643\u201351.","journal-title":"Lancet Infect Dis"},{"key":"2374_CR17","unstructured":"VAERS DATA USE GUIDE. 2017.https:\/\/vaers.hhs.gov\/docs\/VAERSDataUseGuide_October2017.pdf."},{"issue":"24","key":"2374_CR18","doi-asserted-by":"publisher","first-page":"2294","DOI":"10.1056\/NEJMra1114525","volume":"366","author":"N Yuki","year":"2012","unstructured":"Yuki N, Hartung H. Guillain-barr\u00e9 syndrome. N Engl J Med. 2012;366(24):2294\u2013304.https:\/\/doi.org\/10.1056\/NEJMra1114525.","journal-title":"N Engl J Med"},{"issue":"7","key":"2374_CR19","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1097\/01.JAA.0000466585.10595.f5","volume":"28","author":"R Estridge","year":"2015","unstructured":"Estridge R, Iskander M. Understanding guillain-barr\u00e9 syndrome. J Am Acad Phys Assist. 2015;28(7):19\u201322.https:\/\/doi.org\/10.1097\/01.JAA.0000466585.10595.f5.","journal-title":"J Am Acad Phys Assist"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02374-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-023-02374-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02374-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,5]],"date-time":"2024-01-05T10:04:13Z","timestamp":1704449053000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-023-02374-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,5]]},"references-count":19,"journal-issue":{"issue":"S4","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["2374"],"URL":"https:\/\/doi.org\/10.1186\/s12911-023-02374-2","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,5]]},"assertion":[{"value":"14 October 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 January 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"All authors declare no competing interests exist.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"298"}}