{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T01:06:47Z","timestamp":1790039207918,"version":"4.0.1"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2018,6,20]],"date-time":"2018-06-20T00:00:00Z","timestamp":1529452800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2018,6,20]],"date-time":"2018-06-20T00:00:00Z","timestamp":1529452800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["P30CA134274"],"award-info":[{"award-number":["P30CA134274"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Biomed Semant"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Vaccine has been one of the most successful public health interventions to date. However, vaccines are pharmaceutical products that carry risks so that many adverse events (AEs) are reported after receiving vaccines. Traditional adverse event reporting systems suffer from several crucial challenges including poor timeliness. This motivates increasing social media-based detection systems, which demonstrate successful capability to capture timely and prevalent disease information. Despite these advantages, social media-based AE detection suffers from serious challenges such as labor-intensive labeling and class imbalance of the training data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>To tackle both challenges from traditional reporting systems and social media, we exploit their complementary strength and develop a combinatorial classification approach by integrating Twitter data and the Vaccine Adverse Event Reporting System (VAERS) information aiming to identify potential AEs after influenza vaccine. Specifically, we combine formal reports which have accurately predefined labels with social media data to reduce the cost of manual labeling; in order to combat the class imbalance problem, a max-rule based multi-instance learning method is proposed to bias positive users. Various experiments were conducted to validate our model compared with other baselines. We observed that (1) multi-instance learning methods outperformed baselines when only Twitter data were used; (2) formal reports helped improve the performance metrics of our multi-instance learning methods consistently while affecting the performance of other baselines negatively; (3) the effect of formal reports was more obvious when the training size was smaller. Case studies show that our model labeled users and tweets accurately.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>We have developed a framework to detect vaccine AEs by combining formal reports with social media data. We demonstrate the power of formal reports on the performance improvement of AE detection when the amount of social media data was small. Various experiments and case studies show the effectiveness of our model.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13326-018-0184-y","type":"journal-article","created":{"date-parts":[[2018,6,20]],"date-time":"2018-06-20T09:16:10Z","timestamp":1529486170000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Adverse event detection by integrating twitter data and VAERS"],"prefix":"10.1186","volume":"9","author":[{"given":"Junxiang","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanfang","family":"Ye","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5429-6762","authenticated-orcid":false,"given":"Yuji","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2018,6,20]]},"reference":[{"issue":"4","key":"184_CR1","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1542\/peds.2013-0698","volume":"133","author":"F Zhou","year":"2014","unstructured":"Zhou F, Shefer A, Wenger J, Messonnier ML, Wang LY, Lopez AS, Moore MR, Murphy TV, Cortese MM, Rodewald LE. Economic evaluation of the routine childhood immunization program in the united states, 2009. Pediatrics. 2014; 133(4):577\u201385.","journal-title":"Pediatrics"},{"issue":"5","key":"184_CR2","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1097\/INF.0b013e3181a6a511","volume":"28","author":"GA Poland","year":"2009","unstructured":"Poland GA, Ovsyannikova IG, Jacobson RM. Adversomics: the emerging field of vaccine adverse event immunogenetics. Pediatr Infect Dis J. 2009; 28(5):431\u20132.","journal-title":"Pediatr Infect Dis J"},{"issue":"2","key":"184_CR3","doi-asserted-by":"crossref","first-page":"81","DOI":"10.3233\/JRS-2011-0525","volume":"23","author":"EP van Puijenbroek","year":"2011","unstructured":"van Puijenbroek EP, van Grootheest AC. Monitoring adverse events of vaccines against mexican flu. Int J Risk Saf Med. 2011; 23(2):81.","journal-title":"Int J Risk Saf Med"},{"issue":"3","key":"184_CR4","doi-asserted-by":"crossref","first-page":"183","DOI":"10.7883\/yoken.64.183","volume":"64","author":"SM Hwang","year":"2011","unstructured":"Hwang SM, Choe KW, Cho SH, Yoon SJ, Park DE, Kang JS, Kim MJ, Chun BC, Lee SM. The adverse events of influenza a (h1n1) vaccination and its risk factors in healthcare personnel in 18 military healthcare units in korea. Jpn J Infect Dis. 2011; 64(3):183\u20139.","journal-title":"Jpn J Infect Dis"},{"key":"184_CR5","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1016\/j.jbi.2015.02.004","volume":"54","author":"A Sarker","year":"2015","unstructured":"Sarker A, Ginn R, Nikfarjam A, O\u2019Connor K, Smith K, Jayaraman S, Upadhaya T, Gonzalez G. Utilizing social media data for pharmacovigilance: a review. J Biomed Inform. 2015; 54:202\u201312.","journal-title":"J Biomed Inform"},{"key":"184_CR6","volume-title":"Proceedings of the 35th European Conference on Advances in Information Retrieval, ECIR\u201913","author":"A Yates","year":"2013","unstructured":"Yates A, Goharian N. Adrtrace: Detecting expected and unexpected adverse drug reactions from user reviews on social media sites. In: Proceedings of the 35th European Conference on Advances in Information Retrieval, ECIR\u201913. Berlin: Springer: 2013. p. 816\u20139."},{"key":"184_CR7","volume-title":"Proceedings of the 5th International Workshop on Health Text Mining and Information Analysis (Louhi)","author":"I Segura-Bedmar","year":"2014","unstructured":"Segura-Bedmar I, Revert R, Mart\u00ednez P. Detecting drugs and adverse events from spanish social media streams. In: Proceedings of the 5th International Workshop on Health Text Mining and Information Analysis (Louhi). Gothenburg: Association for Computational Linguistics: 2014. p. 106\u201315."},{"key":"184_CR8","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.artmed.2016.05.004","volume":"70","author":"J Liu","year":"2016","unstructured":"Liu J, Zhao S, Zhang X. An ensemble method for extracting adverse drug events from social media. Artif Intell Med. 2016; 70:62\u201376.","journal-title":"Artif Intell Med"},{"key":"184_CR9","first-page":"924","volume":"2014","author":"K O\u2019Connor","year":"2014","unstructured":"O\u2019Connor K, Pimpalkhute P, Nikfarjam A, Ginn R, Smith KL, Gonzalez G. Pharmacovigilance on twitter? mining tweets for adverse drug reactions. AMIA Ann Symp Proc. 2014; 2014:924. American Medical Informatics Association.","journal-title":"AMIA Ann Symp Proc"},{"key":"184_CR10","volume-title":"Proceedings of the 2012 International Workshop on Smart Health and Wellbeing, SHB \u201912","author":"J Bian","year":"2012","unstructured":"Bian J, Topaloglu U, Yu F. Towards large-scale twitter mining for drug-related adverse events. In: Proceedings of the 2012 International Workshop on Smart Health and Wellbeing, SHB \u201912. New York: ACM: 2012. p. 25\u201332. https:\/\/doi.org\/101145\/23897072389713."},{"key":"184_CR11","volume-title":"Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD \u201913","author":"K Lee","year":"2013","unstructured":"Lee K, Agrawal A, Choudhary A. Real-time disease surveillance using twitter data: Demonstration on flu and cancer. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD \u201913. New York: ACM: 2013. p. 1474\u20137."},{"key":"184_CR12","doi-asserted-by":"crossref","unstructured":"Chen L, Hossain KT, Butler P, Ramakrishnan N, Prakash BA. Flu gone viral: Syndromic surveillance of flu on twitter using temporal topic models. In: 2014 IEEE International Conference on Data Mining (ICDM), vol. 00. Shenzhen: 2014. p. 755\u201360.","DOI":"10.1109\/ICDM.2014.137"},{"key":"184_CR13","unstructured":"Polgreen PM, Segre A, Signorini A. The use of twitter to track public concerns about novel h1n1 influenza. In: Infectious Diseases Society of America.2009."},{"key":"184_CR14","doi-asserted-by":"crossref","unstructured":"Kumar A, Raj B. Audio event detection using weakly labeled data. In: ACM on Multimedia Conference.2016. p. 1038\u201347.","DOI":"10.1145\/2964284.2964310"},{"issue":"1\u20132","key":"184_CR15","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/S0004-3702(96)00034-3","volume":"89","author":"TG Dietterich","year":"1997","unstructured":"Dietterich TG, Lathrop RH, Lozano-P\u00e9rez T. Solving the multiple instance problem with axis-parallel rectangles. Artif Intell. 1997; 89(1\u20132):31\u201371.","journal-title":"Artif Intell"},{"issue":"2","key":"184_CR16","first-page":"561","volume":"15","author":"S Andrews","year":"2002","unstructured":"Andrews S, Tsochantaridis I, Hofmann T. Support vector machines for multiple-instance learning. Adv Neural Inf Process Syst. 2002; 15(2):561\u20138.","journal-title":"Adv Neural Inf Process Syst"},{"key":"184_CR17","volume-title":"Proceedings of the 26th Annual International Conference on Machine Learning, ICML \u201909","author":"Z-H Zhou","year":"2009","unstructured":"Zhou Z-H, Sun Y-Y, Li Y-F. Multi-instance learning by treating instances as non-iid samples. In: Proceedings of the 26th Annual International Conference on Machine Learning, ICML \u201909. New York: ACM: 2009. p. 1249\u201356."},{"key":"184_CR18","volume-title":"Multiple-instance learning for music information retrieval","author":"MI Mandel","year":"2008","unstructured":"Mandel MI, Ellis DPW. Multiple-instance learning for music information retrieval. Philadelphia: Ismir 2008, International Conference on Music Information Retrieval; 2008, pp. 577\u201382."},{"key":"184_CR19","unstructured":"Yu H. Libshorttext: A library for short-text classification and analysis.2013."},{"key":"184_CR20","unstructured":"Lamb A, Paul MJ, Dredze M. Separating fact from fear: Tracking flu infections on twitter. In: HLT-NAACL.2013. p. 789\u201395."},{"issue":"2","key":"184_CR21","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1023\/A:1009715923555","volume":"2","author":"CJ Burges","year":"1998","unstructured":"Burges CJ. A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov. 1998; 2(2):121\u201367.","journal-title":"Data Min Knowl Discov"},{"key":"184_CR22","unstructured":"Platt JC. Sequential minimal optimization: A fast algorithm for training support vector machines. In: Advances in Kernel Methods-support Vector Learning.1999. p. 212\u201323."},{"issue":"9","key":"184_CR23","first-page":"1871","volume":"9","author":"RE Fan","year":"2012","unstructured":"Fan RE, Chang KW, Hsieh CJ, Wang XR, Lin CJ. Liblinear: A library for large linear classification. J Mach Learn Res. 2012; 9(9):1871\u20134.","journal-title":"J Mach Learn Res"},{"issue":"4","key":"184_CR24","first-page":"99","volume":"52","author":"W Pitts","year":"1943","unstructured":"Pitts W. A logical calculus of the ideas immanent in nervous activity. Bull Math Biol. 1943; 52(4):99.","journal-title":"Bull Math Biol"},{"key":"184_CR25","doi-asserted-by":"crossref","unstructured":"Wei X, Wu J, Zhou Z. Scalable multi-instance learning. In: 2014 IEEE International Conference on Data Mining (ICDM), vol. 00.2014. p. 1037\u201342. https:\/\/doi.org\/101109\/ICDM201416.","DOI":"10.1109\/ICDM.2014.16"}],"container-title":["Journal of Biomedical Semantics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-018-0184-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13326-018-0184-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-018-0184-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T00:25:57Z","timestamp":1790036757000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s13326-018-0184-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,20]]},"references-count":25,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,12]]}},"alternative-id":["184"],"URL":"https:\/\/doi.org\/10.1186\/s13326-018-0184-y","relation":{},"ISSN":["2041-1480"],"issn-type":[{"value":"2041-1480","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,6,20]]},"assertion":[{"value":"2 February 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 May 2018","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 June 2018","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","label":"Ethics approval and consent to participate","group":{"name":"EthicsHeading","label":"Ethics"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Ethics"}},{"value":"Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.","order":3,"name":"Ethics","label":"Publisher\u2019s Note","group":{"name":"EthicsHeading","label":"Ethics"}}],"article-number":"19"}}