{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,5]],"date-time":"2026-07-05T06:52:24Z","timestamp":1783234344763,"version":"3.54.6"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,10,12]],"date-time":"2019-10-12T00:00:00Z","timestamp":1570838400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,10,12]],"date-time":"2019-10-12T00:00:00Z","timestamp":1570838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Health Inf Sci Syst"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The paper aims to leverage the highly unstructured user-generated content in the context of pollen allergy surveillance using neural networks with character embeddings and the attention mechanism. Currently, there is no accurate representation of hay fever prevalence, particularly in real-time scenarios. Social media serves as an alternative to extract knowledge about the condition, which is valuable for allergy sufferers, general practitioners, and policy makers. Despite tremendous potential offered, conventional natural language processing methods prove limited when exposed to the challenging nature of user-generated content. As a result, the detection of<jats:italic>actual<\/jats:italic>hay fever instances among the number of false positives, as well as the correct identification of non-technical expressions as pollen allergy symptoms poses a major problem. We propose a deep architecture enhanced with character embeddings and neural attention to improve the performance of hay fever-related content classification from Twitter data. Improvement in prediction is achieved due to the character-level semantics introduced, which effectively addresses the out-of-vocabulary problem in our dataset where the rate is approximately 9%. Overall, the study is a step forward towards improved real-time pollen allergy surveillance from social media with state-of-art technology.<\/jats:p>","DOI":"10.1007\/s13755-019-0084-2","type":"journal-article","created":{"date-parts":[[2019,10,12]],"date-time":"2019-10-12T15:05:08Z","timestamp":1570892708000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":56,"title":["Neural attention with character embeddings for hay fever detection from twitter"],"prefix":"10.1007","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9676-1186","authenticated-orcid":false,"given":"Jiahua","family":"Du","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sandra","family":"Michalska","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sudha","family":"Subramani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hua","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanchun","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,10,12]]},"reference":[{"key":"84_CR1","unstructured":"Australian Institute of Health and Welfare (AIHW). Allergic rhinitis (\u2018hay fever\u2019). https:\/\/www.aihw.gov.au\/reports\/chronic-respiratory-conditions\/allergic-rhinitis-hay-fever\/contents\/allergic-rhinitis-by-the-numbers (2016). Accessed 30 Jan 2019."},{"key":"84_CR2","doi-asserted-by":"crossref","unstructured":"Byrd K, Mansurov A, Baysal O. Mining twitter data for influenza detection and surveillance. In: Proceedings of the international workshop on software engineering in healthcare systems. New York: ACM; 2016. p. 43\u20139.","DOI":"10.1145\/2897683.2897693"},{"issue":"2","key":"84_CR3","first-page":"249","volume":"22","author":"J Carletta","year":"1996","unstructured":"Carletta J. Assessing agreement on classification tasks: the kappa statistic. Comput linguist. 1996;22(2):249\u201354.","journal-title":"Comput linguist"},{"issue":"Aug","key":"84_CR4","first-page":"2493","volume":"12","author":"R Collobert","year":"2011","unstructured":"Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P. Natural language processing (almost) from scratch. J Mach Learn Res. 2011;12(Aug):2493\u2013537.","journal-title":"J Mach Learn Res"},{"key":"84_CR5","doi-asserted-by":"crossref","unstructured":"Coppersmith G, Dredze M, Harman C. Quantifying mental health signals in twitter. In: Proceedings of the workshop on computational linguistics and clinical psychology: From linguistic signal to clinical reality, 2014, p. 51\u201360.","DOI":"10.3115\/v1\/W14-3207"},{"issue":"12","key":"84_CR6","doi-asserted-by":"publisher","first-page":"4434","DOI":"10.3390\/s18124434","volume":"18","author":"S Cowie","year":"2018","unstructured":"Cowie S, Arthur R, Williams H. @ choo: tracking pollen and hayfever in the UK using social media. Sensors. 2018;18(12):4434.","journal-title":"Sensors"},{"key":"84_CR7","unstructured":"Cowling D. Social media statistics Australia\u2014January 2018. 2018. https:\/\/www.socialmedianews.com.au\/social-media-statistics-australia-january-2018 . Accessed 29 June 2019."},{"key":"84_CR8","doi-asserted-by":"crossref","unstructured":"Culotta A. Estimating county health statistics with twitter. In: Proceedings of the 32nd annual ACM conference on Human factors in computing systems. New York: ACM; 2014. p. 1335\u201344.","DOI":"10.1145\/2556288.2557139"},{"issue":"1","key":"84_CR9","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1038\/s41533-018-0071-0","volume":"28","author":"B Cvetkovski","year":"2018","unstructured":"Cvetkovski B, Kritikos V, Yan K, Bosnic-Anticevich S. Tell me about your hay fever: a qualitative investigation of allergic rhinitis management from the perspective of the patient. NPJ Prim Care Respir Med. 2018;28(1):3.","journal-title":"NPJ Prim Care Respir Med"},{"issue":"2","key":"84_CR10","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1037\/0003-066X.55.2.205","volume":"55","author":"KP Davison","year":"2000","unstructured":"Davison KP, Pennebaker JW, Dickerson SS. Who talks? The social psychology of illness support groups. Am Psychol. 2000;55(2):205.","journal-title":"Am Psychol"},{"issue":"4","key":"84_CR11","first-page":"293","volume":"2","author":"E de Quincey","year":"2014","unstructured":"de Quincey E. Potential of social media to determine hay fever seasons and drug efficacy. Planet Risk. 2014;2(4):293\u20137.","journal-title":"Planet Risk"},{"key":"84_CR12","doi-asserted-by":"crossref","unstructured":"de Quincey E, Kyriacou T, Pantin T. # hayfever; a longitudinal study into hay fever related tweets in the UK. In: Proceedings of the 6th international conference on digital health conference. New York: ACM; 2016, p. 85\u20139.","DOI":"10.1145\/2896338.2896342"},{"issue":"3","key":"84_CR13","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1093\/jamia\/ocx131","volume":"25","author":"S Gao","year":"2017","unstructured":"Gao S, Young MT, Qiu JX, Yoon HJ, Christian JB, Fearn PA, Tourassi GD, Ramanthan A. Hierarchical attention networks for information extraction from cancer pathology reports. J Am Med Inf Assoc. 2017;25(3):321\u201330.","journal-title":"J Am Med Inf Assoc"},{"issue":"7","key":"84_CR14","doi-asserted-by":"publisher","first-page":"e0133706","DOI":"10.1371\/journal.pone.0133706","volume":"10","author":"F Gesualdo","year":"2015","unstructured":"Gesualdo F, Stilo G, D\u2019Ambrosio A, Carloni E, Pandolfi E, Velardi P, Fiocchi A, Tozzi AE. Can twitter be a source of information on allergy? Correlation of pollen counts with tweets reporting symptoms of allergic rhinoconjunctivitis and names of antihistamine drugs. PloS ONE. 2015;10(7):e0133706.","journal-title":"PloS ONE"},{"key":"84_CR15","unstructured":"Graves A. Generating sequences with recurrent neural networks. 2013. arXiv:1308.0850 ."},{"key":"84_CR16","first-page":"976","volume-title":"Lecture Notes in Computer Science","author":"Hong Hu","year":"2006","unstructured":"Hu H, Li J, Wang H, Daggard G. Combined gene selection methods for microarray data analysis. In: International conference on knowledge-based and intelligent information and engineering systems. Berlin: Springer; 2006. p. 976\u201383."},{"issue":"2","key":"84_CR17","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1007\/s11280-016-0390-4","volume":"20","author":"J Huang","year":"2017","unstructured":"Huang J, Peng M, Wang H, Cao J, Gao W, Zhang X. A probabilistic method for emerging topic tracking in microblog stream. World Wide Web. 2017;20(2):325\u201350.","journal-title":"World Wide Web"},{"key":"84_CR18","doi-asserted-by":"crossref","unstructured":"Java A, Song X, Finin T, Tseng B. Why we twitter: understanding microblogging usage and communities. In: Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 workshop on Web mining and social network analysis. New York: ACM; 2007. p. 56\u201365.","DOI":"10.1145\/1348549.1348556"},{"key":"84_CR19","doi-asserted-by":"crossref","unstructured":"Johnson R, Zhang T. Effective use of word order for text categorization with convolutional neural networks. In: Human language technologies: the 2015 annual conference of the North American chapter of the ACL, Denver, CO, 2014, p. 103\u201312","DOI":"10.3115\/v1\/N15-1011"},{"key":"84_CR20","doi-asserted-by":"crossref","unstructured":"Kalchbrenner N, Grefenstette E, Blunsom P. A convolutional neural network for modelling sentences. In: Proceedings of the 52nd annual meeting of the association for computational linguistics, 2014, p. 655-65.","DOI":"10.3115\/v1\/P14-1062"},{"issue":"1\/2","key":"84_CR21","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1504\/IJKWI.2009.027925","volume":"1","author":"F Khalil","year":"2009","unstructured":"Khalil F, Li J, Wang H. An integrated model for next page access prediction. IJ Knowl Web Intell. 2009;1(1\/2):48\u201380.","journal-title":"IJ Knowl Web Intell"},{"key":"84_CR22","unstructured":"Khalil F, Wang H, Li J. Integrating markov model with clustering for predicting web page accesses. In: Proceeding of the 13th Australasian world wide web conference (AusWeb07). AusWeb; 2007, p. 63\u201374."},{"key":"84_CR23","doi-asserted-by":"crossref","unstructured":"Kim Y. Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Doha, Qatar: Association for Computational Linguistics; 2014. p. 1746\u201351.","DOI":"10.3115\/v1\/D14-1181"},{"key":"84_CR24","doi-asserted-by":"crossref","unstructured":"Lee K, Agrawal A, Choudhary A. Mining social media streams to improve public health allergy surveillance. In: 2015 IEEE\/ACM international conference on advances in social networks analysis and mining (ASONAM). IEEE; 2015. p. 815\u201322.","DOI":"10.1145\/2808797.2808896"},{"issue":"6","key":"84_CR25","doi-asserted-by":"publisher","first-page":"1507","DOI":"10.1007\/s11280-017-0449-x","volume":"20","author":"H Li","year":"2017","unstructured":"Li H, Wang Y, Wang H, Zhou B. Multi-window based ensemble learning for classification of imbalanced streaming data. World Wide Web. 2017;20(6):1507\u201325.","journal-title":"World Wide Web"},{"issue":"1","key":"84_CR26","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1145\/2806890","volume":"16","author":"J Ma","year":"2016","unstructured":"Ma J, Sun L, Wang H, Zhang Y, Aickelin U. Supervised anomaly detection in uncertain pseudoperiodic data streams. ACM Trans Internet Technol (TOIT). 2016;16(1):4.","journal-title":"ACM Trans Internet Technol (TOIT)"},{"issue":"1","key":"84_CR27","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1007\/s11280-017-0456-y","volume":"21","author":"M Peng","year":"2018","unstructured":"Peng M, Zeng G, Sun Z, Huang J, Wang H, Tian G. Personalized app recommendation based on app permissions. World Wide Web. 2018;21(1):89\u2013104.","journal-title":"World Wide Web"},{"key":"84_CR28","unstructured":"Pennington J, Socher R, Manning C. Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 2014, p. 1532\u201343."},{"issue":"1","key":"84_CR29","doi-asserted-by":"publisher","first-page":"127","DOI":"10.25046\/aj020115","volume":"2","author":"SA Salloum","year":"2017","unstructured":"Salloum SA, Al-Emran M, Monem AA, Shaalan K. A survey of text mining in social media: facebook and twitter perspectives. Adv Sci Technol Eng Syst J. 2017;2(1):127\u201333.","journal-title":"Adv Sci Technol Eng Syst J"},{"key":"84_CR30","unstructured":"Santos CD, Zadrozny B. Learning character-level representations for part-of-speech tagging. In: Proceedings of the 31st international conference on machine learning (ICML-14), 2014, p. 1818\u201326."},{"key":"84_CR31","doi-asserted-by":"crossref","unstructured":"Serban IV, Sordoni A, Bengio Y, Courville AC, Pineau J. Building end-to-end dialogue systems using generative hierarchical neural network models. 2016. arXiv:1507.04808","DOI":"10.1609\/aaai.v30i1.9883"},{"key":"84_CR32","doi-asserted-by":"publisher","first-page":"46210","DOI":"10.1109\/ACCESS.2019.2908827","volume":"7","author":"S Subramani","year":"2019","unstructured":"Subramani S, Michalska S, Wang H, Du J, Zhang Y, Shakeel H. Deep learning for multi-class identification from domestic violence online posts. IEEE Access. 2019;7:46210\u201324.","journal-title":"IEEE Access"},{"issue":"5","key":"84_CR33","first-page":"360","volume":"37","author":"AJ Viera","year":"2005","unstructured":"Viera AJ, Garrett JM, et al. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360\u20133.","journal-title":"Fam Med"},{"issue":"5","key":"84_CR34","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1007\/s40266-018-0537-3","volume":"35","author":"KN Wang","year":"2018","unstructured":"Wang KN, Bell JS, Chen EYH, Gilmartin-Thomas JFM, Ilom\u00e4ki J. Medications and prescribing patterns as factors associated with hospitalizations from long-term care facilities: a systematic review. Drugs Aging. 2018;35(5):423\u201357. https:\/\/doi.org\/10.1007\/s40266-018-0537-3 .","journal-title":"Drugs Aging"},{"key":"84_CR35","unstructured":"World Allergy Organization (WAO). World allergy week 2016. 2016. https:\/\/www.worldallergy.org\/UserFiles\/file\/WorldAllergyWeek2016FactSheet.pdf . Accessed 30 Jan 2019."},{"issue":"4","key":"84_CR36","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1007\/s11280-013-0218-4","volume":"17","author":"J Zhang","year":"2014","unstructured":"Zhang J, Tao X, Wang H. Outlier detection from large distributed databases. World Wide Web. 2014;17(4):539\u201368.","journal-title":"World Wide Web"},{"key":"84_CR37","unstructured":"Zhang X, LeCun Y. Text understanding from scratch. 2015. arXiv:1502.01710 ."}],"container-title":["Health Information Science and Systems"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s13755-019-0084-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s13755-019-0084-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s13755-019-0084-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,1]],"date-time":"2022-10-01T15:32:46Z","timestamp":1664638366000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s13755-019-0084-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,12]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["84"],"URL":"https:\/\/doi.org\/10.1007\/s13755-019-0084-2","relation":{},"ISSN":["2047-2501"],"issn-type":[{"value":"2047-2501","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,12]]},"assertion":[{"value":"21 August 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 September 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 October 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"21"}}