{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T16:31:58Z","timestamp":1774629118817,"version":"3.50.1"},"reference-count":55,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,6,25]],"date-time":"2021-06-25T00:00:00Z","timestamp":1624579200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>The massive amount of data generated by social media present a unique opportunity for disaster analysis. As a leading social platform, Twitter generates over 500 million Tweets each day. Due to its real-time characteristic, more agencies employ Twitter to track disaster events to make a speedy rescue plan. However, it is challenging to build an accurate predictive model to identify disaster Tweets, which may lack sufficient context due to the length limit. In addition, disaster Tweets and regular ones can be hard to distinguish because of word ambiguity. In this paper, we propose a sentiment-aware contextual model named SentiBERT-BiLSTM-CNN for disaster detection using Tweets. The proposed learning pipeline consists of SentiBERT that can generate sentimental contextual embeddings from a Tweet, a Bidirectional long short-term memory (BiLSTM) layer with attention, and a 1D convolutional layer for local feature extraction. We conduct extensive experiments to validate certain design choices of the model and compare our model with its peers. Results show that the proposed SentiBERT-BiLSTM-CNN demonstrates superior performance in the F1 score, making it a competitive model in Tweets-based disaster prediction.<\/jats:p>","DOI":"10.3390\/fi13070163","type":"journal-article","created":{"date-parts":[[2021,6,25]],"date-time":"2021-06-25T11:07:40Z","timestamp":1624619260000},"page":"163","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["A Sentiment-Aware Contextual Model for Real-Time Disaster Prediction Using Twitter Data"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2588-7010","authenticated-orcid":false,"given":"Guizhe","family":"Song","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Dalian University of Technology, Dalian 116024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Degen","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Dalian University of Technology, Dalian 116024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Li, C., Weng, J., He, Q., Yao, Y., Datta, A., Sun, A., and Lee, B.S. (2012, January 12\u201316). Twiner: Named entity recognition in targeted twitter stream. Proceedings of the 35th international ACM SIGIR Conference on Research and Development in Information Retrieval, Portland, OR, USA.","DOI":"10.1145\/2348283.2348380"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ritter, A., Wright, E., Casey, W., and Mitchell, T. (2015, January 18\u201322). Weakly supervised extraction of computer security events from twitter. Proceedings of the 24th International Conference on World Wide Web, Florence, Italy.","DOI":"10.1145\/2736277.2741083"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Soulier, L., Tamine, L., and Nguyen, G.H. (2016, January 24\u201328). Answering twitter questions: A model for recommending answerers through social collaboration. Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, Indianapolis, IN, USA.","DOI":"10.1145\/2983323.2983771"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kim, Y. Convolutional Neural Networks for Sentence Classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP).","DOI":"10.3115\/v1\/D14-1181"},{"key":"ref_5","unstructured":"Steinskog, A., Therkelsen, J., and Gamb\u00e4ck, B. (2017, January 22\u201324). Twitter topic modeling by tweet aggregation. Proceedings of the 21st Nordic Conference on Computational Linguistics, Gothenburg, Sweden."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Stowe, K., Paul, M., Palmer, M., Palen, L., and Anderson, K.M. (2016, January 1). Identifying and categorizing disaster-related tweets. Proceedings of the Fourth International Workshop on Natural Language Processing for Social Media, Austin, TX, USA.","DOI":"10.18653\/v1\/W16-6201"},{"key":"ref_7","unstructured":"Bakshi, R.K., Kaur, N., Kaur, R., and Kaur, G. (2016, January 16\u201318). Opinion mining and sentiment analysis. Proceedings of the 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India."},{"key":"ref_8","first-page":"2009","article-title":"Twitter sentiment classification using distant supervision. CS224N project report","volume":"1","author":"Go","year":"2009","journal-title":"Stanford"},{"key":"ref_9","unstructured":"Kouloumpis, E., Wilson, T., and Moore, J. (2011, January 17\u201321). Twitter sentiment analysis: The good the bad and the omg!. Proceedings of the International AAAI Conference on Web and Social Media, Catalonia, Spain."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1909","DOI":"10.1109\/TKDE.2019.2913379","article-title":"Cross-domain sentiment encoding through stochastic word embedding","volume":"32","author":"Hao","year":"2019","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Sankaranarayanan, J., Samet, H., Teitler, B.E., Lieberman, M.D., and Sperling, J. (2009, January 4\u20136). Twitterstand: News in tweets. Proceedings of the 17th ACM Sigspatial International Conference on Advances in Geographic Information Systems, Seattle, WA, USA.","DOI":"10.1145\/1653771.1653781"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sriram, B., Fuhry, D., Demir, E., Ferhatosmanoglu, H., and Demirbas, M. (2010, January 19\u201323). Short text classification in twitter to improve information filtering. Proceedings of the 33rd international ACM SIGIR Conference on Research and Development in Information Retrieval, Geneva, Switzerland.","DOI":"10.1145\/1835449.1835643"},{"key":"ref_13","first-page":"52","article-title":"Using social media to enhance emergency situation awareness","volume":"27","author":"Yin","year":"2012","journal-title":"IEEE Ann. Hist. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kogan, M., Palen, L., and Anderson, K.M. (2015, January 14\u201318). Think local, retweet global: Retweeting by the geographically-vulnerable during Hurricane Sandy. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work and Social Computing, Vancouver, BC, Canada.","DOI":"10.1145\/2675133.2675218"},{"key":"ref_15","unstructured":"Lamb, A., Paul, M., and Dredze, M. (2013, January 9\u201314). Separating fact from fear: Tracking flu infections on twitter. Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Atlanta, GA, USA."},{"key":"ref_16","unstructured":"Verma, S., Vieweg, S., Corvey, W., Palen, L., Martin, J., Palmer, M., Schram, A., and Anderson, K. (2011, January 17\u201321). Natural language processing to the rescue? extracting \u201csituational awareness\u201d tweets during mass emergency. Proceedings of the International AAAI Conference on Web and Social Media, Catalonia, Spain."},{"key":"ref_17","unstructured":"Huang, Z., Xu, W., and Yu, K. (2015). Bidirectional LSTM-CRF models for sequence tagging. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.eswa.2016.10.065","article-title":"Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN","volume":"72","author":"Chen","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kalchbrenner, N., Grefenstette, E., and Blunsom, P. (2014). A convolutional neural network for modelling sentences. arXiv.","DOI":"10.3115\/v1\/P14-1062"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, J., Chang, W.C., Wu, Y., and Yang, Y. (2017, January 7\u201311). Deep learning for extreme multi-label text classification. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japan.","DOI":"10.1145\/3077136.3080834"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Mou, L., Men, R., Li, G., Xu, Y., Zhang, L., Yan, R., and Jin, Z. (2015). Natural language inference by tree-based convolution and heuristic matching. arXiv.","DOI":"10.18653\/v1\/P16-2022"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pang, L., Lan, Y., Guo, J., Xu, J., Wan, S., and Cheng, X. (2016, January 12\u201317). Text matching as image recognition. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10341"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, J., Wang, Z., Zhang, D., and Yan, J. (2017, January 19\u201325). Combining Knowledge with Deep Convolutional Neural Networks for Short Text Classification. Proceedings of the IJCAI, Melbourne, Australia.","DOI":"10.24963\/ijcai.2017\/406"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Karimi, S., Dai, X., Hassanzadeh, H., and Nguyen, A. (2017, January 4). Automatic diagnosis coding of radiology reports: A comparison of deep learning and conventional classification methods. Proceedings of the BioNLP 2017, Vancouver, BC, Canada.","DOI":"10.18653\/v1\/W17-2342"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"i70","DOI":"10.1093\/bioinformatics\/btw294","article-title":"DeepMeSH: Deep semantic representation for improving large-scale MeSH indexing","volume":"32","author":"Peng","year":"2016","journal-title":"Bioinformatics"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rios, A., and Kavuluru, R. (2015, January 9\u201312). Convolutional neural networks for biomedical text classification: Application in indexing biomedical articles. Proceedings of the 6th ACM Conference on Bioinformatics, Computational Biology and Health Informatics, Atlanta, GA, USA.","DOI":"10.1145\/2808719.2808746"},{"key":"ref_27","first-page":"246","article-title":"Medical text classification using convolutional neural networks","volume":"235","author":"Hughes","year":"2017","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kowsari, K., Brown, D.E., Heidarysafa, M., Meim, K.J., Gerber, M.S., and Barnes, L.E. (2017, January 18\u201321). Hdltex: Hierarchical deep learning for text classification. Proceedings of the 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA), Cancun, Mexico.","DOI":"10.1109\/ICMLA.2017.0-134"},{"key":"ref_29","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_30","unstructured":"Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., and Soricut, R. (2019). Albert: A lite bert for self-supervised learning of language representations. arXiv."},{"key":"ref_31","unstructured":"Sanh, V., Debut, L., Chaumond, J., and Wolf, T. (2019). DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1162\/tacl_a_00300","article-title":"Spanbert: Improving pre-training by representing and predicting spans","volume":"8","author":"Joshi","year":"2020","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_33","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sun, Y., Wang, S., Li, Y., Feng, S., Tian, H., Wu, H., and Wang, H. (2020, January 7\u201312). Ernie 2.0: A continual pre-training framework for language understanding. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i05.6428"},{"key":"ref_35","unstructured":"Liu, X., Cheng, H., He, P., Chen, W., Wang, Y., Poon, H., and Gao, J. (2020). Adversarial training for large neural language models. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Graves, A., Jaitly, N., and Mohamed, A.R. (2013, January 8\u201312). Hybrid speech recognition with deep bidirectional LSTM. Proceedings of the 2013 IEEE Workshop on Automatic Speech Recognition and Understanding, Olomouc, Czech Republic.","DOI":"10.1109\/ASRU.2013.6707742"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"11765","DOI":"10.1007\/s11042-020-10183-2","article-title":"FakeBERT: Fake news detection in social media with a BERT-based deep learning approach","volume":"80","author":"Kaliyar","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_38","unstructured":"Harrag, F., Debbah, M., Darwish, K., and Abdelali, A. (2021). Bert transformer model for detecting Arabic GPT2 auto-generated tweets. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mozafari, M., Farahbakhsh, R., and Crespi, N. (2019). A BERT-based transfer learning approach for hate speech detection in online social media. International Conference on Complex Networks and Their Applications, Springer.","DOI":"10.1007\/978-3-030-36687-2_77"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"48501","DOI":"10.1109\/ACCESS.2021.3068323","article-title":"Context-Based Feature Technique for Sarcasm Identification in Benchmark Datasets Using Deep Learning and BERT Model","volume":"9","author":"Eke","year":"2021","journal-title":"IEEE Access"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1007\/s10796-018-9830-2","article-title":"Weakly supervised and online learning of word models for classification to detect disaster reporting tweets","volume":"20","author":"Palshikar","year":"2018","journal-title":"Inf. Syst. Front."},{"key":"ref_42","unstructured":"Algur, S.P., and Venugopal, S. (2021, January 17\u201319). Classification of Disaster Specific Tweets-A Hybrid Approach. Proceedings of the 2021 8th International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1007\/s10479-017-2522-3","article-title":"Event classification and location prediction from tweets during disasters","volume":"283","author":"Singh","year":"2019","journal-title":"Ann. Oper. Res."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Madichetty, S., and Sridevi, M. (2019, January 7\u201311). Detecting informative tweets during disaster using deep neural networks. Proceedings of the 2019 11th International Conference on Communication Systems & Networks (COMSNETS), Bengaluru, India.","DOI":"10.1109\/COMSNETS.2019.8711095"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Joao, R.S. (2021). On Informative Tweet Identification For Tracking Mass Events. arXiv.","DOI":"10.5220\/0010392712661273"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1111\/1468-5973.12194","article-title":"Disaster response aided by tweet classification with a domain adaptation approach","volume":"26","author":"Li","year":"2018","journal-title":"J. Contingencies Crisis Manag."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2851","DOI":"10.1007\/s11280-020-00786-y","article-title":"Leveraging burst in twitter network communities for event detection","volume":"23","author":"Ansah","year":"2020","journal-title":"World Wide Web"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Saeed, Z., Abbasi, R.A., and Razzak, I. (2020). Evesense: What can you sense from twitter?. European Conference on Information Retrieval, Springer.","DOI":"10.1007\/978-3-030-45442-5_64"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Sani, A.M., and Moeini, A. (2020, January 22\u201323). Real-time Event Detection in Twitter: A Case Study. Proceedings of the 2020 6th International Conference on Web Research (ICWR), Tehran, Iran.","DOI":"10.1109\/ICWR49608.2020.9122281"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Yin, D., Meng, T., and Chang, K.W. (2020). Sentibert: A transferable transformer-based architecture for compositional sentiment semantics. arXiv.","DOI":"10.18653\/v1\/2020.acl-main.341"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Song, G., Huang, D., and Xiao, Z. (2021). A Study of Multilingual Toxic Text Detection Approaches under Imbalanced Sample Distribution. Information, 12.","DOI":"10.3390\/info12050205"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1162\/tacl_a_00051","article-title":"Enriching word vectors with subword information","volume":"5","author":"Bojanowski","year":"2017","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_53","unstructured":"Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Alam, F., Qazi, U., Imran, M., and Ofli, F. (2021). HumAID: Human-Annotated Disaster Incidents Data from Twitter with Deep Learning Benchmarks. arXiv.","DOI":"10.1609\/icwsm.v15i1.18116"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Alam, F., Ofli, F., and Imran, M. (2018, January 25\u201328). Crisismmd: Multimodal twitter datasets from natural disasters. Proceedings of the International AAAI Conference on Web and Social Media, Stanford, CA, USA.","DOI":"10.1609\/icwsm.v12i1.14983"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/7\/163\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:23:56Z","timestamp":1760163836000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/7\/163"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,25]]},"references-count":55,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["fi13070163"],"URL":"https:\/\/doi.org\/10.3390\/fi13070163","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,25]]}}}