{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T18:40:38Z","timestamp":1775068838494,"version":"3.50.1"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T00:00:00Z","timestamp":1732492800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T00:00:00Z","timestamp":1732492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100009169","name":"Assiut University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100009169","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Emotion prediction is a subset of sentiment analysis that aims to extract emotions from text, speech, or images. The researchers posit that emotions determine human behavior, making the development of a method to recognize emotions automatically crucial for use during global crises, such as the COVID-19 pandemic. In this paper, a real-time system is developed that identifies and predicts emotions conveyed by users in Arabic tweets regarding COVID-19 into standard six emotions based on the big data platform, Apache Spark. The system consists of two main stages: (1) Developing an offline model and (2) Online emotion prediction pipeline. For the first stage, two different approaches: The deep Learning (DL) approach and the Transfer Learning-based (TL) approach to find the optimal classifier for identifying and predicting emotion. For DL, three classifiers are applied: Convolutional Neural Network (CNN), Gated Recurrent Unit (GRU), and Bidirectional GRU (BiGRU). For TL, five models are applied: AraBERT, ArabicBERT, ARBERT, MARBERT, and QARiB. For the second stage, create a Transmission Control Protocol (TCP) socket between Twitter\u2019s API and Spark used to receive streaming tweets and Apache Spark to predict the label of tweets in real-time. The experimental results show that the QARiB model achieved the highest Jaccard accuracy (65.73%), multi-accuracy (78.71%), precision-micro (78.71%), recall-micro (78.71%), f-micro (78.71%), and f-macro (78.55%). The system is available as a web-based application that aims to provide a real-time visualization of people\u2019s emotions during a crisis.<\/jats:p>","DOI":"10.1186\/s40537-024-01035-z","type":"journal-article","created":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T12:49:49Z","timestamp":1732538989000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A real-time predicting online tool for detection of people\u2019s emotions from Arabic tweets based on big data platforms"],"prefix":"10.1186","volume":"11","author":[{"given":"Naglaa","family":"Abdelhady","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ibrahim E.","family":"Elsemman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Taysir Hassan A.","family":"Soliman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,11,25]]},"reference":[{"key":"1035_CR1","first-page":"7","volume":"712","author":"VK Singh","year":"2013","unstructured":"Singh VK, Piryani R, Uddin A, Waila P. Sentiment analysis of movie reviews: a new feature-based heuristic for aspect-level sentiment classification. Int mutli-Conf Automation Comput Commun Cont Compres Sens. 2013;712:7.","journal-title":"Int mutli-Conf Automation Comput Commun Cont Compres Sens"},{"key":"1035_CR2","doi-asserted-by":"crossref","unstructured":"Al-Khatib A, El-Beltagy SR. 20218 Emotional tone detection in arabic tweets Computational Linguistics and Intelligent Text Processing: 18th International Conference CICLing 2017 Budapest Hungary. Springer: Cham.","DOI":"10.1007\/978-3-319-77116-8_8"},{"key":"1035_CR3","doi-asserted-by":"crossref","unstructured":"George A, HB BG, Soman K, et\u00a0al. Teamcen at semeval-2018 task 1: global vectors representation in emotion detection. Proceedings of the 12th international workshop on semantic evaluation. 334:338. 2018.","DOI":"10.18653\/v1\/S18-1050"},{"issue":"7","key":"1035_CR4","first-page":"661","volume":"42","author":"M Abdullah","year":"2020","unstructured":"Abdullah M, AlMasawa M, Makki I, Alsolmi M, Mahrous S. Emotions extraction from Arabic tweets. Int J Comput Appl. 2020;42(7):661\u201375.","journal-title":"Int J Comput Appl"},{"key":"1035_CR5","doi-asserted-by":"crossref","unstructured":"Abdullah M, Hadzikadicy M, Shaikhz S, SEDAT: sentiment and emotion detection in Arabic text using CNN-LSTM deep learning. international conference on machine learning and applications. 835:40. 2018.","DOI":"10.1109\/ICMLA.2018.00134"},{"key":"1035_CR6","unstructured":"Al-Khatib A, El-Beltagy SR. A simple and effective approach for fine tuning pre-trained word embeddings for improved text classification. arXiv preprint arXiv:1908.02579. 2019;."},{"key":"1035_CR7","first-page":"35","volume":"30","author":"A Vaswani","year":"2017","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention is all you need. Adv Neural Inform Proc Syst. 2017;30:35.","journal-title":"Adv Neural Inform Proc Syst"},{"key":"1035_CR8","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. 2018;."},{"key":"1035_CR9","first-page":"35","volume":"32","author":"Z Yang","year":"2019","unstructured":"Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov RR, Le QV. Xlnet: generalized autoregressive pretraining for language understanding. Adv Neural Inform Proc Syst. 2019;32:35.","journal-title":"Adv Neural Inform Proc Syst"},{"issue":"8","key":"1035_CR10","first-page":"9","volume":"1","author":"A Radford","year":"2019","unstructured":"Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I, et al. Language models are unsupervised multitask learners. OpenAI blog. 2019;1(8):9.","journal-title":"OpenAI blog"},{"key":"1035_CR11","unstructured":"Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, et\u00a0al. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692. 2019;."},{"key":"1035_CR12","unstructured":"Lan Z, Chen M, Goodman S, Gimpel K, Sharma P, Soricut R. Albert: A lite bert for self-supervised learning of language representations. arXiv preprint arXiv:1909.11942. 2019;."},{"issue":"1","key":"1035_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-021-00523-w","volume":"8","author":"EAH Khalil","year":"2021","unstructured":"Khalil EAH, El Houby EM, Mohamed HK. Deep learning for emotion analysis in Arabic tweets. J Big Data. 2021;8(1):1\u201315.","journal-title":"J Big Data"},{"key":"1035_CR14","first-page":"10","volume":"11","author":"H Alhazmi","year":"2020","unstructured":"Alhazmi H, Alharbi M. Emotion analysis of arabic tweets during COVID-19 pandemic in Saudi Arabia. Int J Adv Comput Sci Appl. 2020;11:10.","journal-title":"Int J Adv Comput Sci Appl"},{"key":"1035_CR15","unstructured":"Yang Q, Alamro H, Albaradei S, Salhi A, Lv X, Ma C, et\u00a0al. SenWave: Monitoring the global sentiments under the COVID-19 pandemic. arXiv preprint arXiv:2006.10842. 2020;."},{"key":"1035_CR16","unstructured":"Antoun W, Baly F, Hajj H. Arabert: Transformer-based model for arabic language understanding. arXiv preprint arXiv:2003.00104. 2020;."},{"issue":"22","key":"1035_CR17","doi-asserted-by":"publisher","first-page":"10694","DOI":"10.3390\/app112210694","volume":"11","author":"N Alturayeif","year":"2021","unstructured":"Alturayeif N, Luqman H. Fine-grained sentiment analysis of arabic covid-19 tweets using bert-based transformers and dynamically weighted loss function. Appl Sci. 2021;11(22):10694.","journal-title":"Appl Sci"},{"issue":"2","key":"1035_CR18","doi-asserted-by":"publisher","first-page":"86","DOI":"10.3390\/info12020086","volume":"12","author":"A Al-Laith","year":"2021","unstructured":"Al-Laith A, Alenezi M. Monitoring people\u2019s emotions and symptoms from Arabic tweets during the COVID-19 pandemic. Information. 2021;12(2):86.","journal-title":"Information"},{"issue":"9","key":"1035_CR19","doi-asserted-by":"publisher","first-page":"474","DOI":"10.3390\/info14090474","volume":"14","author":"M Mujahid","year":"2023","unstructured":"Mujahid M, Rustam F, Shafique R, Chunduri V, Villar MG, Ballester JB, et al. Analyzing sentiments regarding ChatGPT using novel BERT: a machine learning approach. Information. 2023;14(9):474.","journal-title":"Information"},{"issue":"4","key":"1035_CR20","doi-asserted-by":"publisher","first-page":"170","DOI":"10.3390\/bdcc7040170","volume":"7","author":"AME Koshiry","year":"2023","unstructured":"Koshiry AME, Eliwa EHI, Abd El-Hafeez T, Omar A. Arabic toxic tweet classification: leveraging the arabert model. Big Data Cogni Comput. 2023;7(4):170.","journal-title":"Big Data Cogni Comput"},{"issue":"1","key":"1035_CR21","first-page":"8014111","volume":"2024","author":"AY Muaad","year":"2024","unstructured":"Muaad AY, Raza S, Heyat MBB, Alabrah A. An intelligent COVID-19-related Arabic text detection framework based on transfer learning using context representation. Int J Intell Syst. 2024;2024(1):8014111.","journal-title":"Int J Intell Syst"},{"issue":"1","key":"1035_CR22","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1186\/s13677-024-00644-6","volume":"13","author":"N Abdelhady","year":"2024","unstructured":"Abdelhady N, Soliman Hassan A, T, F Farghally M. Stacked-CNN-BiLSTM-COVID: an effective stacked ensemble deep learning framework for sentiment analysis of arabic COVID-19 tweets. J Cloud Comput. 2024;13(1):85.","journal-title":"J Cloud Comput"},{"key":"1035_CR23","doi-asserted-by":"crossref","unstructured":"Abhineswari M, Priyadarshini R. Analyzing Large-Scale Twitter Real Time Streaming Data with Manifold Machine Learning Algorithms in Apache SPARK. In: 2023 International Conference on Data Science, Agents & Artificial Intelligence (ICDSAAI). IEEE; 2023. p. 1\u20139.","DOI":"10.1109\/ICDSAAI59313.2023.10452549"},{"key":"1035_CR24","doi-asserted-by":"crossref","unstructured":"Vanam H, et\u00a0al. Sentiment analysis of twitter data using big data analytics and deep learning model. In: 2023 International Conference on Artificial Intelligence and Knowledge Discovery in Concurrent Engineering. 2023. p. 1\u20136.","DOI":"10.1109\/ICECONF57129.2023.10084281"},{"key":"1035_CR25","first-page":"3950","volume":"3947","author":"A Assiri","year":"2016","unstructured":"Assiri A, Emam A, Al-Dossari H. Real-time sentiment analysis of Saudi dialect tweets using SPARK. Int Conf Big Data. 2016;3947:3950.","journal-title":"Int Conf Big Data"},{"key":"1035_CR26","unstructured":"Farha IA, Magdy W. Mazajak: An online Arabic sentiment analyser. Proceedings of the fourth arabic natural language processing workshop. 2019. 192\u2013198."},{"key":"1035_CR27","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.procs.2017.10.092","volume":"117","author":"M El-Masri","year":"2017","unstructured":"El-Masri M, Altrabsheh N, Mansour H, Ramsay A. A web-based tool for Arabic sentiment analysis. Procedia Comput Sci. 2017;117:38\u201345.","journal-title":"Procedia Comput Sci"},{"key":"1035_CR28","doi-asserted-by":"crossref","unstructured":"Almanie T, Aldayel A, Alkanhal G, Alesmail L, Almutlaq M, Althunayan R, Saudi mood: a real-time informative tool for visualizing emotions in Saudi Arabia using twitter. 21st Saudi Computer Society National Computer Conference. 2018. 1\u20136.","DOI":"10.1109\/NCG.2018.8593165"},{"key":"1035_CR29","doi-asserted-by":"crossref","unstructured":"Hassan S, Mubarak H, Abdelali A, Darwish K. Asad: Arabic social media analytics and understanding. Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations. 2021. 113\u2013118.","DOI":"10.18653\/v1\/2021.eacl-demos.14"},{"key":"1035_CR30","unstructured":"Elmadany AA, Mubarak H, Magdy W. An Arabic speech-act and sentiment Corpus of Tweets. The 3rd Workshop on Open-Source Arabic Corpora and Processing Tools. European Language Resources Association. 2018. 1\u20136."},{"key":"1035_CR31","unstructured":"Saxena A.: Spark Streaming vs. Structured Streaming. https:\/\/dzone.com\/articles\/spark-streaming-vs-structured-streaming."},{"issue":"4","key":"1035_CR32","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","volume":"1","author":"Y LeCun","year":"1989","unstructured":"LeCun Y, Boser B, Denker JS, Henderson D, Howard RE, Hubbard W, et al. Backpropagation applied to handwritten zip code recognition. Neural Comput. 1989;1(4):541\u201351.","journal-title":"Neural Comput"},{"key":"1035_CR33","doi-asserted-by":"crossref","unstructured":"Cho K, Van\u00a0Merri\u00ebnboer B, Bahdanau D, Bengio Y. On the properties of neural machine translation: Encoder-decoder approaches. arXiv preprint arXiv:1409.1259. 2014;.","DOI":"10.3115\/v1\/W14-4012"},{"key":"1035_CR34","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.107242","volume":"228","author":"ME Basiri","year":"2021","unstructured":"Basiri ME, Nemati S, Abdar M, Asadi S, Acharrya UR. A novel fusion-based deep learning model for sentiment analysis of COVID-19 tweets. Knowledge-Based Syst. 2021;228: 107242.","journal-title":"Knowledge-Based Syst"},{"key":"1035_CR35","doi-asserted-by":"crossref","unstructured":"Abdul-Mageed M, Zhang C, Elmadany A, Ungar L. Toward micro-dialect identification in diaglossic and code-switched environments. arXiv preprint arXiv:2010.04900. 2020;.","DOI":"10.18653\/v1\/2020.emnlp-main.472"},{"key":"1035_CR36","doi-asserted-by":"crossref","unstructured":"Abdul-Mageed M, Elmadany A, Nagoudi EMB. ARBERT & MARBERT: deep bidirectional transformers for Arabic. arXiv preprint arXiv:2101.01785. 2020;.","DOI":"10.18653\/v1\/2021.acl-long.551"},{"issue":"2","key":"1035_CR37","doi-asserted-by":"publisher","first-page":"84","DOI":"10.3390\/info12020084","volume":"12","author":"N Al-Twairesh","year":"2021","unstructured":"Al-Twairesh N. The evolution of language models applied to emotion analysis of Arabic tweets. Information. 2021;12(2):84.","journal-title":"Information"},{"key":"1035_CR38","unstructured":"Abdelali A, Hassan S, Mubarak H, Darwish K, Samih Y. Pre-training bert on arabic tweets: Practical considerations. arXiv preprint arXiv:2102.10684. 2021;."}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-024-01035-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-024-01035-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-024-01035-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T13:02:53Z","timestamp":1732539773000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-024-01035-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,25]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["1035"],"URL":"https:\/\/doi.org\/10.1186\/s40537-024-01035-z","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,25]]},"assertion":[{"value":"27 October 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 November 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 November 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This research did not contain any studies involving animal or human participants, nor did it take place in any private or protected areas.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no Competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"171"}}