{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T07:10:00Z","timestamp":1776841800149,"version":"3.51.2"},"reference-count":45,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,2,19]],"date-time":"2025-02-19T00:00:00Z","timestamp":1739923200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>The rising prevalence of social media turns them into huge, rich repositories of human emotions. Understanding and categorizing human emotion from social media content is of fundamental importance for many reasons, such as improvement of user experience, monitoring of public sentiment, support for mental health, and enhancement of focused marketing strategies. However, social media text is often unstructured and ambiguous; hence, extracting meaningful emotional information is difficult. Thus, effective emotion classification needs advanced techniques. This article proposes a novel model, EmoBERTa-X, to enhance performance in multilabel emotion classification, particularly in informal and ambiguous social media texts. Attention mechanisms combined with ensemble learning, supported by preprocessing steps, help in avoiding issues such as class imbalance of the dataset, ambiguity in short texts, and the inherent complexities of multilabel classification. The experimental results on the GoEmotions dataset indicate that EmoBERTa-X has outperformed state-of-the-art models on fine-grained emotion-detection tasks in social media expressions with an accuracy increase of 4.32% over some popular approaches.<\/jats:p>","DOI":"10.3390\/bdcc9020048","type":"journal-article","created":{"date-parts":[[2025,2,19]],"date-time":"2025-02-19T05:34:26Z","timestamp":1739943266000},"page":"48","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["EmoBERTa-X: Advanced Emotion Classifier with Multi-Head Attention and DES for Multilabel Emotion Classification"],"prefix":"10.3390","volume":"9","author":[{"given":"Farah Hassan","family":"Labib","sequence":"first","affiliation":[{"name":"Computer Engineering Department, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria 1029, Egypt"}]},{"given":"Mazen","family":"Elagamy","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria 1029, Egypt"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1289-0501","authenticated-orcid":false,"given":"Sherine Nagy","family":"Saleh","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria 1029, Egypt"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-Hern\u00e1ndez, R.A., Luna-Garc\u00eda, H., Celaya-Padilla, J.M., Garc\u00eda-Hern\u00e1ndez, A., Reveles-G\u00f3mez, L.C., Flores-Chaires, L.A., Delgado-Contreras, J.R., Rondon, D., and Villalba-Condori, K.O. (2024). A Systematic Literature Review of Modalities, Trends, and Limitations in Emotion Recognition, Affective Computing, and Sentiment Analysis. Appl. Sci., 14.","DOI":"10.3390\/app14167165"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.bushor.2011.01.007","article-title":"We\u2019re all connected: The power of the social media ecosystem","volume":"54","author":"Hanna","year":"2011","journal-title":"Bus. Horizons"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Tawfik, A., Elkhodary, H.O., and Saleh, S.N. (2022, January 17\u201319). A Deep Learning-based Emotion Recognition System for Interactive E-Learning. Proceedings of the 2022 32nd International Conference on Computer Theory and Applications (ICCTA), Alexandria, Egypt.","DOI":"10.1109\/ICCTA58027.2022.10206184"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1186\/s13388-014-0007-3","article-title":"Emotion classification of social media posts for estimating people\u2019s reactions to communicated alert messages during crises","volume":"3","author":"Brynielsson","year":"2014","journal-title":"Secur. Inform."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"22935","DOI":"10.1007\/s00521-022-06913-2","article-title":"Real-time emotional health detection using fine-tuned transfer networks with multimodal fusion","volume":"35","author":"Sharma","year":"2023","journal-title":"Neural Comput. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kusal, S., Patil, S., Kotecha, K., Aluvalu, R., and Varadarajan, V. (2021). AI Based Emotion Detection for Textual Big Data: Techniques and Contribution. Big Data Cogn. Comput., 5.","DOI":"10.3390\/bdcc5030043"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mansoor, M.A., and Ansari, K.H. (2024). Early Detection of Mental Health Crises through Artifical-Intelligence-Powered Social Media Analysis: A Prospective Observational Study. J. Pers. Med., 14.","DOI":"10.1101\/2024.08.12.24311872"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"868","DOI":"10.1007\/s12559-017-9503-3","article-title":"Sentence-level emotion detection framework using rule-based classification","volume":"9","author":"Asghar","year":"2017","journal-title":"Cogn. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1007\/s10844-019-00591-8","article-title":"Sentiment analysis using rule-based and case-based reasoning","volume":"55","author":"Berka","year":"2020","journal-title":"J. Intell. Inf. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, L., Isomura, S., Ptaszynski, M., Dybala, P., Urabe, Y., Rzepka, R., and Masui, F. (2024). The Limits of Words: Expanding a Word-Based Emotion Analysis System with Multiple Emotion Dictionaries and the Automatic Extraction of Emotive Expressions. Appl. Sci., 14.","DOI":"10.3390\/app14114439"},{"key":"ref_11","unstructured":"\u00d6hman, E. (2021, January 16\u201319). The validity of lexicon-based sentiment analysis in interdisciplinary research. Proceedings of the Workshop on Natural Language Processing for Digital Humanities, Silchar, India."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/s13278-021-00776-6","article-title":"A review on sentiment analysis and emotion detection from text","volume":"11","author":"Nandwani","year":"2021","journal-title":"Soc. Netw. Anal. Min."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"27171","DOI":"10.1007\/s11042-021-11041-5","article-title":"Emotion recognition using support vector machine and one-dimensional convolutional neural network","volume":"80","author":"Sujanaa","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Semary, N.A., Ahmed, W., Amin, K., P\u0142awiak, P., and Hammad, M. (2024). Enhancing machine learning-based sentiment analysis through feature extraction techniques. PLoS ONE, 19.","DOI":"10.1371\/journal.pone.0294968"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1177\/1470785320921779","article-title":"Sarcasm detection using machine learning algorithms in Twitter: A systematic review","volume":"62","author":"Sarsam","year":"2020","journal-title":"Int. J. Mark. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5477","DOI":"10.1109\/ACCESS.2016.2594194","article-title":"A pattern-based approach for sarcasm detection on twitter","volume":"4","author":"Bouazizi","year":"2016","journal-title":"IEEE Access"},{"key":"ref_17","unstructured":"Shiri, F.M., Perumal, T., Mustapha, N., and Mohamed, R. (2023). A comprehensive overview and comparative analysis on deep learning models: CNN, RNN, LSTM, GRU. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4883","DOI":"10.1007\/s11042-022-12310-7","article-title":"CNN and LSTM based ensemble learning for human emotion recognition using EEG recordings","volume":"82","author":"Iyer","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chen, M. (2022). Emotion analysis based on deep learning with application to research on development of Western culture. Front. Psychol., 13.","DOI":"10.3389\/fpsyg.2022.911686"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bodapati, S., Bandarupally, H., Shaw, R.N., and Ghosh, A. (2021). Comparison and analysis of RNN-LSTMs and CNNs for social reviews classification. Advances in Applications of Data-Driven Computing, Springer.","DOI":"10.1007\/978-981-33-6919-1_4"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, N., and Ren, F. (2019). Emotion classification using a CNN_LSTM-based model for smooth emotional synchronization of the humanoid robot REN-XIN. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0215216"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"5789","DOI":"10.1007\/s10462-021-09958-2","article-title":"Transformer models for text-based emotion detection: A review of BERT-based approaches","volume":"54","author":"Acheampong","year":"2021","journal-title":"Artif. Intell. Rev."},{"key":"ref_23","unstructured":"Rezapour, M. (2024). Emotion Detection with Transformers: A Comparative Study. arXiv."},{"key":"ref_24","unstructured":"Ganie, A.G. (2023). Presence of informal language, such as emoticons, hashtags, and slang, impact the performance of sentiment analysis models on social media text?. arXiv."},{"key":"ref_25","first-page":"353","article-title":"Comparative Analysis of Transformer Models for Sentiment Analysis in Low-Resource Languages","volume":"15","author":"Aliyu","year":"2024","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1007\/s10844-021-00692-3","article-title":"RecogNet-LSTM+ CNN: A hybrid network with attention mechanism for aspect categorization and sentiment classification","volume":"58","author":"Ramaswamy","year":"2022","journal-title":"J. Intell. Inf. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ramirez-Alcocer, U.M., Tello-Leal, E., Hernandez-Resendiz, J.D., and Romero, G. (2023, January 4\u20135). A Hybrid CNN-LSTM Approach for Sentiment Analysis. Proceedings of the Congress on Intelligent Systems, Bengaluru, India.","DOI":"10.1007\/978-981-99-9040-5_31"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Saleh, S.N. (2025). Enhancing multilabel classification for unbalanced COVID-19 vaccination hesitancy tweets using ensemble learning. Comput. Biol. Med., 184.","DOI":"10.1016\/j.compbiomed.2024.109437"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Yang, Y., Wang, G., and Kong, H. (2009). Emotion Recognition Based on Dynamic Ensemble Feature Selection. Man-Machine Interactions, Springer.","DOI":"10.1007\/978-3-642-00563-3_22"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"10655","DOI":"10.1007\/s00521-019-04599-7","article-title":"Boosting dynamic ensemble\u2019s performance in twitter","volume":"32","author":"Costa","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1903","DOI":"10.1007\/s12652-021-03407-2","article-title":"Multimodal emotion recognition based on feature selection and extreme learning machine in video clips","volume":"14","author":"Pan","year":"2023","journal-title":"J. Ambient. Intell. Humaniz. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Patwardhan, N., Marrone, S., and Sansone, C. (2023). Transformers in the real world: A survey on nlp applications. Information, 14.","DOI":"10.3390\/info14040242"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Chen, X., Yin, Y., and Feng, T. (2023, January 14\u201316). Multi-Label Text Classification Based on BERT and Label Attention Mechanism. Proceedings of the 2023 Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC), Dalian, China.","DOI":"10.1109\/IPEC57296.2023.00073"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yuan, L., Xu, X., Sun, P., Yu, H.P., Wei, Y.Z., and Zhou, J.J. (2024). Research of multi-label text classification based on label attention and correlation networks. PLoS ONE, 19.","DOI":"10.1371\/journal.pone.0311305"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhou, Z.H. (2012). Ensemble Methods: Foundations and Algorithms, CRC Press.","DOI":"10.1201\/b12207"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10462-009-9124-7","article-title":"Ensemble-based classifiers","volume":"33","author":"Rokach","year":"2010","journal-title":"Artif. Intell. Rev."},{"key":"ref_37","unstructured":"Lowe, S. (2024, November 04). RoBERTa-Base Model on GoEmotions. Available online: https:\/\/huggingface.co\/SamLowe\/roberta-base-go_emotions."},{"key":"ref_38","unstructured":"Vaswani, A. (2017). Attention is all you need. Advances in Neural Information Processing Systems, Curran Associates, Inc.. NeurIPS Foundation."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.ipm.2009.03.002","article-title":"A systematic analysis of performance measures for classification tasks","volume":"45","author":"Sokolova","year":"2009","journal-title":"Inf. Process. Manag."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"McNamara, D.S., Graesser, A.C., McCarthy, P.M., and Cai, Z. (2014). Automated Evaluation of Text and Discourse with Coh-Metrix, Cambridge University Press.","DOI":"10.1017\/CBO9780511894664"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Kuncheva, L.I. (2014). Combining Pattern Classifiers: Methods and Algorithms, John Wiley & Sons.","DOI":"10.1002\/9781118914564"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1037\/0033-295X.99.3.550","article-title":"Are there basic emotions?","volume":"99","author":"Ekman","year":"1992","journal-title":"Psychol. Rev."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"56921","DOI":"10.1109\/ACCESS.2023.3281544","article-title":"Emotion classification in texts over graph neural networks: Semantic representation is better than syntactic","volume":"11","author":"Ameer","year":"2023","journal-title":"IEEE Access"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"118534","DOI":"10.1016\/j.eswa.2022.118534","article-title":"Multi-label emotion classification in texts using transfer learning","volume":"213","author":"Ameer","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Demszky, D., Movshovitz-Attias, D., Ko, J., Cowen, A., Nemade, G., and Ravi, S. (2020). GoEmotions: A dataset of fine-grained emotions. arXiv.","DOI":"10.18653\/v1\/2020.acl-main.372"}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/2\/48\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:37:39Z","timestamp":1760027859000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/2\/48"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,19]]},"references-count":45,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["bdcc9020048"],"URL":"https:\/\/doi.org\/10.3390\/bdcc9020048","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,19]]}}}