{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T07:39:45Z","timestamp":1780472385735,"version":"3.54.1"},"reference-count":47,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2020,6,6]],"date-time":"2020-06-06T00:00:00Z","timestamp":1591401600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"published-print":{"date-parts":[[2020,8,31]]},"abstract":"<jats:p>Irony detection is a not trivial problem and can help to improve natural language processing tasks as sentiment analysis. When dealing with social media data in real scenarios, an important issue to address is data skew, i.e. the imbalance between available ironic and non-ironic samples available. In this work, the main objective is to address irony detection in Twitter considering various degrees of imbalanced distribution between classes. We rely on the emotIDM irony detection model. We evaluated it against both benchmark corpora and skewed Twitter datasets collected to simulate a realistic distribution of ironic tweets. We carry out a set of classification experiments aimed to determine the impact of class imbalance on detecting irony, and we evaluate the performance of irony detection when different scenarios are considered. We experiment with a set of classifiers applying class imbalance techniques to compensate class distribution. Our results indicate that by using such techniques, it is possible to improve the performance of irony detection in imbalanced class scenarios.<\/jats:p>","DOI":"10.3233\/jifs-179880","type":"journal-article","created":{"date-parts":[[2020,6,9]],"date-time":"2020-06-09T12:50:56Z","timestamp":1591707056000},"page":"2147-2163","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":7,"title":["Irony detection in Twitter with imbalanced class distributions"],"prefix":"10.1177","volume":"39","author":[{"given":"Delia Iraz\u00fa","family":"Hern\u00e1ndez Far\u00edas","sequence":"first","affiliation":[{"name":"Divisi\u00f3n de Ciencias e Ingenier\u00edas Campus Le\u00f3n, Universidad de Guanajuato, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ronaldo","family":"Prati","sequence":"additional","affiliation":[{"name":"Universidade Federal do ABC, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Francisco","family":"Herrera","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, University of Granada, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paolo","family":"Rosso","sequence":"additional","affiliation":[{"name":"Universitat Polit\u00e8cnica de Val\u00e8ncia, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2020,6,6]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"crossref","unstructured":"AbercrombieG. and HovyD. Putting Sarcasm Detection into Context: The Effects of Class Imbalance and Manual Labelling on Supervised Machine Classification of Twitter Conversations. In Proceedings of the ACL 2016 Student ResearchWorkshop pp. 107\u2013113 Germany August (2016). ACL.","DOI":"10.18653\/v1\/P16-3016"},{"key":"e_1_3_2_3_2","doi-asserted-by":"crossref","unstructured":"Alba-JuezL. and AttardoS. The Evaluative Palette of Verbal Irony In Geoff Thompson and Laura Alba-Juez editors Evaluation in Context pages 93\u2013116. John Benjamins Publishing Company Amsterdam\/Philadelphia (2014).","DOI":"10.1075\/pbns.242.05alb"},{"issue":"3","key":"e_1_3_2_4_2","first-page":"176","article-title":"Classification with Class Imbalance Problem: A Review","volume":"7","author":"Ali A.","year":"2015","unstructured":"AliA., ShamsuddinS.M. and RalescuA.L., Classification with Class Imbalance Problem: A Review, Intertional Journal Of Advances In Soft Computing And Its Applications7(3) (2015), 176\u2013204.","journal-title":"Intertional Journal Of Advances In Soft Computing And Its Applications"},{"key":"e_1_3_2_5_2","unstructured":"AttardoS. Irony as Relevant Inappropriateness In H. Colston and R. Gibbs editors Irony in language and thought: A cognitive science reader pages 135\u2013172. Lawrence Erlbaum (2007)."},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","unstructured":"BammanD. and SmithN.A. Contextualized Sarcasm Detection on Twitter In Proceedings of the Ninth International Conference on Web and Social Media (2015) pp. 574\u2013577.","DOI":"10.1609\/icwsm.v9i1.14655"},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","unstructured":"BarbieriF. SaggionH. and RonzanoF. Modelling Sarcasm in Twitter A Novel Approach. In Proc. of the 5th Workshop on Computational Approaches to Subjectivity Sentiment and Social Media Analysis pp. 50\u201358 USA June (2014). ACL.","DOI":"10.3115\/v1\/W14-2609"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/1007730.1007735"},{"key":"e_1_3_2_9_2","unstructured":"BradleyM.M. and LangP.J. Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings Technical Report Center for Research in Psychophysiology University of Florida Florida (1999)."},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","unstructured":"CambriaE. OlsherD. and RajagopalD. SenticNet 3: A Common and Common-Sense Knowledge Base for Cognition-Driven Sentiment Analysis In Proceedings of AAAI Conference on Artificial Intelligence pages 1515\u20131521 Canada (2014). AAAI.","DOI":"10.1609\/aaai.v28i1.8928"},{"key":"e_1_3_2_11_2","doi-asserted-by":"crossref","unstructured":"CervoneA. StepanovE.A. CelliF. and RiccardiG. Irony Detection: From the Twittersphere to the News Space In Proceedings of Fourth Italian Conference on Computational Linguistics (CLiC-it 2017) (2017).","DOI":"10.4000\/books.aaccademia.2377"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"e_1_3_2_13_2","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndezA. Garc\u00edaS. GalarM. PratiR.C. KrawczykB. and HerreraF. Learning from imbalanced data sets Springer (2018).","DOI":"10.1007\/978-3-319-98074-4_11"},{"key":"e_1_3_2_14_2","doi-asserted-by":"crossref","unstructured":"FersiniE. PozziF.A. and MessinaE. Detecting Irony and Sarcasmin Microblogs: The Role of Expressive Signals and Ensemble Classifiers In International Conference on Data Science and Advanced Analytics (DSAA 2015) pages 1\u20138 France (2015). IEEE Xplore Digital Library.","DOI":"10.1109\/DSAA.2015.7344888"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","unstructured":"Paul GriceH. Logic and Conversation. In P. Cole and J.L. Morgan editors Syntax and Semantics:Vol. 3 Speech Acts pages 41\u201358. Academic Press (1975).","DOI":"10.1163\/9789004368811_003"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2008.239"},{"key":"e_1_3_2_17_2","unstructured":"Far\u00edasD.I.H. G\u00f3mezM. M.-y. EscalanteH.J. RossoP. and PattiV. A Knowledge-based Weighted KNN for Detecting Irony in Twitter In 17th Mexican International Conference on Artificial Intelligence (MICAI 2018) Mexico (2018)."},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/2930663"},{"key":"e_1_3_2_19_2","unstructured":"Far\u00edasD.I.H. and RossoP. Irony Sarcasm and Sentiment Analysis. Chapter 7. In Federico A. Pozzi Elisabetta Fersini Enza Messina and Bing Liu editors Sentiment Analysis in Social Networks pages 113\u2013127.Morgan Kaufmann (2016)."},{"key":"e_1_3_2_20_2","doi-asserted-by":"crossref","unstructured":"HuM. and LiuB. Mining and Summarizing Customer Reviews. In Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining KDD \u201904 (2004) pages 168\u2013177 USA ACM.","DOI":"10.1145\/1014052.1014073"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.3233\/IDA-2002-6504"},{"key":"e_1_3_2_22_2","unstructured":"JoshiA. BhattacharyyaP. and CarmanM.J. Automatic Sarcasm Detection: A Survey. CoRR abs\/1602.03426 (2016)."},{"key":"e_1_3_2_23_2","doi-asserted-by":"crossref","unstructured":"JoshiA. TripathiV. PatelK. BhattacharyyaP. and CarmanM.J. Are Word Embeddingbased Features Useful for Sarcasm Detection? In Proc. of the 2016 Conference on Empirical Methods in Natural Language Processing Austin Texas USA (2016) pages 1006\u20131011.","DOI":"10.18653\/v1\/D16-1104"},{"key":"e_1_3_2_24_2","doi-asserted-by":"crossref","unstructured":"KarouiJ. BenamaraF. MoriceauV. Aussenac-GillesN. and Hadrich-BelguithL. Towards a Contextual Pragmatic Model to Detect Irony in Tweets. In Proc. of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) pages 644\u2013650 China (2015). ACL.","DOI":"10.3115\/v1\/P15-2106"},{"key":"e_1_3_2_25_2","doi-asserted-by":"crossref","unstructured":"KhattriA. JoshiA. BhattacharyyaP. and CarmanM. Your Sentiment Precedes You: Using an author\u2019s Historical Tweets to Predict Sarcasm. In Proceedings of the 6th Workshop on Computational Approaches to Subjectivity Sentiment and Social Media Analysis pages 25\u201330 Portugal September (2015). ACL.","DOI":"10.18653\/v1\/W15-2905"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.124.1.3"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2014.07.006"},{"key":"e_1_3_2_28_2","unstructured":"LiebrechtC. KunnemanF. and Van den BoschA. The Perfect Solution for Detecting Sarcasm in Tweets #not. In Proceedings of the 4th Workshop on Computational Approaches to Subjectivity Sentiment and Social Media Analysis pages 29\u201337 USA June (2013). ACL."},{"key":"e_1_3_2_29_2","doi-asserted-by":"crossref","unstructured":"LiuP. ChenW. OuG. WangT. YangD. and LeiK. Sarcasm Detection in Social Media Based on Imbalanced Classification. In Feifei Li Guoliang Li Seungwon Hwang Bin Yao and Zhenjie Zhang editors Proceedings of the Web-Age Information Management: 15th International Conference pages 459\u2013471 China (2014). Springer International Publishing.","DOI":"10.1007\/978-3-319-08010-9_49"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2013.07.007"},{"key":"e_1_3_2_31_2","unstructured":"McDonaldS. Neuropsychological Studies of Sarcasm. In H. Colston and R. Gibbs editors Irony in language and Thought: A Cognitive Science Reader pages 217\u2013230. Lawrence Erlbaum (2007)."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8640.2012.00460.x"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2014.09.003"},{"key":"e_1_3_2_34_2","unstructured":"NielsenF.\u00c5. A New ANEW: Evaluation of a Word List for Sentiment Analysis in Microblogs In Proceedings of the ESWC2011 Workshop on \u2019Making Sense of Microposts\u2019: Big things come in small packages volume 718 of CEUR Workshop Proceedings pages 93\u201398 Greece (2011). CEUR-WS.org."},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","unstructured":"NozzaD. FersiniE. and MessinaE. Unsupervised Irony Detection: A Probabilistic Model with Word Embeddings In Proceedings of the 8th International Joint Conference on KnowledgeDiscovery Knowledge Engineering and Knowledge Management pages (2016) 68\u201376.","DOI":"10.5220\/0006052000680076"},{"key":"e_1_3_2_36_2","first-page":"2","article-title":"Linguistic Inquiry and Word Count: LIWC","volume":"71","author":"Pennebaker J.W.","year":"2001","unstructured":"PennebakerJ.W., FrancisM.E. and BoothR.J., Linguistic Inquiry and Word Count: LIWC, Mahway: Lawrence Erlbaum Associates71 (2001), 2\u201323.","journal-title":"Mahway: Lawrence Erlbaum Associates"},{"key":"e_1_3_2_37_2","unstructured":"PoriaS. CambriaE. HazarikaD. and VijP. A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networks In Proceedings of COLING 2016 the 26th International Conference on Computational Linguistics page 1601\u00e2\u0102\u015e1612 Japan December (2016)."},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2013.4"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-014-0794-3"},{"key":"e_1_3_2_40_2","unstructured":"Pt\u00e1\u010dekT. HaalI. and HongJ. Sarcasm Detection on Czech and English Twitter In Proceedings of COLING 2014 the 25th International Conference on Computational Linguistics pages 213\u2013223 Ireland August (2014). Dublin City University and ACL."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-012-9196-x"},{"key":"e_1_3_2_42_2","doi-asserted-by":"crossref","unstructured":"RiloffE. QadirA. SurveP. De SilvaL. GilbertN. and HuangR. Sarcasm as Contrast between a Positive Sentiment and Negative Situation In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing (EMNLP 2013) pages 704\u2013714. USA October (2013). ACL.","DOI":"10.18653\/v1\/D13-1066"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.05.035"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0378-2166(99)00116-2"},{"key":"e_1_3_2_45_2","doi-asserted-by":"crossref","unstructured":"WallaceB.C. ChoeD.K. and CharniakE. Sparse Contextually Informed Models for Irony Detection: Exploiting User Communities Entities and Sentiment. In Proc. of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) pages 1035\u20131044 China July 2015. ACL.","DOI":"10.3115\/v1\/P15-1100"},{"key":"e_1_3_2_46_2","unstructured":"Wang.A.P. #Irony or #Sarcasm \u2014 A Quantitative and Qualitative Study Based on Twitter. In Proceedings of the PACLIC: the 27th Pacific Asia Conference on Language Information and Computation pages 349\u2013356 Taiwan (2013)."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.2466\/PR0.105.2.509-521"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/0024-3841(92)90025-E"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-179880","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/JIFS-179880","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-179880","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:42:08Z","timestamp":1777455728000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/JIFS-179880"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,6]]},"references-count":47,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,8,31]]}},"alternative-id":["10.3233\/JIFS-179880"],"URL":"https:\/\/doi.org\/10.3233\/jifs-179880","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,6]]}}}