{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T10:18:49Z","timestamp":1771669129206,"version":"3.50.1"},"reference-count":48,"publisher":"Emerald","issue":"3","license":[{"start":{"date-parts":[[2018,10,30]],"date-time":"2018-10-30T00:00:00Z","timestamp":1540857600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JSIT"],"published-print":{"date-parts":[[2018,11,14]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>Sarcasm is often used in everyday speech and writing and is prevalent in online contexts. The purpose of this paper is to investigate the analogy between sarcasm comments from sentiment tools and the human coder.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>Using the Verbal Irony Procedure, eight human coders were engaged to analyse comments collected from an online commercial page, and a dissimilarity analysis was conducted with sentiment tools. Three constants were tested, namely, polarity from sentiment tools, polarity rating by human coders; and sarcasm-level ratings by human coders.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>Results found an inconsistent ratio between these three constants. Sentiment tools used did not have the capability or reliability to detect the subtle, contextualized meanings of sarcasm statements that human coders could detect. Further research is required to refine the sentiment tools to enhance their sensitivity and capability.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Practical implications<\/jats:title>\n<jats:p>With these findings, it is recommended that further research and commercialization efforts be directed at improving current sentiment tools \u2013 for example, to incorporate sophisticated human sarcasm texts in their analytical systems. Sarcasm exists frequently in media, politics and human forms of communications in society. Therefore, more highly sophisticated sentiment tools with the abilities to detect human sarcasm would be vital in research and industry.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Social implications<\/jats:title>\n<jats:p>The findings suggest that presently, of the sentiment tools investigated, most are still unable to pick up subtle contexts within the text which can reverse or change the message that the writer intends to send to his\/her receiver. Hence, the use of the relevant hashtags (e.g. #sarcasm; #irony) are of fundamental importance in detection tools. This would aid the evaluation of product reviews online for commercial usage.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>The value of this study lies in its original, empirical findings on the inconsistencies between sentiment tools and human coders in sarcasm detection. The current study proves these inconsistencies are detected between human and sentiment tools in social media texts and points to the inadequacies of current sentiment tools. With these findings, it is recommended that further research and commercialization efforts be directed at improving current sentiment tools \u2013 to incorporate sophisticated human sarcasm texts in their analytical systems. The system can then be used as a reference for psychologists, media analysts, researchers and speech writers to detect cues in the inconsistencies in behaviour and language.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/jsit-12-2017-0120","type":"journal-article","created":{"date-parts":[[2018,10,30]],"date-time":"2018-10-30T07:32:44Z","timestamp":1540884764000},"page":"358-374","source":"Crossref","is-referenced-by-count":9,"title":["A comparative study of the effectiveness of sentiment tools and human coding in sarcasm detection"],"prefix":"10.1108","volume":"20","author":[{"given":"Phoey Lee","family":"Teh","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pei Boon","family":"Ooi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nee Nee","family":"Chan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yee Kang","family":"Chuah","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","published-online":{"date-parts":[[2018,10,30]]},"reference":[{"key":"key2021041507545485100_ref001","unstructured":"Agrawal, S. and Awekar, A. (2018), \u201cDeep learning for detecting cyberbullying across multiple social media platforms\u201d, available at: https:\/\/arxiv.org\/pdf\/1801.06482.pdf (accessed 23 February 2018)."},{"key":"key2021041507545485100_ref002","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/j.knosys.2016.05.001","article-title":"Text normalization and semantic indexing to enhance instant messaging and SMS spam filtering","volume":"108","year":"2016","journal-title":"Knowledge-Based Systems Elsevier B.V."},{"issue":"82\/97","key":"key2021041507545485100_ref003","first-page":"82","article-title":"Slur, insults, (backhanded) compliments and other strategic facework moves","volume":"52","year":"2015","journal-title":"Language Sciences"},{"issue":"2","key":"key2021041507545485100_ref004","first-page":"243","article-title":"Multimodal markers of irony and sarcasm","volume":"16","year":"2003","journal-title":"Humor - International Journal of Humor Research"},{"key":"key2021041507545485100_ref005","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1016\/j.knosys.2016.06.021","article-title":"A new hybrid semi-supervised algorithm for text classification with class-based semantics","volume":"108","year":"2016","journal-title":"Knowledge-Based Systems"},{"key":"key2021041507545485100_ref006","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/j.knosys.2016.05.002","article-title":"Using neural word embeddings to model user behavior and detect user segments","volume":"108","year":"2016","journal-title":"Knowledge-Based Systems Elsevier B.V."},{"key":"key2021041507545485100_ref007","volume-title":"Verbal Irony: Use and Effects in Written Discourse","year":"2010"},{"issue":"3","key":"key2021041507545485100_ref008","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1080\/10926488.2011.583194","article-title":"Finding irony: an introduction of the verbal irony procedure (VIP)","volume":"26","year":"2011","journal-title":"Metaphor and Symbol"},{"issue":"3","key":"key2021041507545485100_ref009","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1177\/0261927X12446596","article-title":"Verbal irony: differences in usage across written genres","volume":"31","year":"2012","journal-title":"Journal of Language and Social Psychology"},{"key":"key2021041507545485100_ref010","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.knosys.2016.07.025","article-title":"New avenues in knowledge bases for natural language processing","volume":"108","year":"2016","journal-title":"Knowledge-Based Systems"},{"issue":"4","key":"key2021041507545485100_ref030a","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1016\/j.ipm.2017.02.004","article-title":"Twitter sentiment analysis using hybrid cuckoo search method","volume":"53","year":"2017","journal-title":"Information Processing and Management"},{"key":"key2021041507545485100_ref030x","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.engappai.2016.01.007","article-title":"A comparison between semi-supervised and supervised text mining techniques on detecting irony in greek political tweets","volume":"51","year":"2016","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"key2021041507545485100_ref011","volume-title":"Designing and Conducting Mixed Methods Research","year":"2011"},{"issue":"1","key":"key2021041507545485100_ref012","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1207\/s15327868ms1001_2","article-title":"Muting the meaning: a social function of irony","volume":"10","year":"1995","journal-title":"Metaphor and Symbolic Activity"},{"issue":"4","key":"key2021041507545485100_ref013","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1515\/humor-2014-0096","article-title":"Isn\u2019t it ironic? Defining the scope of humorous irony","volume":"27","year":"2014","journal-title":"Humor"},{"key":"key2021041507545485100_ref014","first-page":"392","article-title":"Irony and sarcasm: corpus generation and analysis using crowdsourcing","volume-title":"Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC\u201912)","year":"2012"},{"key":"key2021041507545485100_ref015","first-page":"168","article-title":"Mining and summarizing customer reviews","volume-title":"Proceedings of the tenth ACM SIGKDD international Conference on Knowledge discovery and data mining (KDD 2004)","year":"2004"},{"key":"key2021041507545485100_ref016","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.obhdp.2015.07.001","article-title":"The highest form of intelligence: Sarcasm increases creativity for both expressers and recipients","volume":"131","year":"2015","journal-title":"Organizational Behavior and Human Decision Processes"},{"issue":"5","key":"key2021041507545485100_ref017","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1016\/0378-2166(95)00067-4","article-title":"The functions of sarcastic irony in speech","volume":"26","year":"1996","journal-title":"Journal of Pragmatics"},{"issue":"5","key":"key2021041507545485100_ref018","first-page":"13","article-title":"Automatic sarcasm detection: a survey","volume":"50","year":"2016","journal-title":"ACM Computing Surveys"},{"key":"key2021041507545485100_ref019","unstructured":"Joshi, A. Bhattacharyya, P. and James, M. (2012), \u201cAutomatic sarcasm detection: a survey\u201d, available at: aarXivpreprintarXiv:1602.03426 (accessed 16 April 2016)."},{"issue":"1","key":"key2021041507545485100_ref030y","first-page":"124","article-title":"Extracting relevant knowledge for the detection of sarcasm and nastiness in the social web","volume":"69","year":"2014","journal-title":"Knowledge-Based Systems"},{"issue":"4","key":"key2021041507545485100_ref030e","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1016\/j.ipm.2014.07.006","article-title":"Signaling sarcasm: from hyperbole to hashtag","volume":"51","year":"2015","journal-title":"Information Processing and Management"},{"issue":"10","key":"key2021041507545485100_ref020","doi-asserted-by":"publisher","first-page":"1702","DOI":"10.1016\/j.pragma.2007.05.002","article-title":"Irony and sarcasm in advertisements: effects of relevant inappropriateness","volume":"39","year":"2007","journal-title":"Journal of Pragmatics"},{"key":"key2021041507545485100_ref021","first-page":"29","article-title":"The perfect solution for detecting sarcasm in tweets #not","volume-title":"Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, in WASSA 2013","year":"2013"},{"key":"key2021041507545485100_ref022a","first-page":"195","article-title":"Indonesian social media sentiment analysis with sarcasm detection","year":"2013"},{"issue":"6","key":"key2021041507545485100_ref023","first-page":"486","article-title":"Exploring the process of inference generation in sarcasm: a review of normal and clinical studies","volume":"68","year":"1999","journal-title":"Brain and Language"},{"key":"key2021041507545485100_ref022","first-page":"4238","article-title":"Who cares about sarcastic tweets? Investigating the impact of sarcasm on sentiment analysis","year":"2014","journal-title":"Lrec"},{"issue":"1\/2","key":"key2021041507545485100_ref024","first-page":"1","article-title":"Opinion mining and sentiment analysis","volume":"2","year":"2008","journal-title":"Foundations and Trends\u00ae in Information Retrieval"},{"key":"key2021041507545485100_ref025","volume-title":"Qualitative Research and Evaluation Methods","year":"2001","edition":"3rd ed"},{"key":"key2021041507545485100_ref026","volume-title":"Qualitative Evaluation and Research Methods","year":"1990","edition":"2nd ed"},{"key":"key2021041507545485100_ref027","unstructured":"Pazzanese, C. (2015), \u201cGo ahead, be sarcastic | Harvard gazette\u201d, available at: http:\/\/news.harvard.edu\/gazette\/story\/2015\/07\/go-ahead-be-sarcastic\/ (accessed 27 April 2017)."},{"issue":"12","key":"key2021041507545485100_ref028","doi-asserted-by":"crossref","first-page":"1840","DOI":"10.1037\/dev0000063","article-title":"Older adults have difficulty in decoding sarcasm","volume":"51","year":"2015","journal-title":"Developmental Psychology"},{"key":"key2021041507545485100_ref029","article-title":"Lexical Coverage evaluation of large-scale multilingual semantic lexicons for twelve languages\u2019","volume-title":"LREC 2016, 23-28 May 2016, Tenth International Conference on Language Resources and Evaluation","year":"2016"},{"key":"key2021041507545485100_ref030","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1145\/2684822.2685316","article-title":"Sarcasm detection on twitter: a behavioral modeling approach","volume-title":"Proceedings of the Eighth ACM International Conference on Web Search and Data Mining","year":"2015"},{"key":"key2021041507545485100_ref031","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.datak.2012.02.005","article-title":"From humor recognition to irony detection: the figurative language of social media","volume":"74","year":"2012","journal-title":"Data and Knowledge Engineering"},{"issue":"5","key":"key2021041507545485100_ref032","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/s10936-006-9049-0","article-title":"Vocal features of conversational sarcasm: a comparison of methods","volume":"36","year":"2007","journal-title":"Journal of Psycholinguistic Research"},{"key":"key2021041507545485100_ref033","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1007\/978-3-642-35176-1-32","article-title":"Semantic sentiment analysis of twitter","volume-title":"Lecture Notes in Computer Science (including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)","year":"2012"},{"key":"key2021041507545485100_ref034","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2964284.2964321","article-title":"Detecting sarcasm in multimodal social platforms","year":"2016","journal-title":"ACM Multimedia"},{"key":"key2021041507545485100_ref035","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.knosys.2016.05.015","article-title":"Knowledge base population using semantic label propagation","volume":"108","year":"2016","journal-title":"Knowledge-Based Systems Elsevier B.V."},{"key":"key2021041507545485100_ref036","first-page":"108","article-title":"Exploring fine-grained sentiment values in online product reviews","volume-title":"2015 IEEE Conference on Open Systems","year":"2015"},{"key":"key2021041507545485100_ref037","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1007\/978-3-319-41754-7_48","article-title":"Reversing the polarity with emoticons","volume-title":"Natural Language Processing and Information Systems: 21st International Conference on Applications of Natural Language to Information Systems, NLDB 2016, Salford, UK, June 22-24, 2016, Proceedings","year":"2016"},{"key":"key2021041507545485100_ref038","doi-asserted-by":"publisher","DOI":"10.1145\/2837185.2837216","article-title":"Sentiment analysis tools should take account of the number of exclamation marks!","volume-title":"The 17th International Conference on Information Integration and Web-Based Applications and Services","year":"2015"},{"issue":"5","key":"key2021041507545485100_ref031v","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1016\/j.cortex.2011.01.004","article-title":"Distinction between the literal and intended meanings of sentences: a functional magnetic resonance imaging study of metaphor and sarcasm","volume":"48","year":"2012","journal-title":"Cortex"},{"key":"key2021041507545485100_ref039","first-page":"13","article-title":"Automatic detection and prevention of cyberbullying","volume-title":"International Conference on Human and Social Analytics (HUSO 2015)","year":"2015"},{"key":"key2021041507545485100_ref0300","first-page":"1","article-title":"Analysis of users\u2019 comments on political portal for extraction of suggestions and opinion mining","year":"2016"},{"issue":"4","key":"key2021041507545485100_ref040","doi-asserted-by":"crossref","first-page":"2005","DOI":"10.1016\/j.neuroimage.2009.05.077","article-title":"Detecting sarcasm from paralinguistic cues: anatomic and cognitive correlates in neurodegenerative disease","volume":"47","year":"2009","journal-title":"NeuroImage"},{"key":"key2021041507545485100_ref041","unstructured":"Sarcasm (2017), \u201cIn Merriam-Webster.com\u201d, available at: www.merriam-webster.com\/dictionary\/sarcasm (accessed April 2016)."}],"container-title":["Journal of Systems and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JSIT-12-2017-0120\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JSIT-12-2017-0120\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:24:10Z","timestamp":1753395850000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jsit\/article\/20\/3\/358-374\/246160"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,30]]},"references-count":48,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2018,10,30]]},"published-print":{"date-parts":[[2018,11,14]]}},"alternative-id":["10.1108\/JSIT-12-2017-0120"],"URL":"https:\/\/doi.org\/10.1108\/jsit-12-2017-0120","relation":{},"ISSN":["1328-7265"],"issn-type":[{"value":"1328-7265","type":"print"}],"subject":[],"published":{"date-parts":[[2018,10,30]]}}}