{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T12:13:00Z","timestamp":1762431180462,"version":"3.41.0"},"reference-count":62,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2016,8,23]],"date-time":"2016-08-23T00:00:00Z","timestamp":1471910400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001703","name":"EPFL","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001703","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2017,1,31]]},"abstract":"<jats:p>Emotion recognition in text has become an important research objective. It involves building classifiers capable of detecting human emotions for a specific application, for example, analyzing reactions to product launches, monitoring emotions at sports events, or discerning opinions in political debates. Most successful approaches rely heavily on costly manual annotation. To alleviate this burden, we propose a distant supervision method\u2014Dystemo\u2014for automatically producing emotion classifiers from tweets labeled using existing or easy-to-produce emotion lexicons. The goal is to obtain emotion classifiers that work more accurately for specific applications than available emotion lexicons. The success of this method depends mainly on a novel classifier\u2014Balanced Weighted Voting (BWV)\u2014designed to overcome the imbalance in emotion distribution in the initial dataset, and on novel heuristics for detecting neutral tweets. We demonstrate how Dystemo works using Twitter data about sports events, a fine-grained 20-category emotion model, and three different initial emotion lexicons. Through a series of carefully designed experiments, we confirm that Dystemo is effective both in extending initial emotion lexicons of small coverage to find correctly more emotional tweets and in correcting emotion lexicons of low accuracy to perform more accurately.<\/jats:p>","DOI":"10.1145\/2912147","type":"journal-article","created":{"date-parts":[[2016,8,26]],"date-time":"2016-08-26T12:25:39Z","timestamp":1472214339000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Dystemo"],"prefix":"10.1145","volume":"8","author":[{"given":"Valentina","family":"Sintsova","sequence":"first","affiliation":[{"name":"Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland"}]},{"given":"Pearl","family":"Pu","sequence":"additional","affiliation":[{"name":"Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2016,8,23]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220575.1220648"},{"volume-title":"Text, Speech and Dialogue","author":"Aman Saima","key":"e_1_2_2_2_1"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007730.1007735"},{"volume-title":"Fuzzy Logic, Applications.","author":"Bojadziev George","key":"e_1_2_2_4_1"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2502069.2502071"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34584-5_11"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.22859"},{"key":"e_1_2_2_8_1","volume-title":"AISB 2008 Convention Communication, Interaction and Social Intelligence","volume":"1","author":"Danisman Taner","year":"2008"},{"volume-title":"Proceedings of the 6th International AAAI Conference on Weblogs and Social Media (ICWSM).","year":"2012","author":"Choudhury Munmun De","key":"e_1_2_2_9_1"},{"volume-title":"Proceedings of the 6th International AAAI Conference on Weblogs and Social Media (ICWSM).","year":"2012","author":"Choudhury Munmun De","key":"e_1_2_2_10_1"},{"key":"e_1_2_2_11_1","article-title":"Faces of product pleasure: 25 positive emotions in human-product interactions","volume":"6","author":"Desmet Pieter M. A.","year":"2012","journal-title":"International Journal of Design"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699939208411068"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1390681.1442794"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"e_1_2_2_17_1","volume-title":"Proceedings of the International Conference on Artificial Intelligence (ICAI)","volume":"1","author":"Japkowicz Nathalie","year":"2000"},{"volume-title":"Proceedings of the 8th International AAAI Conference on Weblogs and Social Media (ICWSM).","year":"2014","author":"Kempter Renato","key":"e_1_2_2_18_1"},{"volume-title":"Proceedings NAACL-HLT 2010 Workshop on Computing Approaches to Analysis and Generation of Emotion in Text. ACL, 62--70","author":"MacKim Sunghwan","key":"e_1_2_2_19_1"},{"volume-title":"Moore","year":"2011","author":"Kouloumpis Efthymios","key":"e_1_2_2_20_1"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2013.18"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.2200\/S00416ED1V01Y201204HLT016"},{"volume-title":"Proceedings of 28th AAAI Conference on Artificial Intelligence (AAAI).","year":"2014","author":"Martin Lionel","key":"e_1_2_2_23_1"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/1690219.1690287"},{"volume-title":"AAAI Spring Symp.: Computing Approaches to Analyzing Weblogs. 153--154","year":"2006","author":"Mishne Gilad","key":"e_1_2_2_25_1"},{"volume-title":"Proceedings 1st Joint Conference on Lexical and Computing Semantics (&ast;SEM). ACL, 246--255","year":"2012","author":"Mohammad Saif M.","key":"e_1_2_2_26_1"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1111\/coin.12024"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8640.2012.00460.x"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324910000239"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007692713085"},{"volume-title":"The Cognitive Structure of Emotions","author":"Ortony Andrew","key":"e_1_2_2_31_1"},{"volume-title":"Proceedings of International Conference on Language Resources and Evaluation (LREC).","year":"2010","author":"Pak Alexander","key":"e_1_2_2_32_1"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000011"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-37256-8_12"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0953-5438(01)00055-8"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1511\/2001.4.344"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-54906-9_10"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2012.142"},{"volume-title":"EmoSenticSpace: A novel framework for affective common-sense reasoning. Knowledge-Based Systems 69 (Special Issue on Big Social Data Analysis)","year":"2014","author":"Poria Soujanya","key":"e_1_2_2_39_1"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2013.4"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/2380816.2380875"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646072"},{"volume-title":"Proceedings of the 6th International AAAI Conference on Weblogs and Social Media (ICWSM).","year":"2012","author":"Quercia Daniele","key":"e_1_2_2_43_1"},{"volume-title":"Proceedings of International Conference on Language Resources and Evaluation (LREC). 3806--3813","author":"Roberts Kirk","key":"e_1_2_2_44_1"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1177\/0539018405058216"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767830"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2014.80"},{"volume-title":"Proceedings of the NAACL-HLT WASSA. ACL, 12--20","year":"2013","author":"Sintsova Valentina","key":"e_1_2_2_48_1"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2014.146"},{"key":"e_1_2_2_50_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP)","volume":"1631","author":"Socher Richard","year":"2013"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2009.03.002"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1363686.1364052"},{"key":"e_1_2_2_53_1","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation (LREC)","volume":"4","author":"Strapparava Carlo","year":"2004"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-37256-8_11"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00049"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21662"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.4018\/jdwm.2007070101"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/944012.944013"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/SocialCom-PASSAT.2012.119"},{"volume-title":"Proceedings of NoDaLiDa. 198--205","year":"2009","author":"Wiegand Michael","key":"e_1_2_2_60_1"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220575.1220619"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.5555\/1557769.1557809"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.3115\/992730.992783"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2912147","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2912147","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:56:08Z","timestamp":1750222568000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2912147"}},"subtitle":["Distant Supervision Method for Multi-Category Emotion Recognition in Tweets"],"short-title":[],"issued":{"date-parts":[[2016,8,23]]},"references-count":62,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2017,1,31]]}},"alternative-id":["10.1145\/2912147"],"URL":"https:\/\/doi.org\/10.1145\/2912147","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"type":"print","value":"2157-6904"},{"type":"electronic","value":"2157-6912"}],"subject":[],"published":{"date-parts":[[2016,8,23]]},"assertion":[{"value":"2015-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-08-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}