{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T10:54:44Z","timestamp":1760784884949,"version":"3.41.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2020,10,14]],"date-time":"2020-10-14T00:00:00Z","timestamp":1602633600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000093","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R21 HD088739-01, R01 MH108641-01A1, R01 MH110379-01A1, R01 MH105379-02S1, R01 HD095932-01A1"],"award-info":[{"award-number":["R21 HD088739-01, R01 MH108641-01A1, R01 MH110379-01A1, R01 MH105379-02S1, R01 HD095932-01A1"]}],"id":[{"id":"10.13039\/100000093","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000183","name":"Army Research Office","doi-asserted-by":"publisher","award":["71881-NS-YIP"],"award-info":[{"award-number":["71881-NS-YIP"]}],"id":[{"id":"10.13039\/100000183","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2020,10,14]]},"abstract":"<jats:p>Messaging is a common mode of communication, with conversations written informally between individuals. Interpreting emotional affect from messaging data can lead to a powerful form of reflection or act as a support for clinical therapy. Existing analysis techniques for social media commonly use LIWC and VADER for automated sentiment estimation. We correlate LIWC, VADER, and ratings from human reviewers with affect scores from 25 participants. We explore differences in how and when each technique is successful. Results show that human review does better than VADER, the best automated technique, when humans are judging positive affect ($r_s=0.45$ correlation when confident, $r_s=0.30$ overall). Surprisingly, human reviewers only do slightly better than VADER when judging negative affect ($r_s=0.38$ correlation when confident, $r_s=0.29$ overall). Compared to prior literature, VADER correlates more closely with PANAS scores for private messaging than public social media. Our results indicate that while any technique that serves as a proxy for PANAS scores has moderate correlation at best, there are some areas to improve the automated techniques by better considering context and timing in conversations.<\/jats:p>","DOI":"10.1145\/3415182","type":"journal-article","created":{"date-parts":[[2020,10,15]],"date-time":"2020-10-15T22:27:49Z","timestamp":1602800869000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Sochiatrist"],"prefix":"10.1145","volume":"4","author":[{"given":"Talie","family":"Massachi","sequence":"first","affiliation":[{"name":"Brown University, Providence, RI, USA"}]},{"given":"Grant","family":"Fong","sequence":"additional","affiliation":[{"name":"Brown University, Providence, RI, USA"}]},{"given":"Varun","family":"Mathur","sequence":"additional","affiliation":[{"name":"Brown University, Providence, RI, USA"}]},{"given":"Sachin R.","family":"Pendse","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]},{"given":"Gabriela","family":"Hoefer","sequence":"additional","affiliation":[{"name":"Brown University, Providence, RI, USA"}]},{"given":"Jessica J.","family":"Fu","sequence":"additional","affiliation":[{"name":"Brown University, Providence, RI, USA"}]},{"given":"Chong","family":"Wang","sequence":"additional","affiliation":[{"name":"Brown University, Providence, RI, USA"}]},{"given":"Nikita","family":"Ramoji","sequence":"additional","affiliation":[{"name":"Brown University, Providence, RI, USA"}]},{"given":"Nicole R.","family":"Nugent","sequence":"additional","affiliation":[{"name":"Alpert Medical School of Brown University, Providence, RI, USA"}]},{"given":"Megan L.","family":"Ranney","sequence":"additional","affiliation":[{"name":"Alpert Medical School of Brown University, Providence, RI, USA"}]},{"given":"Daniel P.","family":"Dickstein","sequence":"additional","affiliation":[{"name":"Alpert Medical School of Brown University, Providence, RI, USA"}]},{"given":"Michael F.","family":"Armey","sequence":"additional","affiliation":[{"name":"Alpert Medical School of Brown University, Providence, RI, USA"}]},{"given":"Ellie","family":"Pavlick","sequence":"additional","affiliation":[{"name":"Brown University, Providence, RI, USA"}]},{"given":"Jeff","family":"Huang","sequence":"additional","affiliation":[{"name":"Brown University, Providence, RI, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,10,15]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpr.2012.05.007"},{"volume-title":"Social Media & Technology","year":"2018","author":"Anderson Monica","key":"e_1_2_1_2_1"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2011.01.002"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcom.12106"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X12456384"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786451.2786473"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1037\/tps0000086"},{"volume-title":"Clarifying the Linguistic Signature: Measuring Personality From Natural Speech. Journal of personality assessment 90 (12","year":"2008","author":"Cohen Alex","key":"e_1_2_1_8_1"},{"volume-title":"iPhone backup database hashes: which filenames do they use? iPhone Backup Extractor: Recover Your Lost Data","year":"2012","author":"Coles Andrew","key":"e_1_2_1_9_1"},{"volume-title":"Fowler","year":"2014","author":"Coviello Lorenzo","key":"e_1_2_1_10_1"},{"volume-title":"Coling 2010: Posters. Coling 2010 Organizing Committee","year":"2028","author":"Davidov Dmitry","key":"e_1_2_1_11_1"},{"volume-title":"The nature of emotional expression in social media: measurement, inference and utility","year":"2012","author":"Choudhury Munmun De","key":"e_1_2_1_12_1"},{"volume-title":"Sixth International AAAI Conference on Weblogs and Social Media. 435--438","year":"2012","author":"Choudhury Munmun De","key":"e_1_2_1_13_1"},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Munmun De Choudhury Michael Gamon Scott Counts and Eric Horvitz. 2013. Predicting Depression via Social Media. AAAI 128--137.  Munmun De Choudhury Michael Gamon Scott Counts and Eric Horvitz. 2013. Predicting Depression via Social Media. AAAI 128--137.","DOI":"10.1609\/icwsm.v7i1.14432"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1411678112"},{"volume-title":"Circadian mood variations in Twitter content. Brain and Neuroscience Advances 1 (Jan","year":"2017","author":"Dzogang Fabon","key":"e_1_2_1_16_1"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1097\/HRP.0000000000000145"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/00036810500206966"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media","volume":"13","author":"Guntuku Sharath Chandra","year":"2019"},{"volume-title":"Proceedings of the 8th International Conference on Weblogs and Social Media, ICWSM","year":"2015","author":"Hutto C.J.","key":"e_1_2_1_20_1"},{"key":"e_1_2_1_21_1","unstructured":"Long Jiang Mo Yu Ming Zhou Xiaohua Liu and Tiejun Zhao. 2011. Target-dependent Twitter Sentiment Classification. ACL 151--160.  Long Jiang Mo Yu Ming Zhou Xiaohua Liu and Tiejun Zhao. 2011. Target-dependent Twitter Sentiment Classification. ACL 151--160."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1958824.1958882"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753369"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207787"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1320040111"},{"volume-title":"Extraversion, Self-Efficacy, and Self-Presentation Within Social Networking Sites. Journal of Media Psychology: Theories, Methods, and Applications 20 (01","year":"2008","author":"Kr\u00e4mer Nicole","key":"e_1_2_1_26_1"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173634"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcc4.12045"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/BSN.2012.3"},{"key":"e_1_2_1_30_1","unstructured":"David N. Miller. 2011. Positive Affect. Springer US Boston MA 1121--1122. https:\/\/doi.org\/10.1007\/978-0--387--79061- 9_2193  David N. Miller. 2011. Positive Affect. Springer US Boston MA 1121--1122. https:\/\/doi.org\/10.1007\/978-0--387--79061- 9_2193"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-1202"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1017\/S2045796015001067"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173905"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.diin.2016.04.001"},{"volume-title":"Proceedings of the 7th International Conference on Weblogs and Social Media, ICWSM 2013 (01","year":"2013","author":"Park Myoungouk","key":"e_1_2_1_35_1"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00083"},{"volume-title":"Linguistic inquiry and word count (LIWC). (01","year":"1999","author":"Pennebaker James","key":"e_1_2_1_37_1"},{"volume-title":"The Development and Psychometric Properties of LIWC2015","year":"2015","author":"Pennebaker James W.","key":"e_1_2_1_38_1"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2020.467"},{"key":"e_1_2_1_40_1","first-page":"1","article-title":"Instagram photos reveal predictive markers of depression","volume":"6","author":"Reece Andrew G.","year":"2017","journal-title":"EPJ Data Science"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-12961-9"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130960"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052618"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.clinpsy.3.022806.091415"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.clinpsy.3.022806.091415"},{"key":"e_1_2_1_46_1","unstructured":"Aaron Smith and Monica Anderson. 2018. Social Media Use 2018: Demographics and Statistics. https:\/\/www. pewresearch.org\/internet\/2018\/03\/01\/social-media-use-in-2018\/  Aaron Smith and Monica Anderson. 2018. Social Media Use 2018: Demographics and Statistics. https:\/\/www. pewresearch.org\/internet\/2018\/03\/01\/social-media-use-in-2018\/"},{"volume-title":"Springer New York","author":"Stringer Deborah M.","key":"e_1_2_1_47_1"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X09351676"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Auke Tellegen. 1985. Structures of mood and personality and their relevance to assessing anxiety with an emphasis on self-report. (1985) 681--706.  Auke Tellegen. 1985. Structures of mood and personality and their relevance to assessing anxiety with an emphasis on self-report. (1985) 681--706.","DOI":"10.4324\/9780203728215-49"},{"volume-title":"Han Lin, and Lin Ge Qiu.","year":"2013","author":"Tov William","key":"e_1_2_1_50_1"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0012532"},{"volume-title":"Twitter Analysis: Studying US Weekly Trends in Work Stress and Emotion. Applied Psychology 65 (04","year":"2016","author":"Wang Wei","key":"e_1_2_1_52_1"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.54.6.1063"},{"volume-title":"Gi Wook Ryu, and Mona Choi","year":"2019","author":"Yang Yong Sook","key":"e_1_2_1_54_1"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3415182","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3415182","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3415182","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:10Z","timestamp":1750197790000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3415182"}},"subtitle":["Signals of Affect in Messaging Data"],"short-title":[],"issued":{"date-parts":[[2020,10,14]]},"references-count":54,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2020,10,14]]}},"alternative-id":["10.1145\/3415182"],"URL":"https:\/\/doi.org\/10.1145\/3415182","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2020,10,14]]},"assertion":[{"value":"2020-10-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}