{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T05:50:59Z","timestamp":1769320259798,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":42,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,6,2]],"date-time":"2018-06-02T00:00:00Z","timestamp":1527897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,6,2]]},"DOI":"10.1145\/3194932.3194938","type":"proceedings-article","created":{"date-parts":[[2018,7,17]],"date-time":"2018-07-17T16:16:43Z","timestamp":1531844203000},"page":"55-61","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Sentiment and politeness analysis tools on developer discussions are unreliable, but so are people"],"prefix":"10.1145","author":[{"given":"Nasif","family":"Imtiaz","sequence":"first","affiliation":[{"name":"North Carolina State University"}]},{"given":"Justin","family":"Middleton","sequence":"additional","affiliation":[{"name":"North Carolina State University"}]},{"given":"Peter","family":"Girouard","sequence":"additional","affiliation":[{"name":"North Carolina State University"}]},{"given":"Emerson","family":"Murphy-Hill","sequence":"additional","affiliation":[{"name":"North Carolina State University"}]}],"member":"320","published-online":{"date-parts":[[2018,6,2]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/3155562.3155579"},{"key":"e_1_3_2_1_2_1","volume-title":"Natural language processing with Python: analyzing text with the natural language toolkit. \"O'Reilly Media","author":"Bird Steven","unstructured":"Steven Bird , Ewan Klein , and Edward Loper . 2009. Natural language processing with Python: analyzing text with the natural language toolkit. \"O'Reilly Media , Inc .\". Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural language processing with Python: analyzing text with the natural language toolkit. \"O'Reilly Media, Inc.\"."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901739.2901781"},{"key":"e_1_3_2_1_4_1","unstructured":"Chris Brown Justin Middleton Esha Sharma and Emerson Murphy-Hill. {n. d.}. How Software Users Recommend Tools to Each Other. ({n. d.}).  Chris Brown Justin Middleton Esha Sharma and Emerson Murphy-Hill. {n. d.}. How Software Users Recommend Tools to Each Other. ({n. d.})."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511813085"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-017-9546-9"},{"key":"e_1_3_2_1_7_1","volume-title":"The Free Encyclopedia. (2018). https:\/\/en.wikipedia.org\/wiki\/Politeness {Online","author":"Wikipedia Wikipedia","year":"2018","unstructured":"Wikipedia contributors. 2018. Politeness --- Wikipedia , The Free Encyclopedia. (2018). https:\/\/en.wikipedia.org\/wiki\/Politeness {Online ; accessed 18 Jan , 2018 }. Wikipedia contributors. 2018. Politeness --- Wikipedia, The Free Encyclopedia. (2018). https:\/\/en.wikipedia.org\/wiki\/Politeness {Online; accessed 18 Jan, 2018}."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/0378-2166(95)00014-3"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/50087.50089"},{"key":"e_1_3_2_1_10_1","volume-title":"A computational approach to politeness with application to social factors. arXiv preprint arXiv:1306.6078","author":"Danescu-Niculescu-Mizil Cristian","year":"2013","unstructured":"Cristian Danescu-Niculescu-Mizil , Moritz Sudhof , Dan Jurafsky , Jure Leskovec , and Christopher Potts . 2013. A computational approach to politeness with application to social factors. arXiv preprint arXiv:1306.6078 ( 2013 ). Cristian Danescu-Niculescu-Mizil, Moritz Sudhof, Dan Jurafsky, Jure Leskovec, and Christopher Potts. 2013. A computational approach to politeness with application to social factors. arXiv preprint arXiv:1306.6078 (2013)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/2819321.2819343"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2017.40"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-NIER.2017.18"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/11552253_12"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CGC.2013.71"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2597073.2597126"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.289"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2597073.2597118"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491411.2494578"},{"key":"e_1_3_2_1_20_1","volume-title":"Management and Applications (SERA), 2016 IEEE 14th International Conference on. IEEE, 185--192","author":"Islam Md Rakibul","year":"2016","unstructured":"Md Rakibul Islam and Minhaz F Zibran . 2016 . Towards understanding and exploiting developers' emotional variations in software engineering. In Software Engineering Research , Management and Applications (SERA), 2016 IEEE 14th International Conference on. IEEE, 185--192 . Md Rakibul Islam and Minhaz F Zibran. 2016. Towards understanding and exploiting developers' emotional variations in software engineering. In Software Engineering Research, Management and Applications (SERA), 2016 IEEE 14th International Conference on. IEEE, 185--192."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-016-9493-x"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10111-010-0164-1"},{"key":"e_1_3_2_1_23_1","volume-title":"The measurement of observer agreement for categorical data. biometrics","author":"Richard Landis J","year":"1977","unstructured":"J Richard Landis and Gary G Koch . 1977. The measurement of observer agreement for categorical data. biometrics ( 1977 ), 159--174. J Richard Landis and Gary G Koch. 1977. The measurement of observer agreement for categorical data. biometrics (1977), 159--174."},{"key":"e_1_3_2_1_24_1","volume-title":"Michele Lanza, and Rocco Oliveto.","author":"Lin Bin","year":"2018","unstructured":"Bin Lin , Fiorella Zampetti , Gabriele Bavota , Massimiliano Di Penta , Michele Lanza, and Rocco Oliveto. 2018 . Sentiment Analysis for So ware Engineering : How Far Can We Go ? (2018). Bin Lin, Fiorella Zampetti, Gabriele Bavota, Massimiliano Di Penta, Michele Lanza, and Rocco Oliveto. 2018. Sentiment Analysis for So ware Engineering: How Far Can We Go? (2018)."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Saif Mohammad. 2016. A Practical Guide to Sentiment Annotation: Challenges and Solutions.. In WASSA@ NAACL-HLT. 174--179.  Saif Mohammad. 2016. A Practical Guide to Sentiment Annotation: Challenges and Solutions.. In WASSA@ NAACL-HLT. 174--179.","DOI":"10.18653\/v1\/W16-0429"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2597073.2597086"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661685.2661689"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2804381.2804387"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/2820518.2820555"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-18612-2_11"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901739.2903505"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000011"},{"key":"e_1_3_2_1_33_1","unstructured":"Brian Parkinson Peter Totterdell Rob B Briner and SA Reynolds. 1996. Changing moods: The psychology of mood and mood regulation. Longman.  Brian Parkinson Peter Totterdell Rob B Briner and SA Reynolds. 1996. Changing moods: The psychology of mood and mood regulation. Longman."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2597073.2597117"},{"key":"e_1_3_2_1_35_1","volume-title":"SENTIMENT ANALYSIS OF FREE\/OPEN SOURCE DEVELOPERS: PRELIMINARY FINDINGS FROM A CASE STUDY\/AN\u00c1LISE DE SENTIMENTOS DE DESENVOLVEDORES DE SOFTWARE LIVRE: ACHADOS PRELIMINARES DE UM ESTUDO DE CASO","author":"Rousinopoulos Athanasios-Ilias","year":"2014","unstructured":"Athanasios-Ilias Rousinopoulos , Gregorio Robles , and Jes\u00fas M Gonz\u00e1lez-Barahona . 2014. SENTIMENT ANALYSIS OF FREE\/OPEN SOURCE DEVELOPERS: PRELIMINARY FINDINGS FROM A CASE STUDY\/AN\u00c1LISE DE SENTIMENTOS DE DESENVOLVEDORES DE SOFTWARE LIVRE: ACHADOS PRELIMINARES DE UM ESTUDO DE CASO . Revista Electronica de Sistemas de Informa\u00e7ao 13, 2 ( 2014 ), 1. Athanasios-Ilias Rousinopoulos, Gregorio Robles, and Jes\u00fas M Gonz\u00e1lez-Barahona. 2014. SENTIMENT ANALYSIS OF FREE\/OPEN SOURCE DEVELOPERS: PRELIMINARY FINDINGS FROM A CASE STUDY\/AN\u00c1LISE DE SENTIMENTOS DE DESENVOLVEDORES DE SOFTWARE LIVRE: ACHADOS PRELIMINARES DE UM ESTUDO DE CASO. Revista Electronica de Sistemas de Informa\u00e7ao 13, 2 (2014), 1."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901739.2903501"},{"key":"e_1_3_2_1_37_1","volume-title":"Proceedings of the 2013 conference on empirical methods in natural language processing. 1631--1642","author":"Socher Richard","year":"2013","unstructured":"Richard Socher , Alex Perelygin , Jean Wu , Jason Chuang , Christopher D Manning , Andrew Ng , and Christopher Potts . 2013 . Recursive deep models for semantic compositionality over a sentiment treebank . In Proceedings of the 2013 conference on empirical methods in natural language processing. 1631--1642 . Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher D Manning, Andrew Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the 2013 conference on empirical methods in natural language processing. 1631--1642."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675215"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882362.1882435"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/1890706.1890713"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635882"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2007.09.003"}],"event":{"name":"ICSE '18: 40th International Conference on Software Engineering","location":"Gothenburg Sweden","acronym":"ICSE '18","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE-CS Computer Society"]},"container-title":["Proceedings of the 3rd International Workshop on Emotion Awareness in Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3194932.3194938","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3194932.3194938","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:08:49Z","timestamp":1750208929000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3194932.3194938"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,2]]},"references-count":42,"alternative-id":["10.1145\/3194932.3194938","10.1145\/3194932"],"URL":"https:\/\/doi.org\/10.1145\/3194932.3194938","relation":{},"subject":[],"published":{"date-parts":[[2018,6,2]]},"assertion":[{"value":"2018-06-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}