{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T11:18:07Z","timestamp":1775128687250,"version":"3.50.1"},"reference-count":83,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2022,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Self-Admitted Technical Debt (SATD) consists of annotations\u2014typically, but not only, source code comments\u2014pointing out incomplete features, maintainability problems, or, in general, portions of a program not-ready yet. The way a SATD comment is written, and specifically its polarity, may be a proxy indicator of the severity of the problem and, to some extent, of the priority with which it should be addressed. In this paper, we study the relationship between different types of SATD comments in source code and their polarity, to understand in which circumstances (and why) developers use negative or rather neutral comments to highlight an SATD. To address this goal, we combine a manual analysis of 1038 SATD comments from a curated dataset with a survey involving 46 professional developers. First of all, we categorize SATD content into its types. Then, we study the extent to which developers express negative sentiment in different types of SATD as a proxy for priority, and whether they believe this can be considered as an acceptable practice. Finally, we look at whether such annotations contain additional details such as bug references and developers\u2019 names\/initials. Results of the study indicate that SATD comments are mainly used for annotating poor implementation choices (<jats:inline-formula><jats:alternatives><jats:tex-math>$\\simeq $<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:mo>\u2243<\/mml:mo><\/mml:math><\/jats:alternatives><\/jats:inline-formula>41%) and partially implemented functionality (<jats:inline-formula><jats:alternatives><jats:tex-math>$\\simeq $<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:mo>\u2243<\/mml:mo><\/mml:math><\/jats:alternatives><\/jats:inline-formula>22%). The latter may depend from \u201cwaiting\u201d for other features being implemented, and this makes SATD comments more negatives than in other cases. Around 30% of the survey respondents agree on using\/interpreting negative sentiment as a proxy for priority, while 50% of them indicate that it would be better to discuss SATD on issue trackers and not in the source code. However, while our study indicates that open-source developers use links to external systems, such as bug identifiers, to annotate high-priority SATD, better tool support is required for SATD management.<\/jats:p>","DOI":"10.1007\/s10664-022-10183-w","type":"journal-article","created":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T10:03:08Z","timestamp":1658829788000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Self-Admitted Technical Debt and comments\u2019 polarity: an empirical study"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6511-918X","authenticated-orcid":false,"given":"Nathan","family":"Cassee","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fiorella","family":"Zampetti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicole","family":"Novielli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander","family":"Serebrenik","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Massimiliano","family":"Di Penta","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,7,26]]},"reference":[{"key":"10183_CR1","doi-asserted-by":"publisher","unstructured":"Ahmed T, Bosu A, Iqbal A, Rahimi S (2017) SentiCR: a customized sentiment analysis tool for code review interactions. In: ASE 2017\u2014proceedings of the 32nd IEEE\/ACM international conference on automated software engineering. https:\/\/doi.org\/10.1109\/ASE.2017.8115623, pp 106\u2013111","DOI":"10.1109\/ASE.2017.8115623"},{"key":"10183_CR2","doi-asserted-by":"publisher","unstructured":"Alkalbani A, Ghamry A, Hussain F, Hussain O (2016) Sentiment analysis and classification for software as a service reviews. In: 2016 IEEE 30th international conference on advanced information networking and applications (AINA). https:\/\/doi.org\/10.1109\/AINA.2016.148. https:\/\/doi.ieeecomputersociety.org\/10.1109\/AINA.2016.148. IEEE Computer Society, Los Alamitos, pp 53\u201358","DOI":"10.1109\/AINA.2016.148"},{"key":"10183_CR3","unstructured":"Alves NSR, Ribeiro LF, Caires V, Mendes TS, Sp\u00ednola RO (2014) Sixth international workshop on managing technical debt, mtd@icsme 2014, Victoria, BC, Canada, September 30, 2014. In: International workshop on managing technical debt. IEEE Computer Society, pp 1\u20137"},{"key":"10183_CR4","doi-asserted-by":"publisher","unstructured":"Anderson MJ (2017) Permutational multivariate analysis of variance (PERMANOVA). American Cancer Society, pp 1\u201315. https:\/\/doi.org\/10.1002\/9781118445112.stat07841. https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1002\/9781118445112.stat07841. https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/9781118445112.stat07841","DOI":"10.1002\/9781118445112.stat07841"},{"key":"10183_CR5","doi-asserted-by":"crossref","unstructured":"Bavota G, Russo B (2016) A large-scale empirical study on self-admitted technical debt. In: Kim M, Robbes R, Bird C (eds) International conference on mining software repositories. ACM, pp 315\u2013326","DOI":"10.1145\/2901739.2901742"},{"issue":"1","key":"10183_CR6","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"Y Benjamini","year":"1995","unstructured":"Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B (Methodol) 57(1):289\u2013300","journal-title":"J R Stat Soc Ser B (Methodol)"},{"key":"10183_CR7","doi-asserted-by":"crossref","unstructured":"Brown N, Cai Y, Guo Y, Kazman R, Kim M, Kruchten P, Lim E, MacCormack A, Nord R L, Ozkaya I, Sangwan R S, Seaman C B, Sullivan K J, Zazworka N (2010) Managing technical debt in software-reliant systems. In: Roman G, Sullivan KJ (eds) Proceedings of the workshop on future of software engineering research, FoSER 2010, at the 18th ACM SIGSOFT international symposium on foundations of software engineering, 2010, Santa Fe, NM, USA, November 7\u201311, 2010. ACM, pp 47\u201352","DOI":"10.1145\/1882362.1882373"},{"issue":"3","key":"10183_CR8","doi-asserted-by":"publisher","first-page":"1352","DOI":"10.1007\/s10664-017-9546-9","volume":"23","author":"F Calefato","year":"2018","unstructured":"Calefato F, Lanubile F, Maiorano F, Novielli N (2018a) Sentiment polarity detection for software development. Empir Softw Eng 23(3):1352\u20131382. https:\/\/doi.org\/10.1007\/s10664-017-9546-9","journal-title":"Empir Softw Eng"},{"issue":"C","key":"10183_CR9","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1016\/j.infsof.2017.10.009","volume":"94","author":"F Calefato","year":"2018","unstructured":"Calefato F, Lanubile F, Novielli N (2018b) How to ask for technical help? Evidence-based guidelines for writing questions on stack overflow. Inf Softw Technol 94(C):186\u2013207","journal-title":"Inf Softw Technol"},{"key":"10183_CR10","doi-asserted-by":"publisher","first-page":"1829","DOI":"10.1016\/j.jbusres.2015.01.010","volume":"68","author":"LV Casal\u00f3","year":"2015","unstructured":"Casal\u00f3 L V, Flavi\u00e1n C, Guinaliu M, Ekinci Y (2015) Avoiding the dark side of positive online consumer reviews: enhancing reviews\u2019 usefulness for high risk-averse travelers. J Bus Res 68:1829\u20131835","journal-title":"J Bus Res"},{"key":"10183_CR11","doi-asserted-by":"publisher","unstructured":"Chen Z, Cao Y, Lu X, Mei Q, Liu X (2019) Sentimoji: an emoji-powered learning approach for sentiment analysis in software engineering. In: Dumas M, Pfahl D, Apel S, Russo A (eds) Proceedings of the ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering, ESEC\/SIGSOFT FSE 2019, Tallinn, Estonia, August 26\u201330, 2019. https:\/\/doi.org\/10.1145\/3338906.3338977. ACM, pp 841\u2013852","DOI":"10.1145\/3338906.3338977"},{"key":"10183_CR12","doi-asserted-by":"publisher","unstructured":"Choi B, Alexander K, Kraut R E, Levine J M (2010) Socialization tactics in wikipedia and their effects. In: Proceedings of the 2010 ACM conference on computer supported cooperative work, CSCW \u201910. https:\/\/doi.org\/10.1145\/1718918.1718940. Association for Computing Machinery, New York, pp 107\u2013116","DOI":"10.1145\/1718918.1718940"},{"key":"10183_CR13","doi-asserted-by":"crossref","unstructured":"da Silva Maldonado E, Shihab E (2015) Detecting and quantifying different types of self-admitted technical debt. In: 7th IEEE international workshop on managing technical debt, MTD@ICSME 2015, Bremen, Germany, October 2, 2015, pp 9\u201315","DOI":"10.1109\/MTD.2015.7332619"},{"key":"10183_CR14","doi-asserted-by":"crossref","unstructured":"da Silva Maldonado E, Abdalkareem R, Shihab E, Serebrenik A (2017) An empirical study on the removal of self-admitted technical debt. In: ICSME, pp 238\u2013248","DOI":"10.1109\/ICSME.2017.8"},{"issue":"11","key":"10183_CR15","doi-asserted-by":"publisher","first-page":"1044","DOI":"10.1109\/TSE.2017.2654244","volume":"43","author":"E da Silva Maldonado","year":"2017","unstructured":"da Silva Maldonado E, Shihab E, Tsantalis N (2017) Using natural language processing to automatically detect self-admitted technical debt. IEEE Trans Softw Eng 43(11):1044\u20131062","journal-title":"IEEE Trans Softw Eng"},{"key":"10183_CR16","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1037\/0021-9010.88.2.284","volume":"88","author":"J Diefendorff","year":"2003","unstructured":"Diefendorff J, Richard E (2003) Antecedents and consequences of emotional display rule perceptions. J Appl Psychol 88:284\u201394. https:\/\/doi.org\/10.1037\/0021-9010.88.2.284","journal-title":"J Appl Psychol"},{"key":"10183_CR17","doi-asserted-by":"publisher","unstructured":"Ding J, Sun H, Wang X, Liu X (2018) Entity-level sentiment analysis of issue comments. In: Begel A, Serebrenik A, Graziotin D (eds) Proceedings of the 3rd international workshop on emotion awareness in software engineering, SEmotion@ICSE 2018, Gothenburg, Sweden, June 2, 2018. https:\/\/doi.org\/10.1145\/3194932.3194935. ACM, pp 7\u201313","DOI":"10.1145\/3194932.3194935"},{"key":"10183_CR18","doi-asserted-by":"crossref","unstructured":"Ebert F, Castor F, Novielli N, Serebrenik A (2018) Communicative intention in code review questions. In: 2018 IEEE International conference on software maintenance and evolution (ICSME). IEEE, pp 519\u2013523","DOI":"10.1109\/ICSME.2018.00061"},{"key":"10183_CR19","doi-asserted-by":"crossref","unstructured":"Ernst N A, Bellomo S, Ozkaya I, Nord R L, Gorton I (2015) Measure it? Manage it? Ignore it? Software practitioners and technical debt. In: Foundations of software engineering. ACM, pp 50\u201360","DOI":"10.1145\/2786805.2786848"},{"key":"10183_CR20","unstructured":"Fischer M, Pinzger M, Gall H (2003) Populating a release history database from version control and bug tracking systems. In: International conference on software maintenance, 2003. ICSM 2003. Proceedings. IEEE"},{"key":"10183_CR21","doi-asserted-by":"crossref","unstructured":"Fluri B, Wursch M, Gall H C (2007) Do code and comments co-evolve? On the relation between source code and comment changes. In: 14th Working conference on reverse engineering (WCRE 2007). IEEE, pp 70\u201379","DOI":"10.1109\/WCRE.2007.21"},{"key":"10183_CR22","doi-asserted-by":"crossref","unstructured":"Fucci G, Zampetti F, Serebrenik A, Di Penta M (2020) Who (self) admits technical debt?. In: 2020 IEEE International conference on software maintenance and evolution (ICSME). IEEE, pp 672\u2013676","DOI":"10.1109\/ICSME46990.2020.00070"},{"key":"10183_CR23","doi-asserted-by":"publisher","unstructured":"Fucci G, Cassee N, Zampetti F, Novielli N, Serebrenik A, Penta M D (2021) Waiting around or job half-done? Sentiment in self-admitted technical debt. In: 2021 IEEE\/ACM 18th international conference on mining software repositories (MSR) (MSR). https:\/\/doi.org\/10.1109\/MSR52588.2021.00052. https:\/\/doi.ieeecomputersociety.org\/10.1109\/MSR52588.2021.00052. IEEE Computer Society, Los Alamitos, pp 403\u2013414","DOI":"10.1109\/MSR52588.2021.00052"},{"key":"10183_CR24","doi-asserted-by":"publisher","unstructured":"Gachechiladze D, Lanubile F, Novielli N, Serebrenik A (2017) Anger and its direction in collaborative software development. In: Proceedings of the 39th international conference on software engineering: new ideas and emerging results track, ICSE-NIER \u201917. https:\/\/doi.org\/10.1109\/ICSE-NIER.2017.18. IEEE Press, pp 11\u201314","DOI":"10.1109\/ICSE-NIER.2017.18"},{"key":"10183_CR25","doi-asserted-by":"publisher","unstructured":"Gao Z, Xia X, Lo D, Grundy J C, Zimmermann T (2021) Automating the removal of obsolete TODO comments. In: ESEC\/FSE \u201921: 29th ACM joint European software engineering conference and symposium on the foundations of software engineering, Athens, Greece, August 23\u201328, 2021. https:\/\/doi.org\/10.1145\/3468264.3468553, pp 218\u2013229","DOI":"10.1145\/3468264.3468553"},{"key":"10183_CR26","doi-asserted-by":"crossref","unstructured":"Girardi D, Novielli N, Fucci D, Lanubile F (2020) Recognizing developers\u2019 emotions while programming. In: Rothermel G, Bae D (eds) International conference on software engineering. ACM, pp 666\u2013677","DOI":"10.1145\/3377811.3380374"},{"key":"10183_CR27","doi-asserted-by":"publisher","unstructured":"Girardi D, Lanubile F, Novielli N, Serebrenik A (2021) Emotions and perceived productivity of software developers at the workplace. IEEE Trans Softw Eng xxx(1):1\u20131. https:\/\/doi.org\/10.1109\/TSE.2021.3087906https:\/\/doi.org\/10.1109\/TSE.2021.3087906","DOI":"10.1109\/TSE.2021.3087906 10.1109\/TSE.2021.3087906"},{"key":"10183_CR28","volume-title":"The managed heart: commercialization of human feeling","author":"R Hochschild","year":"1983","unstructured":"Hochschild R (1983) The managed heart: commercialization of human feeling. The University of California Press, Berkeley"},{"key":"10183_CR29","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1016\/j.jss.2018.08.030","volume":"145","author":"MR Islam","year":"2018","unstructured":"Islam M R, Zibran M F (2018) Sentistrength-se: exploiting domain specificity for improved sentiment analysis in software engineering text. J Syst Softw 145:125\u2013146. https:\/\/doi.org\/10.1016\/j.jss.2018.08.030. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0164121218301675","journal-title":"J Syst Softw"},{"issue":"5","key":"10183_CR30","doi-asserted-by":"publisher","first-page":"2543","DOI":"10.1007\/s10664-016-9493-x","volume":"22","author":"R Jongeling","year":"2017","unstructured":"Jongeling R, Sarkar P, Datta S, Serebrenik A (2017) On negative results when using sentiment analysis tools for software engineering research. Empir Softw Eng 22(5):2543\u20132584. https:\/\/doi.org\/10.1007\/s10664-016-9493-xhttps:\/\/doi.org\/10.1007\/s10664-016-9493-x","journal-title":"Empir Softw Eng"},{"key":"10183_CR31","unstructured":"Kamei Y, Maldonado EDS, Shihab E, Ubayashi N (2016) Using analytics to quantify interest of self-admitted technical debt. In: Lichter H, F\u00f6gen K, Sunetnanta T, Anwar T, Yamashita A, Moonen L, Mens T, Tahir A, Sureka A (eds) Joint Proceedings of the 4th international workshop on quantitative approaches to software quality (QuASoQ 2016) and 1st international workshop on technical debt analytics (TDA 2016) co-located with the 23rd Asia-Pacific software engineering conference (APSEC 2016), Hamilton, New Zealand, December 6, 2016, CEUR-WS.org, CEUR Workshop Proceedings, vol 1771, pp 68\u201371"},{"key":"10183_CR32","doi-asserted-by":"publisher","first-page":"738","DOI":"10.1214\/12-EJS691","volume":"6","author":"F Konietschke","year":"2012","unstructured":"Konietschke F, Hothorn L A, Brunner E (2012) Rank-based multiple test procedures and simultaneous confidence intervals. Electron J Stat 6:738\u2013759","journal-title":"Electron J Stat"},{"key":"10183_CR33","volume-title":"Content analysis: an introduction to its methodology","author":"K Krippendorff","year":"2012","unstructured":"Krippendorff K (2012) Content analysis: an introduction to its methodology. Sage, Thousand Oaks"},{"key":"10183_CR34","doi-asserted-by":"crossref","unstructured":"Kruchten P, Nord RL, Ozkaya I, Falessi D (2013) Technical debt: towards a crisper definition report on the 4th international workshop on managing technical debt. ACM SIGSOFT Software Engineering Notes","DOI":"10.1109\/ICSE.2013.6606774"},{"issue":"260","key":"10183_CR35","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1080\/01621459.1952.10483441","volume":"47","author":"WH Kruskal","year":"1952","unstructured":"Kruskal W H, Wallis W A (1952) Use of ranks in one-criterion variance analysis. J Am Stat Assoc 47(260):583\u2013621. https:\/\/doi.org\/10.1080\/01621459.1952.10483441","journal-title":"J Am Stat Assoc"},{"key":"10183_CR36","doi-asserted-by":"crossref","unstructured":"Li Z, Zhong H (2021) An empirical study on obsolete issue reports. In: Proceedings of the 36th IEEE\/ACM international conference on automated software engineering, p page to appear","DOI":"10.1109\/ASE51524.2021.9678543"},{"issue":"6","key":"10183_CR37","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1109\/MS.2012.130","volume":"29","author":"E Lim","year":"2012","unstructured":"Lim E, Taksande N, Seaman C (2012) A balancing act: what software practitioners have to say about technical debt. IEEE Softw 29(6):22\u201327","journal-title":"IEEE Softw"},{"key":"10183_CR38","doi-asserted-by":"publisher","unstructured":"Lin B, Zampetti F, Bavota G, Di Penta M, Lanza M, Oliveto R (2018) Sentiment analysis for software engineering: how far can we go?. In: Proceedings of the 40th international conference on software engineering, ICSE 2018, Gothenburg, Sweden, May 27\u2013June 03, 2018. https:\/\/doi.org\/10.1145\/3180155.3180195https:\/\/doi.org\/10.1145\/3180155.3180195, pp 94\u2013104","DOI":"10.1145\/3180155.3180195 10.1145\/3180155.3180195"},{"key":"10183_CR39","doi-asserted-by":"publisher","unstructured":"Lin B, Zampetti F, Bavota G, Di Penta M, Lanza M (2019) Pattern-based mining of opinions in Q & A websites. In: 2019 IEEE\/ACM 41st international conference on software engineering (ICSE). https:\/\/doi.org\/10.1109\/ICSE.2019.00066, pp 548\u2013559","DOI":"10.1109\/ICSE.2019.00066"},{"key":"10183_CR40","doi-asserted-by":"crossref","unstructured":"Lin B, Cassee N, Serebrenik A, Bavota G, Novielli N, Lanza M (2021) Opinion mining for software development: a systematic literature review. ACM Trans Softw Eng Methodol xx:xx\u2013xx","DOI":"10.1145\/3490388"},{"issue":"2","key":"10183_CR41","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1007\/s10664-020-09917-5","volume":"26","author":"J Liu","year":"2021","unstructured":"Liu J, Huang Q, Xia X, Shihab E, Lo D, Li S (2021) An exploratory study on the introduction and removal of different types of technical debt in deep learning frameworks. Empir Softw Eng 26(2):16. https:\/\/doi.org\/10.1007\/s10664-020-09917-5","journal-title":"Empir Softw Eng"},{"key":"10183_CR42","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1007\/s00766-016-0251-9","volume":"21","author":"W Maalej","year":"2016","unstructured":"Maalej W, Kurtanovic Z, Nabil H, Stanik C (2016) On the automatic classification of app reviews. Requir Eng 21:311\u2013331","journal-title":"Requir Eng"},{"key":"10183_CR43","doi-asserted-by":"crossref","unstructured":"Maipradit R, Lin B, Nagy C, Bavota G, Lanza M, Hata H, Matsumoto K (2020a) Automated identification of on-hold self-admitted technical debt. In: 2020 IEEE 20th international working conference on source code analysis and manipulation (SCAM). IEEE, pp 54\u201364","DOI":"10.1109\/SCAM51674.2020.00011"},{"issue":"5","key":"10183_CR44","doi-asserted-by":"publisher","first-page":"3770","DOI":"10.1007\/s10664-020-09854-3","volume":"25","author":"R Maipradit","year":"2020","unstructured":"Maipradit R, Treude C, Hata H, Matsumoto K (2020b) Wait for it: identifying \u201con-hold\u201d self-admitted technical debt. Empir Softw Eng 25 (5):3770\u20133798","journal-title":"Empir Softw Eng"},{"key":"10183_CR45","doi-asserted-by":"publisher","unstructured":"M\u00e4ntyl\u00e4 M, Adams B, Destefanis G, Graziotin D, Ortu M (2016) Mining valence, arousal, and dominance: Possibilities for detecting burnout and productivity?. In: Proceedings of the 13th international conference on mining software repositories, MSR \u201916. https:\/\/doi.org\/10.1145\/2901739.2901752. Association for Computing Machinery, New York, pp 247\u2013258","DOI":"10.1145\/2901739.2901752"},{"key":"10183_CR46","doi-asserted-by":"publisher","unstructured":"McNamara A, Smith J, Murphy-Hill E (2018) Does acm\u2019s code of ethics change ethical decision making in software development?. In: Proceedings of the 2018 26th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering, ESEC\/FSE 2018. https:\/\/doi.org\/10.1145\/3236024.3264833. Association for Computing Machinery, New York, pp 729\u2013733","DOI":"10.1145\/3236024.3264833"},{"key":"10183_CR47","doi-asserted-by":"publisher","unstructured":"M\u00fcller S C, Fritz T (2015) Stuck and frustrated or in flow and happy: sensing developers\u2019 emotions and progress. In: Bertolino A, Canfora G, Elbaum SG (eds) 37th IEEE\/ACM international conference on software engineering, ICSE 2015, Florence, Italy, May 16\u201324, 2015, vol 1. https:\/\/doi.org\/10.1109\/ICSE.2015.334. IEEE Computer Society, pp 688\u2013699","DOI":"10.1109\/ICSE.2015.334"},{"key":"10183_CR48","doi-asserted-by":"publisher","unstructured":"Murgia A, Tourani P, Adams B, Ortu M (2014) Do developers feel emotions? An exploratory analysis of emotions in software artifacts. In: Proceedings of the 11th working conference on mining software repositories, MSR 2014. https:\/\/doi.org\/10.1145\/2597073.2597086. Association for Computing Machinery, New York, pp 262\u2013271","DOI":"10.1145\/2597073.2597086"},{"issue":"8","key":"10183_CR49","doi-asserted-by":"publisher","first-page":"873","DOI":"10.1002\/(SICI)1097-0258(19980430)17:8<873::AID-SIM779>3.0.CO;2-I","volume":"17","author":"RG Newcombe","year":"1998","unstructured":"Newcombe RG (1998) Interval estimation for the difference between independent proportions: comparison of eleven methods. Stat Med 17(8):873\u2013890. https:\/\/doi.org\/10.1002\/(SICI)1097-0258(19980430)17:8<873::AID-SIM779>3.0.CO;2-I","journal-title":"Stat Med"},{"issue":"5","key":"10183_CR50","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1109\/MS.2019.2924013","volume":"36","author":"N Novielli","year":"2019","unstructured":"Novielli N, Serebrenik A (2019) Sentiment and emotion in software engineering. IEEE Softw 36(5):6\u20139. https:\/\/doi.org\/10.1109\/MS.2019.2924013","journal-title":"IEEE Softw"},{"key":"10183_CR51","doi-asserted-by":"publisher","unstructured":"Novielli N, Girardi D, Lanubile F (2018) A benchmark study on sentiment analysis for software engineering research. In: Proceedings of the 15th international conference on mining software repositories, MSR \u201918. https:\/\/doi.org\/10.1145\/3196398.3196403. Association for Computing Machinery, New York, pp 364\u2013375","DOI":"10.1145\/3196398.3196403"},{"key":"10183_CR52","doi-asserted-by":"publisher","unstructured":"Novielli N, Calefato F, Dongiovanni D, Girardi D, Lanubile F (2020) Can we use SE-specific sentiment analysis tools in a cross-platform setting? Proceedings\u20142020 IEEE\/ACM 17th international conference on mining software repositories, MSR 2020. https:\/\/doi.org\/10.1145\/3379597.3387446. 2004.00300, pp 158\u2013168","DOI":"10.1145\/3379597.3387446"},{"key":"10183_CR53","doi-asserted-by":"crossref","unstructured":"Novielli N, Calefato F, Lanubile F, Serebrenik A (2021) Assessment of off-the-shelf SE-specific sentiment analysis tools: an extended replication study. Empir Softw Eng 26","DOI":"10.1007\/s10664-021-09960-w"},{"key":"10183_CR54","doi-asserted-by":"publisher","unstructured":"Ortu M, Adams B, Destefanis G, Tourani P, Marchesi M, Tonelli R (2015) Are bullies more productive? Empirical study of affectiveness vs. issue fixing time. In: 2015 IEEE\/ACM 12th working conference on mining software repositories. https:\/\/doi.org\/10.1109\/MSR.2015.35, pp 303\u2013313","DOI":"10.1109\/MSR.2015.35"},{"issue":"1","key":"10183_CR55","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1109\/TSE.2018.2883603","volume":"47","author":"F Palomba","year":"2021","unstructured":"Palomba F, Andrew Tamburri D, Arcelli Fontana F, Oliveto R, Zaidman A, Serebrenik A (2021) Beyond technical aspects: How do community smells influence the intensity of code smells? IEEE Trans Softw Eng 47 (1):108\u2013129. https:\/\/doi.org\/10.1109\/TSE.2018.2883603","journal-title":"IEEE Trans Softw Eng"},{"key":"10183_CR56","doi-asserted-by":"publisher","unstructured":"Panichella S, Di Sorbo A, Guzman E, Visaggio C A, Canfora G, Gall H C (2015) How can i improve my app? Classifying user reviews for software maintenance and evolution. In: 2015 IEEE International conference on software maintenance and evolution (ICSME). https:\/\/doi.org\/10.1109\/ICSM.2015.7332474, pp 281\u2013290","DOI":"10.1109\/ICSM.2015.7332474"},{"key":"10183_CR57","doi-asserted-by":"publisher","unstructured":"Portugal R L Q, do Prado Leite J C S (2018) Usability related qualities through sentiment analysis. In: Fucci D, Novielli N, Guzman E (eds) 1st International workshop on affective computing for requirements engineering, affectRE@RE 2018, Banff, AB, Canada, August 21, 2018. https:\/\/doi.org\/10.1109\/AffectRE.2018.00010. IEEE, pp 20\u201326","DOI":"10.1109\/AffectRE.2018.00010"},{"key":"10183_CR58","doi-asserted-by":"crossref","unstructured":"Potdar A, Shihab E (2014) An exploratory study on self-admitted technical debt. In: 30th IEEE International conference on software maintenance and evolution, Victoria, BC, Canada, September 29\u2013October 3, 2014, pp 91\u2013100","DOI":"10.1109\/ICSME.2014.31"},{"key":"10183_CR59","doi-asserted-by":"publisher","unstructured":"Raman N, Cao M, Tsvetkov Y, K\u00e4stner C, Vasilescu B (2020) Stress and burnout in open source: toward finding, understanding, and mitigating unhealthy interactions. In: Proceedings of the ACM\/IEEE 42nd international conference on software engineering: new ideas and emerging results, ICSE-NIER \u201920. https:\/\/doi.org\/10.1145\/3377816.3381732. Association for Computing Machinery, New York, pp 57\u201360","DOI":"10.1145\/3377816.3381732"},{"key":"10183_CR60","doi-asserted-by":"publisher","unstructured":"Rantala L, M\u00e4ntyl\u00e4 M, Lo D (2020) Prevalence, contents and automatic detection of KL-SATD. In: 46h Euromicro conference on software engineering and advanced applications, SEAA 2020, Portoroz, Slovenia, August 26\u201328, 2020. https:\/\/doi.org\/10.1109\/SEAA51224.2020.00069, pp 385\u2013388","DOI":"10.1109\/SEAA51224.2020.00069"},{"issue":"3","key":"10183_CR61","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1145\/3324916","volume":"28","author":"X Ren","year":"2019","unstructured":"Ren X, Xing Z, Xia X, Lo D, Wang X, Grundy J (2019) Neural network-based detection of self-admitted technical debt: from performance to explainability. ACM Trans Softw Eng Methodol 28(3):15","journal-title":"ACM Trans Softw Eng Methodol"},{"key":"10183_CR62","first-page":"598","volume":"12","author":"PH Rossi","year":"1983","unstructured":"Rossi P H, Nock S L (1983) Measuring social judgments : the factorial survey approach. Social Forces 12:598","journal-title":"Social Forces"},{"key":"10183_CR63","doi-asserted-by":"crossref","unstructured":"Russo B, Camilli M, Mock M (2022) Weaksatd: detecting weak self-admitted technical debt. In: Proceedings of the 19th international conference on mining software repositories, p page to appear","DOI":"10.1145\/3524842.3528469"},{"issue":"4","key":"10183_CR64","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1177\/0539018404047701","volume":"43","author":"KR Scherer","year":"2004","unstructured":"Scherer K R, Wranik T, Sangsue J, Tran V, Scherer U (2004) Emotions in everyday life: probability of occurrence, risk factors, appraisal and reaction patterns. Soc Sci Inf 43(4):499\u2013570. https:\/\/doi.org\/10.1177\/0539018404047701","journal-title":"Soc Sci Inf"},{"key":"10183_CR65","doi-asserted-by":"crossref","unstructured":"Seaman C, Guo Y (2011) Measuring and monitoring technical debt. Advances in Computers","DOI":"10.1016\/B978-0-12-385512-1.00002-5"},{"key":"10183_CR66","unstructured":"Serebrenik A (2017) Emotional labor of software engineers. In: Demeyer S, Parsai A, Laghari G, van Bladel B (eds) Proceedings of the 16th edition of the BElgian-NEtherlands software eVOLution symposium, Antwerp, Belgium, December 4\u20135, 2017. CEUR-WS.org, CEUR Workshop Proceedings, vol 2047, pp 1\u20136"},{"issue":"6","key":"10183_CR67","doi-asserted-by":"publisher","first-page":"1310","DOI":"10.1016\/j.tourman.2010.12.011","volume":"32","author":"BA Sparks","year":"2011","unstructured":"Sparks B A, Browning V (2011) The impact of online reviews on hotel booking intentions and perception of trust. Tour Manag 32(6):1310\u20131323. https:\/\/doi.org\/10.1016\/j.tourman.2010.12.011. https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0261517711000033","journal-title":"Tour Manag"},{"key":"10183_CR68","unstructured":"Spencer D (2009) Card sorting: designing usable categories. Rosenfeld Media"},{"key":"10183_CR69","doi-asserted-by":"publisher","unstructured":"Steinmacher I, Conte T, Gerosa M A, Redmiles D (2015) Social barriers faced by newcomers placing their first contribution in open source software projects. In: CSCW 2015, CSCW \u201915. https:\/\/doi.org\/10.1145\/2675133.2675215. Association for Computing Machinery, pp 1379\u20131392","DOI":"10.1145\/2675133.2675215"},{"key":"10183_CR70","doi-asserted-by":"crossref","unstructured":"Storey M A (2012) The evolution of the social programmer. In: Proceedings of the 9th IEEE working conference on mining software repositories, MSR \u201912. IEEE Press, p 140","DOI":"10.1109\/MSR.2012.6224273"},{"key":"10183_CR71","doi-asserted-by":"publisher","unstructured":"Storey M A, Ryall J, Bull R I, Myers D, Singer J (2008) Todo or to bug: exploring how task annotations play a role in the work practices of software developers. In: Proceedings of the 30th international conference on software engineering, ICSE \u201908. https:\/\/doi.org\/10.1145\/1368088.1368123. Association for Computing Machinery, New York, pp 251\u2013260","DOI":"10.1145\/1368088.1368123"},{"key":"10183_CR72","doi-asserted-by":"publisher","unstructured":"Tourani P, Adams B, Serebrenik A (2017) Code of conduct in open source projects. In: 2017 IEEE 24th international conference on software analysis, evolution and reengineering (SANER). https:\/\/doi.org\/10.1109\/SANER.2017.7884606, pp 24\u201333","DOI":"10.1109\/SANER.2017.7884606"},{"key":"10183_CR73","doi-asserted-by":"crossref","unstructured":"Uddin G, Khomh F (2017) Opiner: an opinion search and summarization engine for apis. In: Proceedings of the 32nd IEEE\/ACM international conference on automated software engineering, ASE 2017. IEEE Press, pp 978\u2013983","DOI":"10.1109\/ASE.2017.8115715"},{"key":"10183_CR74","doi-asserted-by":"crossref","unstructured":"Wehaibi S, Shihab E, Guerrouj L (2016) Examining the impact of self-admitted technical debt on software quality. In: IEEE 23rd International conference on software analysis, evolution, and reengineering, SANER 2016, Suita, Osaka, Japan, March 14\u201318, 2016, vol 1, pp 179\u2013188","DOI":"10.1109\/SANER.2016.72"},{"issue":"5","key":"10183_CR75","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1037\/h0037186","volume":"59","author":"P Wright","year":"1974","unstructured":"Wright P (1974) The harassed decision maker: time pressures, distractions, and the use of evidence. J Appl Psychol 59(5):555\u2013561","journal-title":"J Appl Psychol"},{"key":"10183_CR76","doi-asserted-by":"publisher","unstructured":"Xavier L, Ferreira F, Brito R, Valente M T (2020) Beyond the code: mining self-admitted technical debt in issue tracker systems. In: Proceedings of the 17th international conference on mining software repositories, MSR \u201920. https:\/\/doi.org\/10.1145\/3379597.3387459. Association for Computing Machinery, New York, pp 137\u2013146","DOI":"10.1145\/3379597.3387459"},{"key":"10183_CR77","doi-asserted-by":"crossref","unstructured":"Yasmin J, Sheikhaei M S, Tian Y (2022) A first look at duplicate and near-duplicate self-admitted technical debt comments. In: Proceedings of the 30th international conference on program comprehension, p page to appear","DOI":"10.1145\/3524610.3528387"},{"key":"10183_CR78","unstructured":"Yin D, Bond S D, Zhang H (2010) Are bad reviews always stronger than good? asymmetric negativity bias in the formation of online consumer trust. In: Sabherwal R, Sumner M (eds) Proceedings of the international conference on information systems, ICIS 2010, Saint Louis, Missouri, USA, December 12\u201315, 2010. http:\/\/aisel.aisnet.org\/icis2010_submissions\/193. Association for Information Systems, p 193"},{"key":"10183_CR79","doi-asserted-by":"crossref","unstructured":"Zampetti F, Noiseux C, Antoniol G, Khomh F, Di Penta M (2017) Recommending when design technical debt should be self-admitted. In: International conference on software maintenance and evolution. IEEE Computer Society, pp 216\u2013226","DOI":"10.1109\/ICSME.2017.44"},{"key":"10183_CR80","doi-asserted-by":"crossref","unstructured":"Zampetti F, Serebrenik A, Di Penta M (2018) Was self-admitted technical debt removal a real removal?: an in-depth perspective. In: Proceedings of the 15th international conference on mining software repositories, MSR 2018, Gothenburg, Sweden, May 28\u201329, 2018, pp 526\u2013536","DOI":"10.1145\/3196398.3196423"},{"key":"10183_CR81","doi-asserted-by":"crossref","unstructured":"Zampetti F, Serebrenik A, Di Penta M (2020) Automatically learning patterns for self-admitted technical debt removal. In: 2020 IEEE 27th International conference on software analysis, evolution and reengineering (SANER), pp 355\u2013366","DOI":"10.1109\/SANER48275.2020.9054868"},{"issue":"6","key":"10183_CR82","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1007\/s10664-021-10031-3","volume":"26","author":"F Zampetti","year":"2021","unstructured":"Zampetti F, Fucci G, Serebrenik A, Di Penta M (2021) Self-admitted technical debt practices: a comparison between industry and open-source. Empir Softw Eng 26(6):131. https:\/\/doi.org\/10.1007\/s10664-021-10031-3https:\/\/doi.org\/10.1007\/s10664-021-10031-3","journal-title":"Empir Softw Eng"},{"key":"10183_CR83","doi-asserted-by":"crossref","unstructured":"Zazworka N, Shaw M A, Shull F, Seaman C B (2011) Investigating the impact of design debt on software quality. In: Proceedings of the 2nd workshop on managing technical debt, MTD 2011, Waikiki, Honolulu, HI, USA, May 23, 2011, pp 17\u201323","DOI":"10.1145\/1985362.1985366"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10183-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-022-10183-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10183-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,29]],"date-time":"2024-09-29T22:15:45Z","timestamp":1727648145000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-022-10183-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,26]]},"references-count":83,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,11]]}},"alternative-id":["10183"],"URL":"https:\/\/doi.org\/10.1007\/s10664-022-10183-w","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,26]]},"assertion":[{"value":"20 May 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 July 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflicts of interest to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of Interest"}}],"article-number":"139"}}