{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T17:27:43Z","timestamp":1776101263166,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":45,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,4,14]],"date-time":"2024-04-14T00:00:00Z","timestamp":1713052800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,4,14]]},"DOI":"10.1145\/3639476.3639777","type":"proceedings-article","created":{"date-parts":[[2024,5,24]],"date-time":"2024-05-24T15:15:01Z","timestamp":1716563701000},"page":"6-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Exploring ChatGPT for Toxicity Detection in GitHub"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-4859-4429","authenticated-orcid":false,"given":"Shyamal","family":"Mishra","sequence":"first","affiliation":[{"name":"Drexel University, Philadelphia, Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3057-7807","authenticated-orcid":false,"given":"Preetha","family":"Chatterjee","sequence":"additional","affiliation":[{"name":"Drexel University, Philadelphia, Pennsylvania, United States of America"}]}],"member":"320","published-online":{"date-parts":[[2024,5,24]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377816.3381732"},{"key":"e_1_3_2_1_2_1","unstructured":"\"What it feels like to be an open-source maintainer \" https:\/\/nolanlawson.com\/2017\/03\/05\/what-it-feels-like-to-be-an-open-source-maintainer\/ 2017 [Online; accessed 2-Jun-2023]."},{"key":"e_1_3_2_1_3_1","unstructured":"J. Lehnardt \"Sustainable Open Source: The Maintainers Perspective or: How I Learned to Stop Caring and Love Open Source \" https:\/\/writing.jan.io\/2017\/03\/06\/sustainable-open-source-the-maintainers-perspective-or-how-i-learned-to-stop-caring-and-love-open-source.html 2017 [Online; accessed 4-Jun-2023]."},{"key":"e_1_3_2_1_4_1","first-page":"710","volume-title":"did you miss my comment or what?\" understanding toxicity in open source discussions,\" in 2022 IEEE\/ACM 44th International Conference on Software Engineering (ICSE)","author":"Miller C.","year":"2022","unstructured":"C. Miller, S. Cohen, D. Klug, B. Vasilescu, and C. K\u00e4stner, \"\"did you miss my comment or what?\" understanding toxicity in open source discussions,\" in 2022 IEEE\/ACM 44th International Conference on Software Engineering (ICSE), 2022, pp. 710--722."},{"key":"e_1_3_2_1_5_1","first-page":"1","volume-title":"The \"shut the f**k up\" phenomenon: Characterizing incivility in open source code review discussions","author":"Ferreira I.","year":"2021","unstructured":"I. Ferreira, J. Cheng, and B. Adams, \"The \"shut the f**k up\" phenomenon: Characterizing incivility in open source code review discussions,\" vol. 5, pp. 1--35, 2021-10-13. [Online]. Available: http:\/\/arxiv.org\/abs\/2108.09905"},{"key":"e_1_3_2_1_6_1","first-page":"309","volume-title":"How heated is it? understanding GitHub locked issues,\" in Proceedings of the 19th International Conference on Mining Software Repositories","author":"Ferreira I.","year":"2022","unstructured":"I. Ferreira, B. Adams, and J. Cheng, \"How heated is it? understanding GitHub locked issues,\" in Proceedings of the 19th International Conference on Mining Software Repositories, 2022-05-23, pp. 309--320. [Online]. Available: http:\/\/arxiv.org\/abs\/2204.00155"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555183"},{"key":"e_1_3_2_1_8_1","first-page":"11","volume-title":"May 2017","author":"Gachechiladze D.","unstructured":"D. Gachechiladze, F. Lanubile, N. Novielli, and A. Serebrenik, \"Anger and Its Direction in Collaborative Software Development,\" in 2017 IEEE\/ACM 39th International Conference on Software Engineering: New Ideas and Emerging Technologies Results Track (ICSE-NIER), May 2017, pp. 11--14."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3463274.3463805"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"R. Ehsani R. Rezapour and P. Chatterjee \"Exploring Moral Principles Exhibited in Software-related Text: A Case Study on GitHub Locked Issues \" in Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering: Ideas Visions and Reflections Track ser. FSE '23 2023.","DOI":"10.1145\/3611643.3613077"},{"key":"e_1_3_2_1_11_1","unstructured":"GitHub \"Open Source Survey \" https:\/\/opensourcesurvey.org\/2017\/ 2017 [Online; accessed 22-May-2023]."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380414"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","unstructured":"H. S. Qiu B. Vasilescu C. K\u00e4stner C. Egelman C. Jaspan and E. Murphy-Hill \"Detecting interpersonal conflict in issues and code review: cross pollinating open- and closed-source approaches \" in Proceedings of the 2022 ACM\/IEEE 44th International Conference on Software Engineering: Software Engineering in Society ser. ICSE-SEIS '22. Association for Computing Machinery 2023-05-08 pp. 41--55. [Online]. 10.1145\/3510458.3513019","DOI":"10.1145\/3510458.3513019"},{"key":"e_1_3_2_1_14_1","first-page":"303","volume-title":"MSR '15","author":"Ortu M.","year":"2015","unstructured":"M. Ortu, B. Adams, G. Destefanis, P. Tourani, M. Marchesi, and R. Tonelli, \"Are bullies more productive? empirical study of affectiveness vs. issue fixing time,\" in Proceedings of the 12th Working Conference on Mining Software Repositories, ser. MSR '15. IEEE Press, 2015, p. 303--313."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.73"},{"key":"e_1_3_2_1_16_1","unstructured":"\"GiHub Conversations Locking \" https:\/\/github.blog\/2014-06-09-locking-conversations\/ 2014 [Online; accessed 7-Jun-2023]."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"I. Ferreira A. Rafiq and J. Cheng \"Incivility detection in open source code review and issue discussions \" 2022-07-07. [Online]. Available: https:\/\/papers.ssrn.com\/abstract=4156317","DOI":"10.2139\/ssrn.4156317"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3583562"},{"key":"e_1_3_2_1_19_1","volume-title":"A benchmark study of the contemporary toxicity detectors on software engineering interactions,\" no. arXiv:2009.09331","author":"Sarker J.","year":"2020","unstructured":"J. Sarker, A. K. Turzo, and A. Bosu, \"A benchmark study of the contemporary toxicity detectors on software engineering interactions,\" no. arXiv:2009.09331, 2020-09-19. [Online]. Available: http:\/\/arxiv.org\/abs\/2009.09331"},{"key":"e_1_3_2_1_20_1","volume-title":"Data augmentation for improving emotion recognition in software engineering communication,\" in 37th IEEE\/ACM International Conference on Automated Software Engineering","author":"Imran M. M.","year":"2022","unstructured":"M. M. Imran, Y. Jain, P. Chatterjee, and K. Damevski, \"Data augmentation for improving emotion recognition in software engineering communication,\" in 37th IEEE\/ACM International Conference on Automated Software Engineering, 2022."},{"key":"e_1_3_2_1_21_1","volume-title":"Bert-based sentiment analysis: A software engineering perspective,\" in International Conference on DEXA","author":"Batra H.","year":"2021","unstructured":"H. Batra, N. S. Punn, S. K. Sonbhadra, and S. Agarwal, \"Bert-based sentiment analysis: A software engineering perspective,\" in International Conference on DEXA, 2021."},{"key":"e_1_3_2_1_22_1","volume-title":"Achieving reliable sentiment analysis in the software engineering domain using bert,\" in 2020 IEEE ICSME","author":"Biswas E.","year":"2020","unstructured":"E. Biswas, M. E. Karabulut, L. Pollock, and K. Vijay-Shanker, \"Achieving reliable sentiment analysis in the software engineering domain using bert,\" in 2020 IEEE ICSME, 2020."},{"key":"e_1_3_2_1_23_1","volume-title":"Computing and Communication Technologies","author":"Kamath R.","year":"2022","unstructured":"R. Kamath, A. Ghoshal, S. Eswaran, and P. B. Honnavalli, \"Emoroberta: An enhanced emotion detection model using roberta,\" in IEEE International Conference on Electronics, Computing and Communication Technologies, 2022."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"C. Liu M. Osama and A. De Andrade \"Dens: A dataset for multi-class emotion analysis \" in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) 2019 pp. 6293--6298.","DOI":"10.18653\/v1\/D19-1656"},{"key":"e_1_3_2_1_25_1","volume-title":"Who answers it better? an in-depth analysis of chatgpt and stack overflow answers to software engineering questions","author":"Kabir S.","year":"2023","unstructured":"S. Kabir, D. N. Udo-Imeh, B. Kou, and T. Zhang, \"Who answers it better? an in-depth analysis of chatgpt and stack overflow answers to software engineering questions,\" 2023."},{"key":"e_1_3_2_1_26_1","volume-title":"Large language models for software engineering: A systematic literature review","author":"Hou X.","year":"2023","unstructured":"X. Hou, Y. Zhao, Y. Liu, Z. Yang, K. Wang, L. Li, X. Luo, D. Lo, J. Grundy, and H. Wang, \"Large language models for software engineering: A systematic literature review,\" 2023."},{"key":"e_1_3_2_1_27_1","volume-title":"Sentiment analysis in the era of large language models: A reality check","author":"Zhang W.","year":"2023","unstructured":"W. Zhang, Y. Deng, B. Liu, S. J. Pan, and L. Bing, \"Sentiment analysis in the era of large language models: A reality check,\" 2023."},{"key":"e_1_3_2_1_28_1","volume-title":"Large language models for software engineering: Survey and open problems","author":"Fan A.","year":"2023","unstructured":"A. Fan, B. Gokkaya, M. Harman, M. Lyubarskiy, S. Sengupta, S. Yoo, and J. M. Zhang, \"Large language models for software engineering: Survey and open problems,\" 2023."},{"key":"e_1_3_2_1_29_1","first-page":"4130","volume-title":"Verification and Validation Workshops (ICSTW)","author":"Jalil S.","year":"2023","unstructured":"S. Jalil, S. Rafi, T. D. LaToza, K. Moran, and W. Lam, \"Chatgpt and software testing education: Promises & perils,\" in 2023 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2023, pp. 4130--4137."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3543873.3587368"},{"key":"e_1_3_2_1_31_1","volume-title":"hot\" chatgpt: The promise of chatgpt in detecting and discriminating hateful, offensive, and toxic comments on social media","author":"Li L.","year":"2023","unstructured":"L. Li, L. Fan, S. Atreja, and L. Hemphill, \"\"hot\" chatgpt: The promise of chatgpt in detecting and discriminating hateful, offensive, and toxic comments on social media,\" 2023."},{"key":"e_1_3_2_1_32_1","volume-title":"You only prompt once: On the capabilities of prompt learning on large language models to tackle toxic content","author":"He X.","year":"2023","unstructured":"X. He, S. Zannettou, Y. Shen, and Y. Zhang, \"You only prompt once: On the capabilities of prompt learning on large language models to tackle toxic content,\" 2023."},{"key":"e_1_3_2_1_33_1","volume-title":"Can large language models transform computational social science?","author":"Ziems C.","year":"2023","unstructured":"C. Ziems, W. Held, O. Shaikh, J. Chen, Z. Zhang, and D. Yang, \"Can large language models transform computational social science?\" 2023."},{"key":"e_1_3_2_1_34_1","unstructured":"OpenAI \"Chatgpt \" https:\/\/openai.com\/blog\/chatgpt 2023."},{"key":"e_1_3_2_1_35_1","volume-title":"Impli: Investigating nli models' performance on figurative language,\" in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics","author":"Stowe K.","year":"2022","unstructured":"K. Stowe, P. Utama, and I. Gurevych, \"Impli: Investigating nli models' performance on figurative language,\" in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, 2022."},{"key":"e_1_3_2_1_36_1","volume-title":"Pie: A parallel idiomatic expression corpus for idiomatic sentence generation and paraphrasing,\" in Proceedings of the 17th Workshop on Multiword Expressions (MWE","author":"Zhou J.","year":"2021","unstructured":"J. Zhou, H. Gong, and S. Bhat, \"Pie: A parallel idiomatic expression corpus for idiomatic sentence generation and paraphrasing,\" in Proceedings of the 17th Workshop on Multiword Expressions (MWE 2021), 2021."},{"key":"e_1_3_2_1_37_1","volume-title":"Magpie: A large corpus of potentially idiomatic expressions,\" in Proceedings of The 12th Language Resources and Evaluation Conference","author":"Haagsma H.","year":"2020","unstructured":"H. Haagsma, J. Bos, and M. Nissim, \"Magpie: A large corpus of potentially idiomatic expressions,\" in Proceedings of The 12th Language Resources and Evaluation Conference, 2020."},{"key":"e_1_3_2_1_38_1","volume-title":"A prompt pattern catalog to enhance prompt engineering with chatgpt","author":"White J.","year":"2023","unstructured":"J. White, Q. Fu, S. Hays, M. Sandborn, C. Olea, H. Gilbert, A. Elnashar, J. Spencer-Smith, and D. C. Schmidt, \"A prompt pattern catalog to enhance prompt engineering with chatgpt,\" 2023."},{"key":"e_1_3_2_1_39_1","unstructured":"Conversationai. (n.d.) GitHub. [Online]. Available: https:\/\/github.com\/conversationai\/conversationai.github.io\/blob\/main\/crowdsourcing_annotation_schemes\/toxicity_with_subattributes.md"},{"key":"e_1_3_2_1_40_1","volume-title":"Llm is like a box of chocolates: the non-determinism of chatgpt in code generation","author":"Ouyang S.","year":"2023","unstructured":"S. Ouyang, J. M. Zhang, M. Harman, and M. Wang, \"Llm is like a box of chocolates: the non-determinism of chatgpt in code generation,\" 2023."},{"key":"e_1_3_2_1_41_1","unstructured":"O. Platform. (n.d.). [Online]. Available: https:\/\/platform.openai.com\/docs\/guides\/gpt\/managing-tokens"},{"key":"e_1_3_2_1_42_1","unstructured":"OpenAI. (n.d.) Managing tokens. OpenAI Documentation. [Online]. Available: https:\/\/platform.openai.com\/docs\/guides\/gpt\/managing-tokens"},{"key":"e_1_3_2_1_43_1","first-page":"1260","volume-title":"Automatic extraction of opinion-based Q&A from online developer chats,\" in Proceedings of the 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE)","author":"Chatterjee P.","year":"2021","unstructured":"P. Chatterjee, K. Damevski, and L. Pollock, \"Automatic extraction of opinion-based Q&A from online developer chats,\" in Proceedings of the 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE), 2021, pp. 1260--1272."},{"key":"e_1_3_2_1_44_1","volume-title":"Chat activity is a better predictor than chat sentiment on software developers productivity,\" Proceedings of the IEEE\/ACM 42nd International Conference on Software Engineering Workshops","author":"Kuutila M.","year":"2020","unstructured":"M. Kuutila, M. M\u00e4ntyl\u00e4, and M. Claes, \"Chat activity is a better predictor than chat sentiment on software developers productivity,\" Proceedings of the IEEE\/ACM 42nd International Conference on Software Engineering Workshops, 2020."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593434.3593463"}],"event":{"name":"ICSE-NIER'24: 2024 ACM\/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results","location":"Lisbon Portugal","acronym":"ICSE-NIER'24","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS","Faculty of Engineering of University of Porto"]},"container-title":["Proceedings of the 2024 ACM\/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639476.3639777","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3639476.3639777","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:53:39Z","timestamp":1750287219000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639476.3639777"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,14]]},"references-count":45,"alternative-id":["10.1145\/3639476.3639777","10.1145\/3639476"],"URL":"https:\/\/doi.org\/10.1145\/3639476.3639777","relation":{},"subject":[],"published":{"date-parts":[[2024,4,14]]},"assertion":[{"value":"2024-05-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}