{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:09:50Z","timestamp":1750219790704,"version":"3.41.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,10,13]],"date-time":"2023-10-13T00:00:00Z","timestamp":1697155200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2023,10,13]]},"abstract":"<jats:p>Natural language processing (NLP) involves the automated anal- ysis and manipulation of human language. This includes algo- rithms that can analyze text created by humans and algorithms that can generate text that appears natural. Nowadays, NLP methods are becoming increasingly prevalent to enhance various aspects of software development. Indeed, throughout the software development lifecycle, numerous natural language artifacts are produced. Therefore, the existence of NLP-based approaches and tools has opened up possibilities for improving the e ectiveness and productivity of software engineers, processes, and products. The second edition of the Natural Language-Based Software Engi- neering Workshop (NLBSE) took place in 2023 alongside the 45th International Conference on Software Engineering (ICSE 2023), where the research community engaged in discussions about these approaches. This event brought together researchers and practi- tioners from the elds of NLP and software engineering to ex- change experiences, establish future research directions, and pro- mote the adoption of NLP techniques and tools in tackling chal- lenges speci c to software engineering. In this paper, we present a summary of the 2nd edition of the workshop, which comprised three full papers, four short\/position papers, ve tool competi- tion\/demonstration papers, two keynote talks (\\Automated Bug Management: Re ections &amp; the Road Ahead\" by David Lo and \\Trends and Opportunities in the Application of Large Language Models: the Quest for Maximum E ect\" by Albert Ziegler), fol- lowed by extensive discussion among NLBSE participants. More details can be found at https:\/\/nlbse2023.github.io\/index. html<\/jats:p>","DOI":"10.1145\/3617946.3617957","type":"journal-article","created":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T18:15:30Z","timestamp":1697566530000},"page":"60-63","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Summary of the 2nd Natural Language-based Software Engineering Workshop (NLBSE 2023)"],"prefix":"10.1145","volume":"48","author":[{"given":"Sebastiano","family":"Panichella","sequence":"first","affiliation":[{"name":"Zurich University of Applied Sciences, Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Di Sorbo","sequence":"additional","affiliation":[{"name":"University of Sannio, Benevento, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,17]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3069248"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/NLBSE59153.2023.00008"},{"key":"e_1_2_1_3_1","first-page":"2023","volume-title":"2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023","author":"Al-Kaswan Ali","year":"2023","unstructured":"Ali Al-Kaswan, Maliheh Izadi, and Arie van Deursen. STACC: Code Comment Classi cation using Sentence Transformers. In 2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023, Melbourne, Australia, May 20, 2023, page To appear, 2023."},{"key":"e_1_2_1_4_1","first-page":"2100","volume-title":"Proceedings of the 33nd International Conference on Machine Learning, ICML 2016","author":"Allamanis Miltiadis","year":"2016","unstructured":"Miltiadis Allamanis, Hao Peng, and Charles Sutton. A convolutional attention network for extreme summarization of source code. In Proceedings of the 33nd International Conference on Machine Learning, ICML 2016, New York City, NY, USA, June 19--24, 2016, pages 2091{2100, 2016."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.301"},{"key":"e_1_2_1_6_1","first-page":"154","volume-title":"ECSA 2017, Canterbury, UK, September 11--15, 2017","author":"Bhat Manoj","year":"2017","unstructured":"Manoj Bhat, Klym Shumaiev, Andreas Biesdorf, Uwe Hohenstein, and Florian Matthes. Automatic extraction of design decisions from issue management systems: A machine learning based approach. In Software Architecture - 11th European Conference, ECSA 2017, Canterbury, UK, September 11--15, 2017, Proceedings, pages 138{154, 2017."},{"key":"e_1_2_1_7_1","first-page":"2023","volume-title":"2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023","author":"Colavito Giuseppe","year":"2023","unstructured":"Giuseppe Colavito, Filippo Lanubile, and Nicole Novielli. Few-Shot Learning for Issue Report Classi cation. In 2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023, Melbourne, Australia, May 20, 2023, page To appear, 2023."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2009.28"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2018.3571242"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2950290.2950299"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.12"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2930519"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME52107.2021.00058"},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Andrea Di Sorbo Fiorella Zampetti Aaron Visaggio Massimiliano Di Penta and Sebastiano Panichella. Automated identi cation and qualitative characterization of safety concerns reported in uav software platforms. ACM Trans. Softw. Eng. Methodol. 32(3) apr 2023.","DOI":"10.1145\/3564821"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/NLBSE59153.2023.00016"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/5254.912386"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2020.106321"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2020.106373"},{"key":"e_1_2_1_19_1","first-page":"2023","volume-title":"2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023","author":"Indika Amila","year":"2023","unstructured":"Amila Indika, Peter Y. Washington, and Anthony Peruma. Performance Comparison of Binary Machine Learning Classi ers in Identifying Code Comment Types: An Exploratory Study. In 2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023, Melbourne, Australia, May 20, 2023, page To appear, 2023."},{"key":"e_1_2_1_20_1","first-page":"146","volume-title":"Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering, ASE 2017","author":"Jiang Siyuan","year":"2017","unstructured":"Siyuan Jiang, Ameer Armaly, and Collin McMillan. Automatically generating commit messages from di s using neural machine translation. In Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering, ASE 2017, Urbana, IL, USA, October 30 - November 03, 2017, pages 135{146, 2017."},{"key":"e_1_2_1_21_1","first-page":"28","volume-title":"2022 IEEE\/ACM 1st International Workshop on Natural Language-Based Software Engineering (NLBSE 2022), Co-located with ICSE 2022","author":"Kallis Rafael","year":"2022","unstructured":"Rafael Kallis, Oscar Chaparro, Andrea Di Sorbo, and Sebastiano Panichella. Nlbse'22 tool competition. In 2022 IEEE\/ACM 1st International Workshop on Natural Language-Based Software Engineering (NLBSE 2022), Co-located with ICSE 2022, Pittsburgh, PA, USA, May 8, 2022, pages 25{28. IEEE, 2022."},{"key":"e_1_2_1_22_1","first-page":"2023","volume-title":"2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023","author":"Kallis Rafael","year":"2023","unstructured":"Rafael Kallis, Maliheh Izadi, Luca Pascarella, Oscar Chaparro, and Pooja Rani. The nlbse'23 tool competition. In 2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023, Melbourne, Australia, May 20, 2023, page To appear, 2023."},{"key":"e_1_2_1_23_1","first-page":"2023","volume-title":"2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023","author":"Krasniqi Rrezarta","year":"2023","unstructured":"Rrezarta Krasniqi and Hyunsook Do. Exploring generalizability of nlp-based models for modern software development cross-domain environments. In 2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023, Melbourne, Australia, May 20, 2023, page To appear, 2023."},{"key":"e_1_2_1_24_1","first-page":"2023","volume-title":"Laiq. An Intelligent Tool for Classifying Issue Reports. In 2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023","author":"Muhammad","year":"2023","unstructured":"Muhammad Laiq. An Intelligent Tool for Classifying Issue Reports. In 2023 IEEE\/ACM 2nd International Workshop on Natural Language-Based Software Engineering (NLBSE 2023), Co-located with ICSE 2023, Melbourne, Australia, May 20, 2023, page To appear, 2023."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00087"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/NLBSE59153.2023.00013"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/NLBSE59153.2023.00019"},{"key":"e_1_2_1_28_1","first-page":"260","volume-title":"30th IEEE International Conference on Software Maintenance and Evolution, Victoria, BC","author":"Panichella Sebastiano","year":"2014","unstructured":"Sebastiano Panichella, Gabriele Bavota, Massimiliano Di Penta, Gerardo Canfora, and Giuliano Antoniol. How developers' collaborations identi ed from di erent sources tell us about code changes. In 30th IEEE International Conference on Software Maintenance and Evolution, Victoria, BC, Canada, September 29 - October 3, 2014, pages 251{260, 2014."},{"key":"e_1_2_1_29_1","first-page":"290","volume-title":"2015 IEEE International Conference on Software Maintenance and Evolution, ICSME 2015","author":"Panichella Sebastiano","year":"2015","unstructured":"Sebastiano Panichella, Andrea Di Sorbo, Emitza Guzman, Corrado Aaron Visaggio, Gerardo Canfora, and Harald C. Gall. How can i improve my app? classifying user reviews for software maintenance and evolution. In Rainer Koschke, Jens Krinke, and Martin P. Robillard, editors, 2015 IEEE International Conference on Software Maintenance and Evolution, ICSME 2015, Bremen, Germany, September 29 - October 1, 2015, pages 281{290. IEEE Computer Society, 2015."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-020-09870-3"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.4018\/IJSSCI.2020040101"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111047"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/NLBSE59153.2023.00018"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/NLBSE59153.2023.00015"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/NLBSE59153.2023.00017"},{"key":"e_1_2_1_36_1","volume-title":"ACM Computing Surveys","author":"Zhao Liping","year":"2020","unstructured":"Liping Zhao, Waad Alhoshan, Alessio Ferrari, Keletso J Letsholo, Muideen Ajagbe, Erol-Valeriu Chioasca, and Riza Theresa Batista-Navarro. Natural language processing (nlp) for requirements engineering (re): A systematic mapping study. ACM Computing Surveys, 2020."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2872971"}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617946.3617957","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3617946.3617957","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:58Z","timestamp":1750178278000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617946.3617957"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,13]]},"references-count":37,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,10,13]]}},"alternative-id":["10.1145\/3617946.3617957"],"URL":"https:\/\/doi.org\/10.1145\/3617946.3617957","relation":{},"ISSN":["0163-5948"],"issn-type":[{"type":"print","value":"0163-5948"}],"subject":[],"published":{"date-parts":[[2023,10,13]]},"assertion":[{"value":"2023-10-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}