{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T11:35:42Z","timestamp":1775561742726,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,17]]},"DOI":"10.1145\/3727967.3756825","type":"proceedings-article","created":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T11:53:17Z","timestamp":1766490797000},"page":"82-90","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Automating Requirements Classification: A Systematic Literature Review and Ensemble LLM-Based Approach"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3647-8511","authenticated-orcid":false,"given":"Mohamad","family":"Kassab","sequence":"first","affiliation":[{"name":"Boston University, Boston, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8855-1141","authenticated-orcid":false,"given":"Walid","family":"Belbach","sequence":"additional","affiliation":[{"name":"New York University Abu Dhabi, Abu Dhabi, United Arab Emirates"}]}],"member":"320","published-online":{"date-parts":[[2025,12,23]]},"reference":[{"key":"e_1_3_3_2_2_2","doi-asserted-by":"crossref","unstructured":"Abdelkareem\u00a0M Alashqar. 2022. Studying the commonalities mappings and relationships between non-functional requirements using machine learning. Science of Computer Programming 218 (2022) 102806.","DOI":"10.1016\/j.scico.2022.102806"},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIT58056.2023.10225936"},{"key":"e_1_3_3_2_4_2","unstructured":"T Brown B Mann N Ryder M Subbiah JD Kaplan P Dhariwal A Neelakantan P Shyam G Sastry A Askell et\u00a0al. 2020. Language models are few-shot learners advances in neural information processing systems 33. (2020)."},{"key":"e_1_3_3_2_5_2","doi-asserted-by":"crossref","unstructured":"Loredana Caruccio Stefano Cirillo Giuseppe Polese Giandomenico Solimando Shanmugam Sundaramurthy and Genoveffa Tortora. 2024. Claude 2.0 large language model: Tackling a real-world classification problem with a new iterative prompt engineering approach. Intelligent Systems with Applications 21 (2024) 200336.","DOI":"10.1016\/j.iswa.2024.200336"},{"key":"e_1_3_3_2_6_2","doi-asserted-by":"crossref","unstructured":"Agustin Casamayor Daniela Godoy and Marcelo Campo. 2010. Identification of non-functional requirements in textual specifications: A semi-supervised learning approach. Information and Software Technology 52 4 (2010) 436\u2013445.","DOI":"10.1016\/j.infsof.2009.10.010"},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"crossref","unstructured":"Betty\u00a0HC Cheng and Joanne\u00a0M Atlee. 2007. Research directions in requirements engineering. Future of software engineering (FOSE\u201907) (2007) 285\u2013303.","DOI":"10.1109\/FOSE.2007.17"},{"key":"e_1_3_3_2_8_2","volume-title":"Non-functional requirements in software engineering","author":"Chung Lawrence","year":"2012","unstructured":"Lawrence Chung, Brian\u00a0A Nixon, Eric Yu, and John Mylopoulos. 2012. Non-functional requirements in software engineering. Vol.\u00a05. Springer Science & Business Media."},{"key":"e_1_3_3_2_9_2","doi-asserted-by":"crossref","unstructured":"Jane Cleland-Huang Raffaella Settimi Xuchang Zou and Peter Solc. 2007. Automated classification of non-functional requirements. Requirements engineering 12 (2007) 103\u2013120.","DOI":"10.1007\/s00766-007-0045-1"},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.5555\/648054.743935"},{"key":"e_1_3_3_2_11_2","doi-asserted-by":"crossref","unstructured":"Tore Dyb\u00e5 and Torgeir Dings\u00f8yr. 2008. Empirical studies of agile software development: A systematic review. Information and software technology 50 9-10 (2008) 833\u2013859.","DOI":"10.1016\/j.infsof.2008.01.006"},{"key":"e_1_3_3_2_12_2","doi-asserted-by":"crossref","unstructured":"Alessio Ferrari and Paola Spoletini. 2025. Formal requirements engineering and large language models: A two-way roadmap. Information and Software Technology 181 (2025) 107697.","DOI":"10.1016\/j.infsof.2025.107697"},{"key":"e_1_3_3_2_13_2","first-page":"2857","volume-title":"REFSQ Workshops","author":"Gnanasekaran Rajesh\u00a0Kumar","year":"2021","unstructured":"Rajesh\u00a0Kumar Gnanasekaran, Suranjan Chakraborty, Josh Dehlinger, and Lin Deng. 2021. Using Recurrent Neural Networks for Classification of Natural Language-based Non-functional Requirements.. In REFSQ Workshops. 2857."},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.5555\/26775"},{"key":"e_1_3_3_2_15_2","doi-asserted-by":"crossref","unstructured":"Gordon Guyatt Drummond Rennie and S Satya-Murti. 2002. Users\u2019 guides to the medical literature: a manual for evidence-based clinical practice. JAMA-Journal of the American Medical Association-International Edition 287 11 (2002) 1463.","DOI":"10.1001\/jama.287.11.1464-JBK0320-3-1"},{"key":"e_1_3_3_2_16_2","doi-asserted-by":"crossref","unstructured":"Shabnam Hassani Mehrdad Sabetzadeh and Daniel Amyot. 2025. An empirical study on LLM-based classification of requirements-related provisions in food-safety regulations. Empirical Software Engineering 30 3 (2025) 72.","DOI":"10.1007\/s10664-025-10619-z"},{"key":"e_1_3_3_2_17_2","doi-asserted-by":"crossref","unstructured":"Arshia Hemmat Mohammadreza Sharbaf Shekoufeh Kolahdouz-Rahimi Kevin Lano and Sobhan\u00a0Y Tehrani. 2025. Research directions for using LLM in software requirement engineering: a systematic review. Frontiers in Computer Science 7 (2025) 1519437.","DOI":"10.3389\/fcomp.2025.1519437"},{"key":"e_1_3_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/RE48521.2020.00028"},{"key":"e_1_3_3_2_19_2","doi-asserted-by":"crossref","unstructured":"Joachim Karlsson and Kevin Ryan. 1997. A cost-value approach for prioritizing requirements. IEEE software 14 5 (1997) 67\u201374.","DOI":"10.1109\/52.605933"},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"crossref","unstructured":"Mohamad Kassab and Phillip Laplante. 2022. The current and evolving landscape of requirements engineering in practice. IEEE Software 39 5 (2022) 76\u201383.","DOI":"10.1109\/MS.2022.3147692"},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/CSIE.2009.946"},{"key":"e_1_3_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSEA.2009.50"},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"crossref","unstructured":"Kamaljit Kaur and Parminder Kaur. 2023. BERT-CNN: improving BERT for requirements classification using CNN. Procedia Computer Science 218 (2023) 2604\u20132611.","DOI":"10.1016\/j.procs.2023.01.234"},{"key":"e_1_3_3_2_24_2","volume-title":"Guidelines for performing systematic literature reviews in software engineering","author":"Keele Staffs","year":"2007","unstructured":"Staffs Keele et\u00a0al. 2007. Guidelines for performing systematic literature reviews in software engineering. Technical Report. Technical report, ver. 2.3 ebse technical report. ebse."},{"key":"e_1_3_3_2_25_2","doi-asserted-by":"crossref","unstructured":"Barbara Kitchenham O\u00a0Pearl Brereton David Budgen Mark Turner John Bailey and Stephen Linkman. 2009. Systematic literature reviews in software engineering\u2013a systematic literature review. Information and software technology 51 1 (2009) 7\u201315.","DOI":"10.1016\/j.infsof.2008.09.009"},{"key":"e_1_3_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/RE.2017.82"},{"key":"e_1_3_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/RE.2017.57"},{"key":"e_1_3_3_2_28_2","doi-asserted-by":"crossref","unstructured":"Gang Li Chengpeng Zheng Min Li and Haosen Wang. 2022. Automatic requirements classification based on graph attention network. IEEE Access 10 (2022) 30080\u201330090.","DOI":"10.1109\/ACCESS.2022.3159238"},{"key":"e_1_3_3_2_29_2","doi-asserted-by":"crossref","unstructured":"Tom Lieberum Senthooran Rajamanoharan Arthur Conmy Lewis Smith Nicolas Sonnerat Vikrant Varma J\u00e1nos Kram\u00e1r Anca Dragan Rohin Shah and Neel Nanda. 2024. Gemma scope: Open sparse autoencoders everywhere all at once on gemma 2. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2408.05147 (2024).","DOI":"10.18653\/v1\/2024.blackboxnlp-1.19"},{"key":"e_1_3_3_2_30_2","doi-asserted-by":"crossref","unstructured":"Anas Mahmoud and Grant Williams. 2016. Detecting classifying and tracing non-functional software requirements. Requirements Engineering 21 (2016) 357\u2013381.","DOI":"10.1007\/s00766-016-0252-8"},{"key":"e_1_3_3_2_31_2","doi-asserted-by":"crossref","unstructured":"Nuno Marques Rodrigo\u00a0Rocha Silva and Jorge Bernardino. 2024. Using chatgpt in software requirements engineering: A comprehensive review. Future Internet 16 6 (2024) 180.","DOI":"10.3390\/fi16060180"},{"key":"e_1_3_3_2_32_2","doi-asserted-by":"crossref","unstructured":"Pl\u00e1cido A\u00a0Souza Neto Genoveva Vargas-Solar Umberto\u00a0Souza da Costa and Martin\u00a0A Musicante. 2016. Designing service-based applications in the presence of non-functional properties: A mapping study. Information and Software Technology 69 (2016) 84\u2013105.","DOI":"10.1016\/j.infsof.2015.09.004"},{"key":"e_1_3_3_2_33_2","volume-title":"IBM blockchain in healthcare rallies for patients","author":"Nichol Peter\u00a0B.","year":"2016","unstructured":"Peter\u00a0B. Nichol. 2016. IBM blockchain in healthcare rallies for patients."},{"key":"e_1_3_3_2_34_2","doi-asserted-by":"crossref","unstructured":"Abdur Rahman Abu Nayem and Saeed Siddik. 2023. Non-Functional Requirements Classification Using Machine Learning Algorithms. International Journal of Intelligent Systems and Applications 15 3 (2023) 56\u201369.","DOI":"10.5815\/ijisa.2023.03.05"},{"key":"e_1_3_3_2_35_2","unstructured":"Paul Ralph Nauman\u00a0bin Ali Sebastian Baltes Domenico Bianculli Jessica Diaz Yvonne Dittrich Neil Ernst Michael Felderer Robert Feldt Antonio Filieri et\u00a0al. 2020. Empirical standards for software engineering research. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2010.03525 (2020)."},{"key":"e_1_3_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2013.64"},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/iNIS.2016.054"},{"key":"e_1_3_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCIT60459.2023.10441143"},{"key":"e_1_3_3_2_39_2","unstructured":"Hugo Touvron Louis Martin Kevin Stone Peter Albert Amjad Almahairi Yasmine Babaei Nikolay Bashlykov Soumya Batra Prajjwal Bhargava Shruti Bhosale et\u00a0al. 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2307.09288 (2023)."},{"key":"e_1_3_3_2_40_2","first-page":"249","volume-title":"Proceedings fifth ieee international symposium on requirements engineering","author":"Van\u00a0Lamsweerde Axel","year":"2001","unstructured":"Axel Van\u00a0Lamsweerde. 2001. Goal-oriented requirements engineering: A guided tour. In Proceedings fifth ieee international symposium on requirements engineering. IEEE, 249\u2013262."},{"key":"e_1_3_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.15439\/2022F140"},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"crossref","unstructured":"David\u00a0H Wolpert. 1992. Stacked generalization. Neural networks 5 2 (1992) 241\u2013259.","DOI":"10.1016\/S0893-6080(05)80023-1"},{"key":"e_1_3_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.18293\/SEKE2015-063"},{"key":"e_1_3_3_2_44_2","doi-asserted-by":"crossref","unstructured":"Muhammad Younas Karzan Wakil Dayang\u00a0NA Jawawi Muhammad\u00a0Arif Shah and Mustafa Ahmad. 2019. An automated approach for identification of non-functional requirements using Word2Vec model. International Journal of Advanced Computer Science and Applications 10 8 (2019).","DOI":"10.14569\/IJACSA.2019.0100871"},{"key":"e_1_3_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-88531-0_15"}],"event":{"name":"EASE Companion '25: Evaluation and Assessment in Software Engineering","location":"Istanbul Turkiye","acronym":"EASE Companion '25"},"container-title":["Proceedings of the 2025 29th International Conference on Evaluation and Assessment in Software Engineering Companion"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3727967.3756825","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T12:08:21Z","timestamp":1766491701000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3727967.3756825"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,17]]},"references-count":44,"alternative-id":["10.1145\/3727967.3756825","10.1145\/3727967"],"URL":"https:\/\/doi.org\/10.1145\/3727967.3756825","relation":{},"subject":[],"published":{"date-parts":[[2025,6,17]]},"assertion":[{"value":"2025-12-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}