{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T16:10:24Z","timestamp":1782835824099,"version":"3.54.5"},"reference-count":59,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,2,15]],"date-time":"2024-02-15T00:00:00Z","timestamp":1707955200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,15]],"date-time":"2024-02-15T00:00:00Z","timestamp":1707955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Requirement Analysis is the essential sub-field of requirements engineering (RE). From the last decade, numerous automatic techniques are widely exploited in requirements analysis. In this context, requirements identification and classification is challenging for RE community, especially in context of large corpus and app review. As a consequence, several Artificial Intelligence (AI) techniques such as Machine learning (ML), Deep learning (DL) and transfer learning (TL)) have been proposed to reduce the manual efforts of requirement engineer. Although, these approaches reported promising results than traditional automated techniques, but the knowledge of their applicability in real-life and actual use of these approaches is yet incomplete. The main objective of this paper is to systematically investigate and better understand the role of Artificial Intelligence (AI) techniques in identification and classification of software requirements. This study conducted a systematic literature review (SLR) and collect the primary studies on the use of AI techniques in requirements classification. (1) this study found that 60 studies are published that adopted automated techniques in requirements classification. The reported results indicate that transfer learning based approaches extensively used in classification and yielding most accurate results and outperforms the other ML and DL techniques. (2) The data extraction process of SLR indicates that Support Vector Machine (SVM) and Convolutional Neural Network (CNN) are widely used in selected studies. (3) Precision and Recall are the commonly used metrics for evaluating the performance of automated techniques. This paper revealed that while these AI approaches reported promising results in classification. The applicability of these existing techniques in complex and real-world settings has not been reported yet. This SLR calls for the urge for the close alliance between RE and AI techniques to handle the open issues confronted in the development of some real-world automated system.<\/jats:p>","DOI":"10.1007\/s10462-023-10667-1","type":"journal-article","created":{"date-parts":[[2024,2,15]],"date-time":"2024-02-15T18:02:16Z","timestamp":1708020136000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["The application of AI techniques in requirements classification: a systematic mapping"],"prefix":"10.1007","volume":"57","author":[{"given":"Kamaljit","family":"Kaur","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Parminder","family":"Kaur","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,2,15]]},"reference":[{"key":"10667_CR1","doi-asserted-by":"crossref","unstructured":"Abad ZSH, Karras O, Ghazi P, Glinz M, Ruhe G, Schneider K (2017) What works better? A study of classifying requirements. In: 2017 IEEE 25th international requirements engineering conference (RE), pp 496\u201350. IEEE","DOI":"10.1109\/RE.2017.36"},{"key":"10667_CR2","volume-title":"Introduction to machine learning","author":"E Alpaydin","year":"2020","unstructured":"Alpaydin E (2020) Introduction to machine learning. MIT Press, Cambridge"},{"key":"10667_CR100","doi-asserted-by":"publisher","first-page":"8963","DOI":"10.1007\/s13369-019-04067-3","volume":"44","author":"MN Anwar Mohammad","year":"2019","unstructured":"Anwar Mohammad MN, Nazir M, Mustafa K (2019) A systematic review and analytical evaluation of security requirements engineering approaches. Arab J Sci Eng 44: 8963\u20138987.","journal-title":"Arab J Sci Eng"},{"issue":"1","key":"10667_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10515-021-00301-1","volume":"29","author":"AF Araujo","year":"2022","unstructured":"Araujo AF, G\u00f4lo MP, Marcacini RM (2022) Opinion mining for app reviews: an analysis of textual representation and predictive models. Autom Softw Eng 29(1):1\u201330. https:\/\/doi.org\/10.1007\/s10515-021-00301-1","journal-title":"Autom Softw Eng"},{"key":"10667_CR4","doi-asserted-by":"crossref","unstructured":"de Ara\u00fajo AF, Marcacini RM (2021) Re-bert: automatic extraction of software requirements from app reviews using bert language model. In: Proceedings of the 36th annual ACM symposium on applied computing, pp 1321\u20131327","DOI":"10.1145\/3412841.3442006"},{"key":"10667_CR5","doi-asserted-by":"publisher","first-page":"185619","DOI":"10.1109\/ACCESS.2020.3029634","volume":"8","author":"N Aslam","year":"2020","unstructured":"Aslam N, Ramay WY, Xia K, Sarwar N (2020) Convolutional neural network based classification of app reviews. IEEE Access 8:185619\u2013185628","journal-title":"IEEE Access"},{"key":"10667_CR6","doi-asserted-by":"publisher","unstructured":"Binkhonain, M., & Zhao, L. (2019). A review of machine learning algorithms for identification and classification of non-functional requirements. Expert Systems with Applications: X, 1. https:\/\/doi.org\/10.1016\/j.eswax.2019.100001","DOI":"10.1016\/j.eswax.2019.100001"},{"issue":"2","key":"10667_CR7","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1023\/A:1009715923555","volume":"2","author":"CJ Burges","year":"1998","unstructured":"Burges CJ (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2(2):121\u2013167","journal-title":"Data Min Knowl Disc"},{"issue":"4","key":"10667_CR8","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1016\/j.infsof.2009.10.010","volume":"52","author":"A Casamayor","year":"2010","unstructured":"Casamayor A, Godoy D, Campo M (2010) Identification of non-functional requirements in textual specifications: a semi-supervised learning approach. Inf Softw Technol 52(4):436\u2013445. https:\/\/doi.org\/10.1016\/j.infsof.2009.10.010","journal-title":"Inf Softw Technol"},{"key":"10667_CR9","unstructured":"Cavnar WB, Trenkle JM (1994) N-gram-based text categorization. In: Proceedings of SDAIR-94, 3rd annual symposium on document analysis and information retrieval, vol 161175"},{"key":"10667_CR10","unstructured":"Chen Y (2015) Convolutional neural network for sentence classification. Master\u2019s thesis, University of Waterloo"},{"key":"10667_CR11","unstructured":"Clark C, Lee K, Zettlemoyer L (2018) Deep contextualized word representations"},{"issue":"2","key":"10667_CR12","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1007\/s00766-007-0045-1","volume":"12","author":"J Cleland-Huang","year":"2007","unstructured":"Cleland-Huang J, Settimi R, Zou X, Solc P (2007) Automated classification of non-functional requirements. Requir Eng 12(2):103\u2013120. https:\/\/doi.org\/10.1007\/s00766-007-0045-1","journal-title":"Requir Eng"},{"issue":"2","key":"10667_CR13","first-page":"1","volume":"27","author":"J D\u0105browski","year":"2022","unstructured":"D\u0105browski J, Letier E, Perini A, Susi A (2022) Analyzing app reviews for software engineering: a systematic literature review. Empir Softw Eng 27(2):1\u201363","journal-title":"Empir Softw Eng"},{"key":"10667_CR14","doi-asserted-by":"crossref","unstructured":"Deocadez R, Harrison R, Rodriguez D (2017) Automatically classifying requirements from app stores: a preliminary study. In: 2017 IEEE 25th international requirements engineering conference workshops (REW), pp 367\u2013371. IEEE","DOI":"10.1109\/REW.2017.58"},{"issue":"4","key":"10667_CR15","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1007\/s00766-015-0222-6","volume":"21","author":"D Dermeval","year":"2016","unstructured":"Dermeval D, Vilela J, Bittencourt II, Castro J, Isotani S, Brito P, Silva A (2016) Applications of ontologies in requirements engineering: a systematic review of the literature. Requir Eng 21(4):405\u2013437","journal-title":"Requir Eng"},{"key":"10667_CR16","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding.\u00a0ArXiv preprint arXiv:1810.04805"},{"key":"10667_CR17","doi-asserted-by":"crossref","unstructured":"Duan S, Liu J, Peng Z (2022) RCBERT an approach with transfer learning for app reviews classification. In: Computer supported cooperative work and social computing: 16th CCF conference, ChineseCSCW 2021, Xiangtan, China, pp 444\u2013457, Springer","DOI":"10.1007\/978-981-19-4549-6_34"},{"key":"10667_CR18","unstructured":"Gershenson C (2003) Artificial neural networks for beginners.\u00a0arXiv preprint cs\/0308031"},{"key":"10667_CR19","doi-asserted-by":"publisher","unstructured":"Gu X, Kim S (2016) What parts of your apps are loved by users?In: Proceedings-2015 30th IEEE\/ACM international conference on automated software engineering, ASE 2015, pp 760\u2013770. https:\/\/doi.org\/10.1109\/ASE.2015.57","DOI":"10.1109\/ASE.2015.57"},{"key":"10667_CR20","doi-asserted-by":"crossref","unstructured":"Haque MA, Rahman MA, Siddik MS (2019) Non-functional requirements classification with feature extraction and machine learning: An empirical study. In: 2019 1st international conference on advances in science, engineering and robotics technology (ICASERT), pp 1\u20135. IEEE","DOI":"10.1109\/ICASERT.2019.8934499"},{"key":"10667_CR120","doi-asserted-by":"crossref","unstructured":"Henao PR, Fischbach J, Spies D, Frattini J, Vogelsang A (2021) September. Transfer learning for mining feature requests and bug reports from tweets and app store reviews. In 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW) (pp. 80\u201386). IEEE","DOI":"10.1109\/REW53955.2021.00019"},{"key":"10667_CR21","doi-asserted-by":"crossref","unstructured":"Hey T, Keim J, Koziolek A, Tichy WF (2020) Norbert: transfer learning for requirements classification. In: 2020 IEEE 28th international requirements engineering conference (RE), pp 169\u2013179. IEEE","DOI":"10.1109\/RE48521.2020.00028"},{"key":"10667_CR22","doi-asserted-by":"publisher","DOI":"10.1201\/b18678","volume-title":"Practical guide to logistic regression","author":"JM Hilbe","year":"2016","unstructured":"Hilbe JM (2016) Practical guide to logistic regression. CRC Press, Boca Raton"},{"key":"10667_CR23","doi-asserted-by":"crossref","unstructured":"Hochreiter S (1997) Long short-term memory. 1780:1735\u20131780","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"10667_CR24","doi-asserted-by":"publisher","first-page":"3659","DOI":"10.1007\/s10664-019-09716-7","volume":"24","author":"N Jha","year":"2019","unstructured":"Jha N, Mahmoud A (2019) Mining non-functional requirements from app store reviews. Empir Softw Eng 24:3659\u20133695","journal-title":"Empir Softw Eng"},{"issue":"6","key":"10667_CR25","first-page":"1930","volume":"2","author":"AG Jivani","year":"2011","unstructured":"Jivani AG (2011) A comparative study of stemming algorithms. Int J Comp Tech Appl 2(6):1930\u20131938","journal-title":"Int J Comp Tech Appl"},{"key":"10667_CR26","unstructured":"Joulin A, Grave E, Bojanowski P, Douze M, J\u00e9gou H, Mikolov T (2016) Fasttext. Zip: compressing text classification models.\u00a0arXiv preprint arXiv:1612.03651"},{"issue":"1","key":"10667_CR27","first-page":"4","volume":"1","author":"A Khan","year":"2010","unstructured":"Khan A, Baharudin B, Lee LH, Khan K (2010) A review of machine learning algorithms for text-documents classification. J Adv Inf Technol 1(1):4\u201320","journal-title":"J Adv Inf Technol"},{"key":"10667_CR28","unstructured":"Kitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering."},{"key":"10667_CR29","volume-title":"Requirements engineering: processes and techniques","author":"G Kotonya","year":"1998","unstructured":"Kotonya G, Sommerville I (1998) Requirements engineering: processes and techniques. Wiley, Hoboken"},{"key":"10667_CR30","doi-asserted-by":"crossref","unstructured":"Kurtanovi\u0107 Z, Maalej W (2017) Automatically classifying functional and non-functional requirements using supervised machine learning. In: 2017 IEEE 25th international requirements engineering conference (RE), pp 490\u2013495. IEEE","DOI":"10.1109\/RE.2017.82"},{"key":"10667_CR31","unstructured":"Laura I, Santi S (2017) Introduction to data science: a python approach to concepts, techniques and applications"},{"key":"10667_CR32","unstructured":"Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: International conference on machine learning, pp 1188\u20131196. PMLR"},{"key":"10667_CR34","doi-asserted-by":"crossref","unstructured":"Lewis DD (1998) Naive (Bayes) at forty: the independence assumption in information retrieval. In: European conference on machine learning, pp 4\u201315. Springer, Berlin, Heidelberg","DOI":"10.1007\/BFb0026666"},{"key":"10667_CR35","doi-asserted-by":"crossref","unstructured":"Lu M, Liang P (2017) Automatic classification of non-functional requirements from augmented app user reviews. In: Proceedings of the 21st international conference on evaluation and assessment in software engineering, pp 344\u2013353)","DOI":"10.1145\/3084226.3084241"},{"key":"10667_CR36","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1007\/s00766-016-0251-9","volume":"21","author":"W Maalej","year":"2016","unstructured":"Maalej W, Kurtanovi\u0107 Z, Nabil H, Stanik C (2016) On the automatic classification of app reviews. Requir Eng 21:311\u2013331","journal-title":"Requir Eng"},{"key":"10667_CR38","doi-asserted-by":"crossref","unstructured":"De Marneffe MC, Manning CD (2008) The Stanford typed dependencies representation. In: Coling 2008: proceedings of the workshop on cross-framework and cross-domain parser evaluation, pp 1\u20138","DOI":"10.3115\/1608858.1608859"},{"key":"10667_CR39","doi-asserted-by":"crossref","unstructured":"Marneffe MD, Manning CD (2008) The Stanford typed dependencies representation, pp 1\u20138","DOI":"10.3115\/1608858.1608859"},{"issue":"10","key":"10667_CR40","doi-asserted-by":"publisher","first-page":"1695","DOI":"10.1016\/j.infsof.2013.03.008","volume":"55","author":"H Meth","year":"2013","unstructured":"Meth H, Brhel M, Maedche A (2013) The state of the art in automated requirements elicitation. Inf Softw Technol 55(10):1695\u20131709","journal-title":"Inf Softw Technol"},{"key":"10667_CR41","unstructured":"Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. In: 1st international conference on learning representations, ICLR 2013-workshop track proceedings, pp 1\u201312"},{"key":"10667_CR42","unstructured":"Mining D, Discovery K, Laboratories B, Technologies L (1998) A tutorial on support vector machines for pattern recognition. 167:121\u2013167"},{"key":"10667_CR43","doi-asserted-by":"crossref","unstructured":"Navarro-Almanza R, Juarez-Ramirez R, Licea G (2017) Towards supporting software engineering using deep learning: a case of software requirements classification. In: 2017 5th international conference in software engineering research and innovation (CONISOFT), pp 116\u2013120. IEEE","DOI":"10.1109\/CONISOFT.2017.00021"},{"key":"10667_CR44","doi-asserted-by":"crossref","unstructured":"Nowak J, Taspinar A, Scherer R (2017) LSTM recurrent neural networks for short text and sentiment classification. In: International conference on artificial intelligence and soft computing, pp 553\u2013562. Springer, Cham","DOI":"10.1007\/978-3-319-59060-8_50"},{"issue":"3","key":"10667_CR45","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1109\/2.910904","volume":"34","author":"B Nuseibeh","year":"2001","unstructured":"Nuseibeh B (2001) Weaving together requirements and architectures. Computer 34(3):115\u2013119. https:\/\/doi.org\/10.1109\/2.910904","journal-title":"Computer"},{"key":"10667_CR46","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532\u20131543","DOI":"10.3115\/v1\/D14-1162"},{"key":"10667_CR47","doi-asserted-by":"crossref","unstructured":"P\u00e9rez-Verdejo JM, S\u00e1nchez-Garc\u00eda AJ, Ochar\u00e1n-Hern\u00e1ndez JO (2020) A systematic literature review on machine learning for automated requirements classification. In: 2020 8th international conference in software engineering research and innovation (CONISOFT), pp 21\u201328. IEEE","DOI":"10.1109\/CONISOFT50191.2020.00014"},{"key":"10667_CR48","unstructured":"Quinlan JR (1996) Bagging, boosting, and C4. 5. In: Aaai\/Iaai, vol 1, pp 725\u2013730"},{"key":"10667_CR49","doi-asserted-by":"crossref","unstructured":"Rashwan A, Ormandjieva O, Witte R (2013) Ontology-based classification of non-functional requirements in software specifications: a new corpus and svm-based classifier. In: 2013 IEEE 37th annual computer software and applications conference, pp 381\u2013386. IEEE","DOI":"10.1109\/COMPSAC.2013.64"},{"key":"10667_CR50","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Guestrin C (2016) \u201cWhy should i trust you\u202f?\u201d Explaining the predictions of any classifier. pp 1135\u20131144","DOI":"10.1145\/2939672.2939778"},{"key":"10667_CR51","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016) \u201cWhy should i trust you?\u201d Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 1135\u20131144","DOI":"10.1145\/2939672.2939778"},{"issue":"11","key":"10667_CR52","doi-asserted-by":"publisher","first-page":"2673","DOI":"10.1109\/78.650093","volume":"45","author":"M Schuster","year":"1997","unstructured":"Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. IEEE Trans Signal Process 45(11):2673\u20132681","journal-title":"IEEE Trans Signal Process"},{"key":"10667_CR53","doi-asserted-by":"publisher","DOI":"10.1109\/9780470187562","volume-title":"Software engineering: Barry W. Boehm's lifetime contributions to software development, management, and research","author":"RW Selby","year":"2007","unstructured":"Selby RW (2007) Software engineering: Barry W. Boehm\u2019s lifetime contributions to software development, management, and research. Wiley, Hoboken"},{"key":"10667_CR54","doi-asserted-by":"crossref","unstructured":"Slankas J, Williams L (2013) Automated extraction of non-functional requirements in available documentation. In: 2013 1st international workshop on natural language analysis in software engineering (NaturaLiSE), pp 9\u201316. IEEE","DOI":"10.1109\/NAturaLiSE.2013.6611715"},{"key":"10667_CR110","doi-asserted-by":"crossref","unstructured":"Stanik C, Haering M, Maalej W (2019) September. Classifying multilingual user feedback using traditional machine learning and deep learning. In 2019 IEEE 27th international requirements engineering conference workshops (REW) (pp. 220\u2013226). IEEE","DOI":"10.1109\/REW.2019.00046"},{"key":"10667_CR55","doi-asserted-by":"crossref","unstructured":"T\u00f3th L, Vid\u00e1cs L (2018) Study of various classifiers for identification and classification of non-functional requirements. In: Computational science and its applications\u2013ICCSA 2018: 18th international conference, Melbourne, Australia, pp 492\u2013503. Springer International Publishing","DOI":"10.1007\/978-3-319-95174-4_39"},{"key":"10667_CR56","volume-title":"Software requirements","author":"K Wiegers","year":"2013","unstructured":"Wiegers K, Beatty J (2013) Software requirements. Pearson Education, London"},{"key":"10667_CR57","doi-asserted-by":"crossref","unstructured":"Wohlin C (2014) Guidelines for snowballing in systematic literature studies and a replication in software engineering. In\u00a0Proceedings of the 18th international conference on evaluation and assessment in software engineering, pp 1\u201310","DOI":"10.1145\/2601248.2601268"},{"issue":"11","key":"10667_CR58","doi-asserted-by":"publisher","first-page":"7383","DOI":"10.1007\/s00521-019-04226-5","volume":"32","author":"M Younas","year":"2020","unstructured":"Younas M, Jawawi DNA, Ghani I, Shah MA (2020) Extraction of non-functional requirement using semantic similarity distance. Neural Comput Appl 32(11):7383\u20137397. https:\/\/doi.org\/10.1007\/s00521-019-04226-5","journal-title":"Neural Comput Appl"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-023-10667-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-023-10667-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-023-10667-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,11]],"date-time":"2024-11-11T14:52:59Z","timestamp":1731336779000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-023-10667-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,15]]},"references-count":59,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["10667"],"URL":"https:\/\/doi.org\/10.1007\/s10462-023-10667-1","relation":{},"ISSN":["1573-7462"],"issn-type":[{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,15]]},"assertion":[{"value":"15 February 2024","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have declared that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"57"}}