{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T15:48:34Z","timestamp":1778168914340,"version":"3.51.4"},"reference-count":57,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,2,12]],"date-time":"2025-02-12T00:00:00Z","timestamp":1739318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>In the digital era, cybersecurity is integral for preserving national security, digital privacy, and social sustainability. This research emphasizes the role of non-functional equirements (NFRs) in developing secure software systems that enhance societal wellbeing by ensuring data protection, user privacy, and system robustness. Specifically, this study introduces a proof-of-concept approach by leveraging machine learning (ML) models to classify NFRs and identify security-related issues early in the software development lifecycle. Two experiments were conducted to assess the effectiveness of different models for binary and multi-class classification tasks. In Experiment 1, BERT-based models and artificial neural networks (ANNs) were fine-tuned to classify NFRs into security and non-security categories using a dataset of 803 statements. BERT-based models outperformed ANNs, achieving higher accuracy, precision, recall, and ROC-AUC scores, with hyperparameter tuning further enhancing the results. Experiment 2 assessed logistic regression (LR), a support vector machine (SVM), and XGBoost for the multi-class classification of security-related NFRs into seven categories. The SVM and XGBoost showed strong performance, achieving high precision and recall in specific categories. The findings demonstrate the effectiveness of advanced ML models in automating NFR classification, improving software security, and supporting social sustainability. Future work will explore hybrid approaches to enhance scalability and accuracy.<\/jats:p>","DOI":"10.3390\/systems13020114","type":"journal-article","created":{"date-parts":[[2025,2,12]],"date-time":"2025-02-12T10:25:57Z","timestamp":1739355957000},"page":"114","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Enhancing Software Sustainability: Leveraging Large Language Models to Evaluate Security Requirements Fulfillment in Requirements Engineering"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7962-6943","authenticated-orcid":false,"given":"Ahmad F.","family":"Subahi","sequence":"first","affiliation":[{"name":"Department of Computer Science, University College of Al Jamoum, Umm Al-Qura University, Makkah 21421, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Saeed, S., Altamimi, S.A., Alkayyal, N.A., Alshehri, E., and Alabbad, D.A. (2023). Digital Transformation and Cybersecurity Challenges for Businesses Resilience: Issues and Recommendations. Sensors, 23.","DOI":"10.3390\/s23156666"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1007\/s10660-006-8677-7","article-title":"Security requirement analysis of business processes","volume":"6","author":"Herrmann","year":"2006","journal-title":"Electron. Comm. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1145\/772862.772866","article-title":"Database privacy: Balancing confidentiality, integrity and availability","volume":"4","author":"Olivier","year":"2002","journal-title":"ACM SIGKDD Explor. Newslett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1016\/j.jss.2017.12.005","article-title":"Characterizing the contribution of quality requirements to software sustainability","volume":"137","author":"Lago","year":"2018","journal-title":"J. Syst. Softw."},{"key":"ref_5","first-page":"100001","article-title":"A review of machine learning algorithms for identification and classification of non-functional requirements","volume":"1","author":"Binkhonain","year":"2019","journal-title":"Expert. Syst. Appl. X"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Canedo, E.D., and Mendes, B.C. (2020). Software requirements classification using machine learning algorithms. Entropy, 22.","DOI":"10.3390\/e22091057"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Baker, C., Deng, L., Chakraborty, S., and Dehlinger, J. (2019, January 15\u201319). Automatic multi-class non-functional software requirements classification using neural networks. Proceedings of the 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC), Milwaukee, WI, USA.","DOI":"10.1109\/COMPSAC.2019.10275"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"e2508","DOI":"10.1002\/smr.2508","article-title":"Automatic software vulnerability classification by extracting vulnerability triggers","volume":"36","author":"Sun","year":"2024","journal-title":"J. Softw. Evol. Process"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Marali, M., and Balakrishnan, K. (2022). Vulnerability Classification Based on Fine-Tuned BERT and Deep Neural Network Approaches. International Conference on Intelligent Systems and Sustainable Computing, Springer Nature.","DOI":"10.1007\/978-981-99-4717-1_24"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Purba, M.D., Ghosh, A., Radford, B.J., and Chu, B. (2023, January 9\u201312). Software vulnerability detection using large language models. Proceedings of the 2023 IEEE 34th International Symposium on Software Reliability Engineering Workshops (ISSREW), Florence, Italy.","DOI":"10.1109\/ISSREW60843.2023.00058"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Pan, C., Lu, M., and Xu, B. (2021). An empirical study on software defect prediction using codebert model. Appl. Sci., 11.","DOI":"10.3390\/app11114793"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Das, S.S., Serra, E., Halappanavar, M., Pothen, A., and Al-Shaer, E. (2021, January 6\u20139). V2w-bert: A framework for effective hierarchical multiclass classification of software vulnerabilities. Proceedings of the 2021 IEEE 8th International Conference on Data Science and Advanced Analytics (DSAA), Porto, Portugal.","DOI":"10.1109\/DSAA53316.2021.9564227"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ni, X., Zheng, J., Guo, Y., Jin, X., and Li, L. (2022, January 22\u201324). Predicting severity of software vulnerability based on BERT-CNN. Proceedings of the 2022 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI), Shijiazhuang, China.","DOI":"10.1109\/ICCEAI55464.2022.00151"},{"key":"ref_14","first-page":"26","article-title":"Developing risk assessment framework for wildfire in the United States\u2013A deep learning approach to safety and sustainability","volume":"1","author":"Hu","year":"2024","journal-title":"J. Saf. Sustain."},{"key":"ref_15","first-page":"4","article-title":"Monte carlo tree search-based deep reinforcement learning for flexible operation & maintenance optimization of a nuclear power plant","volume":"1","author":"Hao","year":"2024","journal-title":"J. Saf. Sustain."},{"key":"ref_16","first-page":"191","article-title":"STORE: Security threat oriented requirements engineering methodology","volume":"34","author":"Ansari","year":"2022","journal-title":"J. King Saud. Univ-Comput. Inf. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/s10207-019-00438-x","article-title":"TrUStAPIS: A trust requirements elicitation method for IoT","volume":"19","author":"Ferraris","year":"2020","journal-title":"Int. J. Inf. Secur."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kang, K.C., Cohen, S.G., Hess, J.A., Novak, W.E., and Peterson, A.S. (1990). Feature-Oriented Domain Analysis (FODA) Feasibility Study, Software Engineering Institute, Carnegie Mellon University. Available online: https:\/\/insights.sei.cmu.edu\/library\/feature-oriented-domain-analysis-foda-feasibility-study\/.","DOI":"10.21236\/ADA235785"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"de Almeida, M.G., and Canedo, E.D. (2022). Authentication and authorization in microservices architecture: A systematic literature review. Appl. Sci., 12.","DOI":"10.3390\/app12063023"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1186\/s13677-023-00425-7","article-title":"Novel secure data protection scheme using Martino homomorphic encryption","volume":"12","author":"Rupa","year":"2023","journal-title":"J. Cloud Comput."},{"key":"ref_21","first-page":"211","article-title":"Information security policy compliance: Leadership and trust","volume":"59","author":"Paliszkiewicz","year":"2019","journal-title":"J. Comput. Inf. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez-Granadillo, G., Gonz\u00e1lez-Zarzosa, S., and Diaz, R. (2021). Security information and event management (SIEM): Analysis, trends, and usage in critical infrastructures. Sensors, 21.","DOI":"10.3390\/s21144759"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"104650","DOI":"10.1109\/ACCESS.2020.3000179","article-title":"A taxonomy of network threats and the effect of current datasets on intrusion detection systems","volume":"8","author":"Hindy","year":"2020","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"9493","DOI":"10.1007\/s11227-020-03213-1","article-title":"A survey on security challenges in cloud computing: Issues, threats, and solutions","volume":"76","author":"Tabrizchi","year":"2020","journal-title":"J. Supercomput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1109\/TII.2020.2968927","article-title":"An efficient spam detection technique for IoT devices using machine learning","volume":"17","author":"Makkar","year":"2020","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Navarro-Almanza, R., Juarez-Ramirez, R., and Licea, G. (2017, January 25\u201327). Towards supporting software engineering using deep learning: A case of software requirements classification. Proceedings of the 5th International Conference on Software Engineering Research and Innovation (CONISOFT), M\u00e9rida, Mexico.","DOI":"10.1109\/CONISOFT.2017.00021"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lima, M., Valle, V., Costa, E., Lira, F., and Gadelha, B. (2019, January 23\u201327). Software engineering repositories: Expanding the PROMISE database. Proceedings of the 33rd Brazilian Symposium on Software Engineering, Salvador, Brazil.","DOI":"10.1145\/3350768.3350776"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"103001","DOI":"10.1109\/ACCESS.2023.3317798","article-title":"BERT-Based Approach for Greening Software Requirements Engineering Through Non-Functional Requirements","volume":"11","author":"Subahi","year":"2023","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Abad, Z.S.H., Karras, O., Ghazi, P., Glinz, M., Ruhe, G., and Schneider, K. (2017, January 4\u20138). What works better? A study of classifying requirements. Proceedings of the IEEE 25th International Requirements Engineering Conference (RE), Lisbon, Portugal.","DOI":"10.1109\/RE.2017.36"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Jindal, R., Malhotra, R., and Jain, A. (2016, January 21\u201324). Automated classification of security requirements. Proceedings of the International Conference on Advanced Computing, Communication and Information (ICACCI), Jaipur, India.","DOI":"10.1109\/ICACCI.2016.7732349"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Severin, K., Gokhale, S., and Dagnino, A. (2019, January 15\u201319). Keyword-based semi-supervised text classification. Proceedings of the 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC), Milwaukee, WI, USA.","DOI":"10.1109\/COMPSAC.2019.00067"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1670","DOI":"10.3390\/ai5030081","article-title":"Enhancing Literature Review Efficiency: A Case Study on Using Fine-Tuned BERT for Classifying Focused Ultrasound-Related Articles","volume":"5","author":"Panagides","year":"2024","journal-title":"AI"},{"key":"ref_33","unstructured":"Hey, T., Keim, J., Koziolek, A., and Tichy, W.F. (September, January 31). NoRBERT: Transfer learning for requirements classification. Proceedings of the IEEE 28th International Requirements Engineering Conference (RE), Zurich, Switzerland."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Barbon, R.S., and Akabane, A.T. (2022). Towards Transfer Learning Techniques\u2014BERT, DistilBERT, BERTimbau, and DistilBERTimbau for Automatic Text Classification from Different Languages: A Case Study. Sensors, 22.","DOI":"10.3390\/s22218184"},{"key":"ref_35","unstructured":"Sanh, V., Debut, L., Chaumond, J., and Wolf, T. (2019, January 13). DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter. Proceedings of the 5th NeurIPS EMC2 Workshop, Vancouver, BC, Canada."},{"key":"ref_36","unstructured":"B\u00fcy\u00fck\u00f6z, B., H\u00fcrriyeto\u011flu, A., and \u00d6zg\u00fcr, A. (2020, January 11\u201316). Analyzing ELMo and DistilBERT on socio-political news classification. Proceedings of the Workshop on Automated Extraction of Socio-political Events from News 2020, European Language Resources Association (ELRA), Marseille, France."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1007\/s11063-024-11500-8","article-title":"A Hybrid Model Based on Convolutional Neural Network and Long Short-Term Memory for Multi-label Text Classification","volume":"56","author":"Maragheh","year":"2024","journal-title":"Neural Process. Lett."},{"key":"ref_38","unstructured":"Shambharkar, P.G., Singh, H., Raghav, H.R., and Verma, H. (2023, January 25\u201326). Exploring the Efficacy of Deep Learning Models for Multiclass Toxic Comment Classification in Social Media Using Natural Language Processing. Proceedings of the 2023 International Conference on Advances in Computing, Communication and Applied Informatics (ACCAI), Chennai, India."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Le, T.T., Oktian, Y.E., and Kim, H. (2022). XGBoost for imbalanced multiclass classification-based industrial internet of things intrusion detection systems. Sustainability, 14.","DOI":"10.3390\/su14148707"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"123534","DOI":"10.1109\/ACCESS.2022.3223094","article-title":"A Comparison of Multi-Label Text Classification Models in Research Articles Labeled with Sustainable Development Goals","volume":"10","year":"2022","journal-title":"IEEE Access"},{"key":"ref_41","first-page":"4171","article-title":"Bert: Pre-training of deep bidirectional transformers for language understanding","volume":"Volume 1","author":"Kenton","year":"2019","journal-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019"},{"key":"ref_42","unstructured":"Loshchilov, I., and Hutter, F. (2017). Fixing weight decay regularization in adam. arXiv."},{"key":"ref_43","unstructured":"Liu, Y. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv."},{"key":"ref_44","unstructured":"Zhou, C., Sun, C., Liu, Z., and Lau, F. (2015). A C-LSTM neural network for text classification. arXiv."},{"key":"ref_45","unstructured":"Pascanu, R., Mikolov, T., and Bengio, Y. (2013, January 16\u201321). On the difficulty of training recurrent neural networks. Proceedings of the 30th International Conference on Machine Learning, JMLR.org, Atlanta, GA, USA."},{"key":"ref_46","unstructured":"Kingma, D.P., and Ba, L.J. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA. Available online: https:\/\/dare.uva.nl\/search?identifier=a20791d3-1aff-464a-8544-268383c33a75."},{"key":"ref_47","first-page":"29935","article-title":"Data augmentation can improve robustness","volume":"34","author":"Rebuffi","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_48","unstructured":"Abonizio, H.Q., and Junior, S.B. (2020). Pre-trained data augmentation for text classification. Brazilian Conference on Intelligent Systems, Springer International Publishing."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1109\/TAI.2021.3114390","article-title":"Toward text data augmentation for sentiment analysis","volume":"3","author":"Abonizio","year":"2021","journal-title":"IEEE Trans. Artif. Intell."},{"key":"ref_50","first-page":"140","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"J. Mach. Learn. Res."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"108293","DOI":"10.1016\/j.knosys.2022.108293","article-title":"Domain knowledge-based security bug reports prediction","volume":"241","author":"Zheng","year":"2022","journal-title":"Knowl.-Based Syst."},{"key":"ref_52","first-page":"3801","article-title":"Fuzzy Logic Inference System for Managing Intensive Care Unit Resources Based on Knowledge Graph","volume":"77","author":"Subahi","year":"2023","journal-title":"Comput. Mater. Contin."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Piao, G. (2021, January 11). Scholarly text classification with sentence BERT and entity embeddings. Proceedings of the Trends and Applications in Knowledge Discovery and Data Mining: PAKDD 2021 Workshops, WSPA, MLMEIN, SDPRA, DARAI, and AI4EPT, Delhi, India.","DOI":"10.1007\/978-3-030-75015-2_8"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"126453","DOI":"10.1016\/j.neucom.2023.126453","article-title":"Refined SBERT: Representing sentence BERT in manifold space","volume":"555","author":"Chu","year":"2023","journal-title":"Neurocomputing"},{"key":"ref_55","first-page":"e60224","article-title":"Exploring the Impact of Batch Size on Deep Learning Artificial Intelligence Models for Malaria Detection","volume":"16","author":"Muralidhar","year":"2024","journal-title":"Cureus"},{"key":"ref_56","unstructured":"Nado, Z., Gilmer, J.M., Shallue, C.J., Anil, R., and Dahl, G.E. (2021). A large batch optimizer reality check: Traditional, generic optimizers suffice across batch sizes. arXiv."},{"key":"ref_57","first-page":"485","article-title":"Significance Of Epochs On Training A Neural Network","volume":"9","author":"Afaq","year":"2020","journal-title":"Int. J. Sci. Technol. Res."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/13\/2\/114\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:32:11Z","timestamp":1760027531000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/13\/2\/114"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,12]]},"references-count":57,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["systems13020114"],"URL":"https:\/\/doi.org\/10.3390\/systems13020114","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,12]]}}}