{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,19]],"date-time":"2025-11-19T11:39:35Z","timestamp":1763552375967,"version":"3.45.0"},"reference-count":131,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T00:00:00Z","timestamp":1763078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Software testing is fundamental to ensuring the quality, reliability, and security of software systems. Over the past decade, artificial intelligence (AI) algorithms have been increasingly applied to automate testing processes, predict and detect defects, and optimize evaluation strategies. This systematic review examines studies published between 2014 and 2024, focusing on the taxonomy and evolution of algorithms across problems, variables, and metrics in software testing. A taxonomy of testing problems is proposed by categorizing issues identified in the literature and mapping the AI algorithms applied to them. In parallel, the review analyzes the input variables and evaluation metrics used by these algorithms, organizing them into established categories and exploring their evolution over time. The findings reveal three complementary trajectories: (1) the evolution of problem categories, from defect prediction toward automation, collaboration, and evaluation; (2) the evolution of input variables, highlighting the increasing importance of semantic, dynamic, and interface-driven data sources beyond structural metrics; and (3) the evolution of evaluation metrics, from classical performance indicators to advanced, testing-specific, and coverage-oriented measures. Finally, the study integrates these dimensions, showing how interdependencies among problems, variables, and metrics have shaped the maturity of AI in software testing. This review contributes a novel taxonomy of problems, a synthesis of variables and metrics, and a future research agenda emphasizing scalability, interpretability, and industrial adoption.<\/jats:p>","DOI":"10.3390\/a18110717","type":"journal-article","created":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T14:37:52Z","timestamp":1763131072000},"page":"717","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Artificial Intelligence in Software Testing: A Systematic Review of a Decade of Evolution and Taxonomy"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0467-411X","authenticated-orcid":false,"given":"Alex","family":"Escalante-Viteri","sequence":"first","affiliation":[{"name":"Faculty of Systems and Informatics Engineering, Universidad Nacional Mayor de San Marcos, Lima 15081, Peru"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9262-626X","authenticated-orcid":false,"given":"David","family":"Mauricio","sequence":"additional","affiliation":[{"name":"Faculty of Systems and Informatics Engineering, Universidad Nacional Mayor de San Marcos, Lima 15081, Peru"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,14]]},"reference":[{"key":"ref_1","unstructured":"Manyika, J., Chui, M., Bughin, J., Dobbs, R., Bisson, P., and Marrs, A. (2013). Disruptive Technologies: Advances That Will Transform Life, Business, and the Global Economy, McKinsey Global Institute. Available online: https:\/\/www.mckinsey.com\/mgi\/overview."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1007\/s43621-024-00273-8","article-title":"Digital transformation for sustainable health and well-being: A review and future research directions","volume":"5","author":"Hameed","year":"2024","journal-title":"Discov. Sustain."},{"key":"ref_3","unstructured":"Software & Information Industry Association (SIIA) (2025, October 31). The Software Industry: Driving Growth and Employment in the U.S. Economy. Available online: https:\/\/www.siia.net\/."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Anderson, R. (2020). Security Engineering: A Guide to Building Dependable Distributed Systems, John Wiley & Sons. [3rd ed.].","DOI":"10.1002\/9781119644682"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Clark, R.C., and Mayer, R.E. (2016). E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning, John Wiley & Sons. [4th ed.].","DOI":"10.1002\/9781119239086"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/MC.2025.3554094","article-title":"Rethinking Software Testing for Modern Development","volume":"58","author":"Saxena","year":"2025","journal-title":"Computer"},{"key":"ref_7","unstructured":"Karvonen, J. (2024). Enhancing Software Quality: A Comprehensive Study of Modern Software Testing Methods. [Unpublished Doctoral Dissertation. Ph.D. Thesis, Tampere University]."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kazimov, T.H., Bayramova, T.A., and Malikova, N.J. (2022). Research of intelligent methods of software testing. Syst. Res. Inf. Technol., 42\u201352.","DOI":"10.20535\/SRIT.2308-8893.2021.4.03"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"786","DOI":"10.3844\/jcssp.2023.786.795","article-title":"Cross-layer design for combining adaptive modulation and coding with DMMPP queuing for wireless networks","volume":"19","author":"Arunachalam","year":"2023","journal-title":"J. Comput. Sci."},{"key":"ref_10","unstructured":"Gao, J., Tsao, H., and Wu, Y. (2006). Testing and Quality Assurance for Component-Based Software, Artech House."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lima, B. (2019, January 22\u201327). Automated Scenario-Based Integration Testing of Time-Constrained Distributed Systems. Proceedings of the 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST), Xi\u2019an, China.","DOI":"10.1109\/ICST.2019.00060"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Fontes, A., and Gay, G. (2023). The integration of machine learning into automated test generation: A systematic mapping study. arXiv.","DOI":"10.1002\/stvr.1845"},{"key":"ref_13","unstructured":"Sharma, C., Sabharwal, S., and Sibal, R. (2014). A survey on software testing techniques using genetic algorithm. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1007\/s42979-024-03412-0","article-title":"Bio-inspired optimization algorithm in machine learning and practical applications","volume":"5","author":"Juneja","year":"2024","journal-title":"SN Comput. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/TSE.2007.256941","article-title":"Data mining static code attributes to learn defect predictors","volume":"33","author":"Menzies","year":"2007","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zimmermann, T., Premraj, R., and Zeller, A. (2009, January 24\u201328). Cross-project defect prediction: A large-scale experiment on open-source projects. Proceedings of the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering, Amsterdam, The Netherlands.","DOI":"10.1145\/1595696.1595713"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"106969","DOI":"10.1016\/j.infsof.2022.106969","article-title":"A deep learning-based automated framework for functional User Interface testing","volume":"150","author":"Khaliq","year":"2022","journal-title":"Inf. Softw. Technol."},{"key":"ref_18","first-page":"980","article-title":"Performance of heterogeneous ensemble approach with traditional methods based on software defect detection model","volume":"100","author":"Sreedevi","year":"2022","journal-title":"J. Theor. Appl. Inf. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"105446","DOI":"10.1016\/j.engappai.2022.105446","article-title":"Using deep learning for selenium web UI functional tests: A case-study with e-commerce applications","volume":"117","author":"Khaliq","year":"2023","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Borandag, E. (2023). Software fault prediction using an RNN-based deep learning approach and ensemble machine learning techniques. Appl. Sci., 13.","DOI":"10.3390\/app13031639"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"107128","DOI":"10.1016\/j.infsof.2022.107128","article-title":"Machine learning in software defect prediction: A business-driven systematic mapping study","volume":"155","author":"Stradowski","year":"2023","journal-title":"Inf. Softw. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3616372","article-title":"Artificial intelligence applied to software testing: A tertiary study","volume":"56","author":"Amalfitano","year":"2024","journal-title":"ACM Comput. Surv."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"79383","DOI":"10.1109\/ACCESS.2024.3407753","article-title":"Natural language processing-based software testing: A systematic literature review","volume":"12","author":"Boukhlif","year":"2024","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"111805","DOI":"10.1016\/j.asoc.2024.111805","article-title":"A systematic review of machine learning methods in software testing","volume":"162","author":"Ajorloo","year":"2024","journal-title":"Appl. Soft Comput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"111518","DOI":"10.1016\/j.jss.2022.111518","article-title":"Mapping the structure and evolution of software testing research over the past three decades","volume":"195","author":"Salahirad","year":"2023","journal-title":"J. Syst. Softw."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"111387","DOI":"10.1016\/j.jss.2022.111387","article-title":"Testing anticipatory systems: A systematic mapping study on the state of the art","volume":"192","author":"Peischl","year":"2022","journal-title":"J. Syst. Softw."},{"key":"ref_27","first-page":"754","article-title":"Metamorphic testing of AI-based applications: A critical review","volume":"11","author":"Khokhar","year":"2020","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"166262","DOI":"10.1109\/ACCESS.2021.3135508","article-title":"Trend application of machine learning in test case prioritization: A review on techniques","volume":"9","author":"Khatibsyarbini","year":"2021","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Boukhlif, M., Hanine, M., and Kharmoum, N. (2023). A decade of intelligent software testing research: A bibliometric analysis. Electronics, 12.","DOI":"10.3390\/electronics12092109"},{"key":"ref_30","unstructured":"Myers, G.J. (1979). The Art of Software Testing, Wiley-Interscience."},{"key":"ref_31","unstructured":"(2013). Software and Systems Engineering\u2014Software Testing\u2014Part 1: Concepts and Definitions. Standard No. ISO\/IEC\/IEEE 29119-1:2013."},{"key":"ref_32","unstructured":"Kaner, C., Bach, J., and Pettichord, B. (2002). Testing Computer Software, John Wiley & Sons. [2nd ed.]."},{"key":"ref_33","unstructured":"Pressman, R.S., and Maxim, B.R. (2014). Software Engineering: A Practitioner\u2019s Approach, McGraw-Hill Education. [8th ed.]."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1109\/2.962984","article-title":"Top 10 list [software development]","volume":"34","author":"Boehm","year":"2001","journal-title":"Computer"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"McGraw, G. (2006). Software Security: Building Security, Addison-Wesley Professional.","DOI":"10.1109\/ISSRE.2006.43"},{"key":"ref_36","unstructured":"Beizer, B. (1990). Software Testing Techniques, Van Nostrand Reinhold. [2nd ed.]."},{"key":"ref_37","unstructured":"Kan, S.H. (2002). Metrics and Models in Software Quality Engineering, Addison-Wesley. [2nd ed.]."},{"key":"ref_38","unstructured":"Beck, K. (2002). Test Driven Development: By Example, Longman."},{"key":"ref_39","unstructured":"Humble, J., and Farley, D. (2010). Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation, Addison-Wesley Professional."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Jorgensen, P.C. (2013). Software Testing: A Craftsman\u2019s Approach, CRC Press. [4th ed.].","DOI":"10.1201\/9781439889503"},{"key":"ref_41","unstructured":"Crispin, L., and Gregory, J. (2009). Agile Testing: A Practical Guide for Testers and Agile Teams, Addison-Wesley. Available online: https:\/\/books.google.com\/books?id=3UdsAQAAQBAJ."},{"key":"ref_42","unstructured":"Graham, D., and Fewster, M. (2012). Experiences of Test Automation: Case Studies of Software Test Automation, Addison-Wesley."},{"key":"ref_43","unstructured":"Meier, J.D., Farre, C., Bansode, P., Barber, S., and Rea, D. (2007). Performance Testing Guidance for Web Applications. Microsoft Press. [1st ed.]."},{"key":"ref_44","unstructured":"North, D. (2025, October 31). Introducing BDD. Available online: https:\/\/dannorth.net\/introducing-bdd\/."},{"key":"ref_45","unstructured":"Fewster, M., and Graham, D. (1999). Software Test Automation, Addison-Wesley."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Pelivani, E., and Cico, B. (2021, January 7\u201311). A comparative study of automation testing tools for web applications. Proceedings of the 2021 10th Mediterranean Conference on Embedded Computing (MECO), Budva, Montenegro.","DOI":"10.1109\/MECO52532.2021.9460242"},{"key":"ref_47","unstructured":"Beck, K., and Saff, D. (2004). JUnit Pocket Guide, O\u2019Reilly Media."},{"key":"ref_48","unstructured":"Black, R. (2009). Advanced Software Testing. Guide to the ISTQB Advanced Certification as an Advanced Test Analyst, Rocky Nook. [2nd ed.]."},{"key":"ref_49","unstructured":"Kitchenham, B. (1996). Software Metrics: Measurement for Software Process Improvement, John Wiley & Sons."},{"key":"ref_50","unstructured":"Cohn, M. (2005). Agile Estimating and Planning, Pearson Education."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1145\/2379776.2379787","article-title":"Search-based software engineering: Trends, techniques and applications","volume":"45","author":"Harman","year":"2012","journal-title":"ACM Comput. Surv."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Arora, L., Girija, S.S., Kapoor, S., Raj, A., Pradhan, D., and Shetgaonkar, A. (2025, January 8\u201311). Explainable artificial intelligence techniques for software development lifecycle: A phase-specific survey. Proceedings of the 2025 IEEE 49th Annual Computers, Software, and Applications Conference (COMPSAC), Toronto, ON, Canada.","DOI":"10.1109\/COMPSAC65507.2025.00321"},{"key":"ref_53","unstructured":"Kitchenham, B., and Charters, S. (2007). Guidelines for Performing Systematic Literature Reviews in Software Engineering, University of Durham. EBSE Technical Report, Ver. 2.3."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/bs.adcom.2015.03.003","article-title":"Chapter Three\u2014A Research Overview of Tool-Supported Model-Based Testing of Requirements-Based Designs","volume":"Volume 98","author":"Hurson","year":"2015","journal-title":"Advances in Computers"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.infsof.2016.09.002","article-title":"A systematic literature review of literature reviews in software testing","volume":"80","author":"Garousi","year":"2016","journal-title":"Inf. Softw. Technol."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"867","DOI":"10.1007\/s13198-019-00840-7","article-title":"Aspects of software quality applied to the process of agile software development: A systematic literature review","volume":"10","author":"Mauricio","year":"2019","journal-title":"Int. J. Syst. Assur. Eng. Manag."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"104773","DOI":"10.1016\/j.engappai.2022.104773","article-title":"A systematic literature review on software defect prediction using artificial intelligence: Datasets, data validation methods, approaches, and tools","volume":"111","author":"Pachouly","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: An updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"12185","DOI":"10.1007\/s10586-024-04599-w","article-title":"A novel software defect prediction model using two-phase grey wolf optimization for feature selection","volume":"27","author":"Malhotra","year":"2024","journal-title":"Clust. Comput."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1149","DOI":"10.1142\/S0218194023300026","article-title":"Software Testing Integration-Based Model (I-BM) framework for recognizing measure fault output accuracy using machine learning approach","volume":"33","author":"Zulkifli","year":"2023","journal-title":"Int. J. Softw. Eng. Knowl. Eng."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1007\/s10664-023-10439-z","article-title":"LineFlowDP: A deep learning-based two-phase approach for line-level defect prediction","volume":"29","author":"Yang","year":"2024","journal-title":"Empir. Softw. Eng."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1007\/s42979-022-01255-1","article-title":"A learning classifier system for automated test case prioritization and selection","volume":"3","author":"Rosenbauer","year":"2022","journal-title":"SN Comput. Sci."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"e2228","DOI":"10.1002\/smr.2228","article-title":"SFLA-based heuristic method to generate software structural test data","volume":"32","author":"Ghaemi","year":"2020","journal-title":"J. Softw. Evolu. Process"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1142\/S0218194023500079","article-title":"A hierarchical feature ensemble deep learning approach for software defect prediction","volume":"33","author":"Zhang","year":"2023","journal-title":"Int. J. Softw. Eng. Knowl. Eng."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"e1860","DOI":"10.7717\/peerj-cs.1860","article-title":"Enhancing software defect prediction: A framework with improved feature selection and ensemble machine learning","volume":"10","author":"Ali","year":"2024","journal-title":"PeerJ Comput. Sci."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"107307","DOI":"10.1016\/j.infsof.2023.107307","article-title":"FrMi: Fault-revealing mutant identification using killability severity","volume":"164","author":"Rostami","year":"2023","journal-title":"Inf. Softw. Technol."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"20376","DOI":"10.1109\/ACCESS.2024.3358201","article-title":"Software defect prediction using an intelligent ensemble-based model","volume":"12","author":"Ali","year":"2024","journal-title":"IEEE Access"},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3589342","article-title":"Concept drift in software defect prediction: A method for detecting and handling the drift","volume":"23","author":"Gangwar","year":"2023","journal-title":"ACM Trans. Internet Technol."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"109336","DOI":"10.1016\/j.compeleceng.2024.109336","article-title":"A software defect prediction method using binary gray wolf optimizer and machine learning algorithms","volume":"118","author":"Wang","year":"2024","journal-title":"Comput. Electr. Eng."},{"key":"ref_70","unstructured":"Lee, R. (2015). Increasing the accuracy of software fault prediction using majority ranking fuzzy clustering. Software Engineering, Artificial Intelligence, Networking and Parallel\/Distributed Computing, Springer International Publishing."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1109\/TSUSC.2023.3248965","article-title":"Defect prediction via tree-based encoding with hybrid granularity for software sustainability","volume":"9","author":"Qiu","year":"2024","journal-title":"IEEE Trans. Sustain. Comput."},{"key":"ref_72","first-page":"5203","article-title":"Optimal test sequence generation in state based testing using moth flame optimization algorithm","volume":"35","author":"Sharma","year":"2018","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1504\/IJCAT.2019.100297","article-title":"Improved Bayesian regularization using neural networks based on feature selection for software defect prediction","volume":"60","author":"Jayanthi","year":"2019","journal-title":"Int. J. Comput. Appl. Technol."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"121251","DOI":"10.1016\/j.eswa.2023.121251","article-title":"Parameter tuning for software fault prediction with different variants of differential evolution","volume":"237","author":"Nikravesh","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"63579","DOI":"10.1109\/ACCESS.2023.3287326","article-title":"A novel approach to improve software defect prediction accuracy using machine learning","volume":"11","author":"Mehmood","year":"2023","journal-title":"IEEE Access"},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/s11219-016-9342-6","article-title":"Tackling class overlap and imbalance problems in software defect prediction","volume":"26","author":"Chen","year":"2018","journal-title":"Softw. Qual. J."},{"key":"ref_77","first-page":"6477","article-title":"A cognitive and neural network approach for software defect prediction","volume":"43","author":"Rajnish","year":"2022","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_78","first-page":"6083","article-title":"Data and ensemble machine learning fusion based intelligent software defect prediction system","volume":"75","author":"Abbas","year":"2023","journal-title":"Comput. Mater. Contin."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"60668","DOI":"10.1109\/ACCESS.2023.3285598","article-title":"Prediction and correction of software defects in Message-Passing Interfaces using a static analysis tool and machine learning","volume":"11","author":"Eassa","year":"2023","journal-title":"IEEE Access"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"103050","DOI":"10.1016\/j.sysarc.2023.103050","article-title":"Mutation testing of unsupervised learning systems","volume":"146","author":"Lu","year":"2024","journal-title":"J. Syst. Archit."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"127502","DOI":"10.1016\/j.neucom.2024.127502","article-title":"Adaptive attention fusion network for cross-device GUI element re-identification in crowdsourced testing","volume":"580","author":"Zhang","year":"2024","journal-title":"Neurocomputing"},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"102999","DOI":"10.1016\/j.sysarc.2023.102999","article-title":"HashC: Making deep learning coverage testing finer and faster","volume":"144","author":"Sun","year":"2023","journal-title":"J. Syst. Archit."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"768","DOI":"10.1049\/iet-sen.2020.0119","article-title":"Software defect prediction using K-PCA and various kernel-based extreme learning machine: An empirical study","volume":"14","author":"Pandey","year":"2020","journal-title":"IET Softw."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"4997459","DOI":"10.1155\/2021\/4997459","article-title":"Software defect prediction based on hybrid swarm intelligence and deep learning","volume":"2021","author":"Li","year":"2021","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_85","first-page":"63","article-title":"ACO based comprehensive model for software fault prediction","volume":"24","author":"Singh","year":"2020","journal-title":"Int. J. Knowl. Based Intell. Eng. Syst."},{"key":"ref_86","first-page":"424","article-title":"Automating software testing with multi-layer perceptron (MLP): Leveraging historical data for efficient test case generation and execution","volume":"11","author":"Manikkannan","year":"2023","journal-title":"Int. J. Intell. Syst. Appl. Eng."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1049\/sfw2.12038","article-title":"Embedding and classifying test execution traces using neural networks","volume":"16","author":"Tsimpourlas","year":"2022","journal-title":"IET Softw."},{"key":"ref_88","first-page":"531","article-title":"Hybrid approach for automated test data generation","volume":"10","author":"Kumar","year":"2022","journal-title":"J. ICT Stand."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Ma, M., Han, L., and Qian, Y. (2022). CVDF DYNAMIC\u2014A dynamic fuzzy testing sample generation framework based on BI-LSTM and genetic algorithm. Sensors, 22.","DOI":"10.3390\/s22031265"},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"1587","DOI":"10.32604\/iasc.2022.025192","article-title":"Modeling metaheuristic optimization with deep learning software bug prediction model","volume":"34","author":"Sangeetha","year":"2022","journal-title":"Intell. Autom. Soft Comput."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"7207","DOI":"10.1007\/s11276-023-03591-3","article-title":"Enhancing IoT-based software defect prediction in analytical data management using war strategy optimization and kernel ELM","volume":"30","author":"Zada","year":"2024","journal-title":"Wirel. Netw."},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"10402","DOI":"10.1109\/ACCESS.2022.3144598","article-title":"Graph neural network for source code defect prediction","volume":"10","author":"KurdiJA","year":"2022","journal-title":"IEEE Access"},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1186\/s13677-022-00311-8","article-title":"Cloud-based bug tracking software defects analysis using deep learning","volume":"11","author":"Hai","year":"2022","journal-title":"J. Cloud Comput."},{"key":"ref_94","first-page":"578","article-title":"Enhancing software user interface testing through few-shot deep learning: A novel approach for automated accuracy and usability evaluation","volume":"14","author":"Widodo","year":"2023","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"1912","DOI":"10.1109\/TSE.2022.3201209","article-title":"Flakify: A black-box, language model-based predictor for flaky tests","volume":"49","author":"Fatima","year":"2023","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"515","DOI":"10.2298\/CSIS180312039B","article-title":"Majority vote feature selection algorithm in software fault prediction","volume":"16","author":"Borandag","year":"2019","journal-title":"Comput. Sci. Inf. Syst."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"1085","DOI":"10.1016\/j.asoc.2016.06.023","article-title":"Classification with reject option for software defect prediction","volume":"49","author":"Mesquita","year":"2016","journal-title":"Appl. Soft Comput."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"103878","DOI":"10.1016\/j.engappai.2020.103878","article-title":"A novel methodology to classify test cases using natural language processing and imbalanced learning","volume":"95","author":"Tahvili","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_99","first-page":"953","article-title":"Software defect prediction using deep learning by correlation clustering of testing metrics","volume":"13","author":"Sharma","year":"2022","journal-title":"Int. J. Electr. Comput. Eng. Syst."},{"key":"ref_100","first-page":"199","article-title":"Applying machine learning to software fault prediction","volume":"12","year":"2018","journal-title":"e-Inform. Softw. Eng. J."},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"14","DOI":"10.5815\/ijmecs.2019.12.01","article-title":"A framework for software defect prediction using feature selection and ensemble learning techniques","volume":"11","author":"Matloob","year":"2019","journal-title":"Int. J. Mod. Educ. Comput. Sci. (IJMECS)"},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"3055","DOI":"10.1109\/ACCESS.2019.2962695","article-title":"ARTDL: Adaptive random testing for deep learning systems","volume":"8","author":"Yan","year":"2020","journal-title":"IEEE Access"},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"1229","DOI":"10.2991\/ijcis.11.1.92","article-title":"A three-stage based ensemble learning for improved software fault prediction: An empirical comparative study","volume":"11","author":"Yohannese","year":"2018","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"ref_104","doi-asserted-by":"crossref","unstructured":"Chen, L.-K., Chen, Y.-H., Chang, S.-F., and Chang, S.-C. (2020). A Long\/Short-Term Memory based automated testing model to quantitatively evaluate game design. Appl. Sci., 10.","DOI":"10.3390\/app10196704"},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1142\/S021819401450003X","article-title":"Investigating associative classification for software fault prediction: An experimental perspective","volume":"24","author":"Ma","year":"2014","journal-title":"Int. J. Softw. Eng. Knowl. Eng."},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1109\/TSMC.2016.2521840","article-title":"Fuzzy rule-based approach for software fault prediction","volume":"47","author":"Singh","year":"2017","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.ins.2018.02.027","article-title":"A novel approach for software defect prediction through hybridizing gradual relational association rules with artificial neural networks","volume":"441","author":"Miholca","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_108","doi-asserted-by":"crossref","unstructured":"Guo, S., Chen, R., and Li, H. (2017). Using knowledge transfer and rough set to predict the severity of Android test reports via text mining. Symmetry, 9.","DOI":"10.3390\/sym9080161"},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.infsof.2014.10.009","article-title":"New bounds for mixed covering arrays in t-way testing with uniform strength","volume":"59","year":"2015","journal-title":"Inf. Softw. Technol."},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"2742","DOI":"10.35940\/ijeat.A9762.109119","article-title":"Test case design and test case prioritization using machine learning","volume":"9","author":"Sharma","year":"2019","journal-title":"Int. J. Eng. Adv. Technol."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1016\/j.asoc.2018.01.042","article-title":"An effective approach for determining the class integration test order using reinforcement learning","volume":"65","author":"Czibula","year":"2018","journal-title":"Appl. Soft Comput."},{"key":"ref_112","doi-asserted-by":"crossref","unstructured":"Kacmajor, M., and Kelleher, J.D. (2019). Automatic acquisition of annotated training corpora for test-code generation. Information, 10.","DOI":"10.3390\/info10020066"},{"key":"ref_113","first-page":"3511","article-title":"ER-Fuzz: Conditional code removed fuzzing","volume":"13","author":"Song","year":"2019","journal-title":"KSII Trans. Internet Info. Syst."},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"729","DOI":"10.1007\/s10586-017-1000-7","article-title":"Parallel testing and coverage analysis for context-free applications","volume":"21","author":"Rauf","year":"2018","journal-title":"Clust. Comput."},{"key":"ref_115","doi-asserted-by":"crossref","first-page":"76551","DOI":"10.1007\/s11042-024-18456-w","article-title":"Hybrid deep architecture for software defect prediction with improved feature set","volume":"83","author":"Shyamala","year":"2024","journal-title":"Multimed. Tools Appl."},{"key":"ref_116","doi-asserted-by":"crossref","first-page":"2836","DOI":"10.1109\/TSE.2021.3070549","article-title":"Reinforcement Learning for Test Case Prioritization","volume":"48","author":"Bagherzadeh","year":"2022","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"11119","DOI":"10.1007\/s10586-024-04446-y","article-title":"Software Defect Prediction Ensemble Learning Algorithm Based on 2-Step Sparrow Optimizing Extreme Learning Machine","volume":"27","author":"Tang","year":"2024","journal-title":"Clust. Comput."},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/j.comcom.2021.09.014","article-title":"Test Case Prioritization Based on Artificial Fish School Algorithm","volume":"180","author":"Xing","year":"2021","journal-title":"Comput. Commun."},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"710","DOI":"10.1109\/TR.2023.3295012","article-title":"ME-SFP: A Mixture-of-Experts-Based Approach for Software Fault Prediction","volume":"73","author":"Omer","year":"2024","journal-title":"IEEE Trans. Reliab."},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.infsof.2018.10.001","article-title":"Automatically Identifying Code Features for Software Defect Prediction: Using AST N-grams","volume":"106","author":"Shippey","year":"2019","journal-title":"Inf. Softw. Technol."},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"111537","DOI":"10.1016\/j.jss.2022.111537","article-title":"On the use of deep learning in software defect prediction","volume":"195","author":"Giray","year":"2023","journal-title":"J. Syst. Softw."},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"1743","DOI":"10.3390\/ai5040086","article-title":"Software defect prediction based on machine learning and deep learning techniques: An empirical approach","volume":"5","author":"Albattah","year":"2024","journal-title":"AI"},{"key":"ref_123","doi-asserted-by":"crossref","unstructured":"Li, J., He, P., Zhu, J., and Lyu, M.R. (2017, January 25\u201329). Software defect prediction via convolutional neural network. Proceedings of the 2017 IEEE International Conference on Software Quality, Reliability and Security (QRS), Prague, Czech Republic.","DOI":"10.1109\/QRS.2017.42"},{"key":"ref_124","doi-asserted-by":"crossref","first-page":"131255","DOI":"10.1109\/ACCESS.2024.3458184","article-title":"A large-scale empirical investigation into cross-project flaky test prediction","volume":"12","author":"Afeltra","year":"2024","journal-title":"IEEE Access"},{"key":"ref_125","doi-asserted-by":"crossref","first-page":"132750","DOI":"10.1109\/ACCESS.2023.3329051","article-title":"Software defects identification: Results using machine learning and explainable artificial intelligence techniques","volume":"11","author":"Begum","year":"2023","journal-title":"IEEE Access"},{"key":"ref_126","doi-asserted-by":"crossref","unstructured":"Ram\u00edrez, A., Berrios, M., Romero, J.R., and Feldt, R. (2023, January 16\u201320). Towards explainable test case prioritisation with learning-to-rank models. Proceedings of the 2023 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), Dublin, Ireland.","DOI":"10.1109\/ICSTW58534.2023.00023"},{"key":"ref_127","first-page":"1819","article-title":"Automated test case generation from requirements: A systematic literature review","volume":"67","author":"Mustafa","year":"2020","journal-title":"Comput. Mater. Contin."},{"key":"ref_128","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1007\/s41109-020-00323-w","article-title":"REDUNET: Reducing test suites by integrating set cover and network-based optimization","volume":"5","author":"Fornaia","year":"2020","journal-title":"Appl. Netw. Sci."},{"key":"ref_129","doi-asserted-by":"crossref","first-page":"45","DOI":"10.47604\/ijsm.2843","article-title":"Self-healing test automation framework using AI and ML","volume":"3","author":"Saarathy","year":"2024","journal-title":"Int. J. Strateg. Manag."},{"key":"ref_130","doi-asserted-by":"crossref","unstructured":"Brandt, C., and Ram\u00edrez, A. (April, January 31). Towards Refined Code Coverage: A New Predictive Problem in Software Testing. Proceedings of the 2025 IEEE Conference on Software Testing, Verification and Validation (ICST), Napoli, Italy.","DOI":"10.1109\/ICST62969.2025.10989028"},{"key":"ref_131","first-page":"21","article-title":"Research on software vulnerability detection methods based on deep learning","volume":"14","author":"Zhu","year":"2024","journal-title":"J. Comput. Electron. Inf. Manag."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/11\/717\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,19]],"date-time":"2025-11-19T11:30:10Z","timestamp":1763551810000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/11\/717"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,14]]},"references-count":131,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["a18110717"],"URL":"https:\/\/doi.org\/10.3390\/a18110717","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2025,11,14]]}}}