{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T17:38:50Z","timestamp":1775065130614,"version":"3.50.1"},"reference-count":60,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2024,1,2]],"date-time":"2024-01-02T00:00:00Z","timestamp":1704153600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Software"],"abstract":"<jats:p>Automated software testing is a crucial yet resource-intensive aspect of software development. This burden on resources affects widespread adoption, with expertise and cost being the primary challenges preventing adoption. This paper focuses on automated testing driven by manually created test cases, acknowledging its advantages while critically analysing its implications across various development stages that are affecting its adoption. Additionally, it analyses the differences in perception between those in nontechnical and technical roles, where nontechnical roles (e.g., management) predominantly strive to reduce costs and delivery time, whereas technical roles are often driven by quality and completeness. This study investigates the difference in attitudes toward automated testing (AtAT), specifically focusing on why it is not adopted. This article presents a survey conducted among software industry professionals that spans various roles to determine common trends and draw conclusions. A two-stage approach is presented, comprising a comprehensive descriptive analysis and the use of Principal Component Analysis. In total, 81 participants received a series of 22 questions, and their responses were compared against job role types and experience levels. In summary, six key findings are presented that cover expertise, time, cost, tools and techniques, utilisation, organisation, and capacity.<\/jats:p>","DOI":"10.3390\/software3010001","type":"journal-article","created":{"date-parts":[[2024,1,2]],"date-time":"2024-01-02T06:04:09Z","timestamp":1704175449000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A Survey on Factors Preventing the Adoption of Automated Software Testing: A Principal Component Analysis Approach"],"prefix":"10.3390","volume":"3","author":[{"given":"George","family":"Murazvu","sequence":"first","affiliation":[{"name":"Axia Digital, Unit 57, Batley Business Park, Batley WF17 6ER, UK"},{"name":"Department of Computer Science, University of Huddersfield, Huddersfield HD1 3DH, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1747-9914","authenticated-orcid":false,"given":"Simon","family":"Parkinson","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Huddersfield, Huddersfield HD1 3DH, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8613-8200","authenticated-orcid":false,"given":"Saad","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Huddersfield, Huddersfield HD1 3DH, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1178-6454","authenticated-orcid":false,"given":"Na","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Logistics, Marketing, Hospitality and Analytics, University of Huddersfield, Huddersfield HD1 3DH, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4911-1492","authenticated-orcid":false,"given":"Gary","family":"Allen","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Huddersfield, Huddersfield HD1 3DH, UK"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/MSPEC.2005.1502528","article-title":"Why software fails","volume":"42","author":"Charette","year":"2005","journal-title":"IEEE Spectr."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ammann, P., and Offutt, J. (2016). Introduction to Software Testing, Cambridge University Press.","DOI":"10.1017\/9781316771273"},{"key":"ref_3","unstructured":"Dustin, E., Rashka, J., and Paul, J. (1999). Automated Software Testing: Introduction, Management, and Performance, Addison-Wesley Professional."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Elghondakly, R., Moussa, S., and Badr, N. (2015, January 12\u201314). Waterfall and agile requirements-based model for automated test cases generation. Proceedings of the 2015 IEEE Seventh International Conference on Intelligent Computing and Information Systems (ICICIS), Cairo, Egypt.","DOI":"10.1109\/IntelCIS.2015.7397285"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"246","DOI":"10.3991\/ijim.v14i11.13269","article-title":"Agile software development: Methodologies and trends","volume":"14","author":"Sawalha","year":"2020","journal-title":"Int. J. Interact. Mob. Technol."},{"key":"ref_6","unstructured":"Rafi, D.M., Moses, K.R.K., Petersen, K., and M\u00e4ntyl\u00e4, M.V. (2012, January 2\u20133). Benefits and limitations of automated software testing: Systematic literature review and practitioner survey. Proceedings of the 2012 7th International Workshop on Automation of Software Test (AST), Zurich, Switzerland."},{"key":"ref_7","first-page":"5","article-title":"Benefits of Automated Testing Over Manual Testing","volume":"2","author":"Asfaw","year":"2015","journal-title":"Int. J. Innov. Res. Inf. Secur."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Collins, E.F., and De Lucena, V.F. (2012, January 2\u20133). Software test automation practices in agile development environment: An industry experience report. Proceedings of the 2012 7th International Workshop on Automation of Software Test (AST), Zurich, Switzerland.","DOI":"10.1109\/IWAST.2012.6228991"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"e1639","DOI":"10.1002\/stvr.1639","article-title":"Impediments for software test automation: A systematic literature review","volume":"27","author":"Wiklund","year":"2017","journal-title":"Softw. Test. Verif. Reliab."},{"key":"ref_10","unstructured":"Bear, S. (2018). State of Testing, Smart Bear. Technical report."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1007\/s13198-011-0065-6","article-title":"Trade-off between automated and manual software testing","volume":"2","author":"Taipale","year":"2011","journal-title":"Int. J. Syst. Assur. Eng. Manag."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"106625","DOI":"10.1016\/j.infsof.2021.106625","article-title":"Why many challenges with GUI test automation (will) remain","volume":"138","author":"Nass","year":"2021","journal-title":"Inf. Softw. Technol."},{"key":"ref_13","first-page":"61","article-title":"Issues\/challenges of automated software testing: A case study","volume":"3","author":"Khan","year":"2018","journal-title":"Pak. J. Comput. Inf. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Evans, I., Porter, C., and Micallef, M. (2021, January 26\u201329). Scared, frustrated and quietly proud: Testers\u2019 lived experience of tools and automation. Proceedings of the 32nd European Conference on Cognitive Ergonomics, Siena Italy.","DOI":"10.1145\/3452853.3452872"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, B., Zhao, Q., Jiao, S., and Liu, X. (2023, January 2\u20136). DroidPerf: Profiling Memory Objects on Android Devices. Proceedings of the 29th Annual International Conference on Mobile Computing and Networking, Madrid Spain.","DOI":"10.1145\/3570361.3592503"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, B., Xu, H., Zhao, Q., Su, P., Chabbi, M., Jiao, S., and Liu, X. (2022, January 21\u201329). OJXPerf: Featherlight object replica detection for Java programs. Proceedings of the 44th International Conference on Software Engineering, Pittsburgh, PA, USA.","DOI":"10.1145\/3510003.3510083"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hynninen, T., Kasurinen, J., Knutas, A., and Taipale, O. (2018, January 2\u20134). Guidelines for software testing education objectives from industry practices with a constructive alignment approach. Proceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education, Larnaca, Cyprus.","DOI":"10.1145\/3197091.3197108"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/bs.adcom.2015.11.003","article-title":"Security testing: A survey","volume":"Volume 101","author":"Felderer","year":"2016","journal-title":"Advances in Computers"},{"key":"ref_19","unstructured":"Larusdottir, M.K., Bjarnadottir, E.R., and Gulliksen, J. (2010). Human-Computer Interaction, Proceedings of the Second IFIP TC 13 Symposium, HCIS 2010, Held as Part of WCC 2010, Brisbane, Australia, 20\u201323 September 2010, Springer. Proceedings."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hourani, H., Hammad, A., and Lafi, M. (2019, January 9\u201311). The impact of artificial intelligence on software testing. Proceedings of the 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT), Amman, Jordan.","DOI":"10.1109\/JEEIT.2019.8717439"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Vos, T.E., Marin, B., Escalona, M.J., and Marchetto, A. (2012, January 27\u201329). A methodological framework for evaluating software testing techniques and tools. Proceedings of the 2012 12th International Conference on Quality Software, Xi\u2019an, China.","DOI":"10.1109\/QSIC.2012.16"},{"key":"ref_22","unstructured":"Eldh, S., Hansson, H., Punnekkat, S., Pettersson, A., and Sundmark, D. (2006, January 29\u201331). A framework for comparing efficiency, effectiveness and applicability of software testing techniques. Proceedings of the Testing: Academic & Industrial Conference-Practice And Research Techniques (TAIC PART\u201906), Windsor, UK."},{"key":"ref_23","unstructured":"Infosys (2023, November 20). Infosys Test Automation Accelerator. Available online: https:\/\/www.infosys.com\/IT-services\/validation-solutions\/Documents\/infosys-test-automation-accelerator.pdf."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.procs.2016.03.003","article-title":"The Impacts of Test Automation on Software\u2019s Cost, Quality and Time to Market","volume":"79","author":"Kumar","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_25","unstructured":"Mittal, V., and Garg, N. (2018). Test Automation using Selenium Webdriver 3.0 with C#, AdactIn Group Pty Limited."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.jss.2015.08.026","article-title":"Evolution of software in automated production systems: Challenges and research directions","volume":"110","author":"Fay","year":"2015","journal-title":"J. Syst. Softw."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.ins.2017.08.088","article-title":"A cost-effective software testing strategy employing online feedback information","volume":"422","author":"Zhou","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Panichella, S., Di Sorbo, A., Guzman, E., Visaggio, C.A., Canfora, G., and Gall, H.C. (October, January 29). How can i improve my app? Classifying user reviews for software maintenance and evolution. Proceedings of the 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME), Bremen, Germany.","DOI":"10.1109\/ICSM.2015.7332474"},{"key":"ref_29","unstructured":"Tracey, N., Clark, J., Mander, K., and McDermid, J. (1998, January 13\u201316). An automated framework for structural test-data generation. Proceedings of the Proceedings 13th IEEE International Conference on Automated Software Engineering (Cat. No. 98EX239), Honolulu, HI, USA."},{"key":"ref_30","unstructured":"Fewster, M., and Graham, D. (1999). Software Test Automation: Effective Use of Test Execution Tools, Addison-Wesley Publishing Co."},{"key":"ref_31","unstructured":"Graham, D., and Fewster, M. (2012). Experiences of Test Automation: Case Studies of Software Test Automation, Addison-Wesley Professional."},{"key":"ref_32","first-page":"345","article-title":"A probabilistic analysis of the efficiency of automated software testing","volume":"42","author":"Paul","year":"2015","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_33","unstructured":"Rahman, A.A., and Hasim, N. (2015, January 2\u20134). Defect Management Life Cycle Process for Software Quality Improvement. Proceedings of the 2015 3rd International Conference on Artificial Intelligence, Modelling and Simulation (AIMS), Kota Kinabalu, Malaysia."},{"key":"ref_34","unstructured":"Garrett, T. (2011). Useful Automated Software Testing Metrics. Softw. Test. Geek."},{"key":"ref_35","unstructured":"Rex, B. (2002). Managing the Testing Process: Practical Tools and Techniques for Managing Hardware and Software Testing, Rex Black Inc."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Berner, S., Weber, R., and Keller, R.K. (2005, January 15\u201321). Observations and lessons learned from automated testing. Proceedings of the 27th International Conference on Software Engineering, St. Louis, MO, USA.","DOI":"10.1145\/1062455.1062556"},{"key":"ref_37","unstructured":"Jansing, D., Novillo, J., Cavallo, R., and Spetka, S. (2015). Enhancing the Effectiveness of Software Test Automation. [Ph.D Thesis, State University of New York Polytechnic Institute Utica]."},{"key":"ref_38","unstructured":"Dustin, E., Garrett, T., and Gauf, B. (2009). Implementing Automated Software Testing: How to Save Time and Lower Costs While Raising Quality, Pearson Education."},{"key":"ref_39","unstructured":"Melton, J.R. (2015, January 27\u201329). The Hidden Benefits of automated Testing. Proceedings of the 2015 Aerospace Testing Seniar, CVENTS, Los Angeles, California."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"620836","DOI":"10.1155\/2010\/620836","article-title":"Software test automation in practice: Empirical observations","volume":"2010","author":"Kasurinen","year":"2010","journal-title":"Adv. Softw. Eng."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Leitner, A., Ciupa, I., Meyer, B., and Howard, M. (2007, January 3\u20136). Reconciling manual and automated testing: The autotest experience. Proceedings of the 2007 40th Annual Hawaii International Conference on System Sciences (HICSS\u201907), Big Island, HI, USA.","DOI":"10.1109\/HICSS.2007.462"},{"key":"ref_42","first-page":"405","article-title":"Evaluation of automated web testing tools","volume":"4","author":"Monier","year":"2015","journal-title":"Int. J. Comput. Appl. Technol. Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MS.2017.3641116","article-title":"Worlds Apart: Industrial and Academic Focus Areas in Software Testing","volume":"34","author":"Garousi","year":"2017","journal-title":"IEEE Softw."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"836","DOI":"10.1109\/TSE.2018.2870414","article-title":"How practitioners perceive automated bug report management techniques","volume":"46","author":"Zou","year":"2018","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lo, D., Nagappan, N., and Zimmermann, T. (2015, January 30). How practitioners perceive the relevance of software engineering research. Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, Bergamo, Italy.","DOI":"10.1145\/2786805.2786809"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Meyer, A.N., Fritz, T., Murphy, G.C., and Zimmermann, T. (2014, January 16\u201321). Software developers\u2019 perceptions of productivity. Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, Hong Kong, China.","DOI":"10.1145\/2635868.2635892"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1002\/wics.101","article-title":"Principal component analysis","volume":"2","author":"Abdi","year":"2010","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"20150202","DOI":"10.1098\/rsta.2015.0202","article-title":"Principal component analysis: A review and recent developments","volume":"374","author":"Jolliffe","year":"2016","journal-title":"Philos. Trans. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_49","first-page":"48","article-title":"Analyzing likert data","volume":"50","author":"Boone","year":"2012","journal-title":"J. Ext."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.11648\/j.ajtas.20160501.11","article-title":"Comparison of convenience sampling and purposive sampling","volume":"5","author":"Etikan","year":"2016","journal-title":"Am. J. Theor. Appl. Stat."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1554","DOI":"10.1287\/mnsc.46.12.1554.12072","article-title":"Coordinating expertise in software development teams","volume":"46","author":"Faraj","year":"2000","journal-title":"Manag. Sci."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1016\/j.ijnurstu.2013.10.005","article-title":"On exploratory factor analysis: A review of recent evidence, an assessment of current practice, and recommendations for future use","volume":"51","author":"Gaskin","year":"2014","journal-title":"Int. J. Nurs. Stud."},{"key":"ref_53","unstructured":"Nunnally, J.C., and Ira, H.B. (1994). Psychometric Theory, McGraw-Hill."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1002\/nur.4770140211","article-title":"Focus on psychometrics. Aspects of item analysis","volume":"14","author":"Ferketich","year":"1991","journal-title":"Res. Nurs. Health"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1037\/0021-9010.78.1.98","article-title":"What is coefficient alpha? An examination of theory and applications","volume":"78","author":"Cortina","year":"1993","journal-title":"J. Appl. Psychol."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Streiner, D.L., Norman, G.R., and Cairney, J. (2015). Health Measurement Scales: A Practical Guide to Their Development and Use, Oxford University Press.","DOI":"10.1093\/med\/9780199685219.001.0001"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1111\/j.1468-2389.1993.tb00092.x","article-title":"Exploratory factor analysis: A users\u2019 guide","volume":"1","author":"Ferguson","year":"1993","journal-title":"Int. J. Sel. Assess."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1207\/s15327906mbr0403_8","article-title":"Brief report: Bartlett\u2019s test of sphericity and chance findings in factor analysis","volume":"4","author":"Tobias","year":"1969","journal-title":"Multivar. Behav. Res."},{"key":"ref_59","unstructured":"Tabachnick, B.G., Fidell, L.S., and Ullman, J.B. (2007). Using Multivariate Statistics, Pearson."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1080\/09640560500294376","article-title":"\u2018Green on green\u2019: Public perceptions of wind power in Scotland and Ireland","volume":"48","author":"Warren","year":"2005","journal-title":"J. Environ. Plan. Manag."}],"container-title":["Software"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2674-113X\/3\/1\/1\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:38:09Z","timestamp":1760103489000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2674-113X\/3\/1\/1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,2]]},"references-count":60,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["software3010001"],"URL":"https:\/\/doi.org\/10.3390\/software3010001","relation":{},"ISSN":["2674-113X"],"issn-type":[{"value":"2674-113X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,2]]}}}