{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T01:56:35Z","timestamp":1769738195508,"version":"3.49.0"},"reference-count":58,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T00:00:00Z","timestamp":1736899200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T00:00:00Z","timestamp":1736899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006359","name":"Blekinge Institute of Technology","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006359","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Software Qual J"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>The quality of the test suites and the constituent test cases significantly impacts confidence in software testing. While research has identified several quality attributes of test cases and test suites, there is a need for a better understanding of their relative importance in practice. We investigate practitioners\u2019 perceptions regarding the relative importance of quality attributes of test cases and test suites and the challenges that they face in ensuring the perceived important quality attributes. To capture the practitioners\u2019 perceptions, we conducted an industrial survey using a questionnaire based on the quality attributes identified in an extensive literature review. We used a sampling strategy that leverages LinkedIn to draw a large and heterogeneous sample of professionals with experience in software testing. We collected 354 responses from practitioners with a wide range of experience (from less than one year to 42 years of experience). We found that the majority of practitioners rated Fault Detection, Usability, Maintainability, Reliability, and Coverage to be the most important quality attributes. Resource Efficiency, Reusability, and Simplicity received the most divergent opinions, which, according to our analysis, depend on the software-testing contexts. Also, we identified common challenges that apply to the important attributes, namely inadequate definition, lack of useful metrics, lack of an established review process, and lack of external support. The findings point out where practitioners actually need further support with respect to achieving high-quality test cases and test suites under different software testing contexts. Hence, the findings can serve as a guideline for academic researchers when looking for research directions on the topic. Furthermore, the findings can be used to encourage companies to provide more support to practitioners to achieve high-quality test cases and test suites.<\/jats:p>","DOI":"10.1007\/s11219-024-09698-w","type":"journal-article","created":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T13:15:15Z","timestamp":1736946915000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Quality attributes of test cases and test suites \u2013 importance &amp; challenges from practitioners\u2019 perspectives"],"prefix":"10.1007","volume":"33","author":[{"given":"Huynh Khanh Vi","family":"Tran","sequence":"first","affiliation":[]},{"given":"Nauman bin","family":"Ali","sequence":"additional","affiliation":[]},{"given":"Michael","family":"Unterkalmsteiner","sequence":"additional","affiliation":[]},{"given":"J\u00fcrgen","family":"B\u00f6rstler","sequence":"additional","affiliation":[]},{"given":"Panagiota","family":"Chatzipetrou","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,1,15]]},"reference":[{"key":"9698_CR1","doi-asserted-by":"crossref","unstructured":"Adlemo, A., Tan, H., & Tarasov, V. (2018). Test case quality as perceived in Sweden. In: Proceedings of the 5th International Workshop on Requirements Engineering and Testing (pp. 9\u201312).","DOI":"10.1145\/3195538.3195541"},{"key":"9698_CR2","doi-asserted-by":"crossref","unstructured":"Ali, N. B., Petersen, K., & M\u00e4ntyl\u00e4, M. (2012). Testing highly complex system of systems: An industrial case study. In: Proceedings of the ACM-IEEE International Symposium on Empirical Software Engineering and Mmeasurement (pp. 211\u2013220).","DOI":"10.1145\/2372251.2372290"},{"key":"9698_CR3","doi-asserted-by":"crossref","unstructured":"Aljedaani, W., Peruma, A., Aljohani, A., et\u00a0al. (2021). Test smell detection tools: A systematic mapping study. In: Proceedings of the 25th International Conference on Evaluation and Assessment in Software Engineering (pp. 170\u2013180).","DOI":"10.1145\/3463274.3463335"},{"key":"9698_CR4","unstructured":"Ate\u015fo\u011fullar\u0131, D., & Mishra, A. (2020). Automation testing tools: A comparative view. International Journal on Information Technologies & Security, 12(4)."},{"issue":"11","key":"9698_CR5","doi-asserted-by":"crossref","first-page":"1100","DOI":"10.1109\/TSE.2014.2342227","volume":"40","author":"D Athanasiou","year":"2014","unstructured":"Athanasiou, D., Nugroho, A., Visser, J., et al. (2014). Test code quality and its relation to issue handling performance. IEEE Transactions on Software Engineering, 40(11), 1100\u20131125.","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"4","key":"9698_CR6","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1007\/s10664-021-10072-8","volume":"27","author":"S Baltes","year":"2022","unstructured":"Baltes, S., & Ralph, P. (2022). Sampling in software engineering research: a critical review and guidelines. Empirical Software Engineering, 27(4), 94.","journal-title":"Empirical Software Engineering"},{"key":"9698_CR7","doi-asserted-by":"crossref","unstructured":"Bertolino, A. (2007). Software testing research: Achievements, challenges, dreams. In: Proceedings of the Future of Software Engineering (FOSE\u201907) (pp. 85\u2013103). IEEE.","DOI":"10.1109\/FOSE.2007.25"},{"key":"9698_CR8","doi-asserted-by":"crossref","unstructured":"Bowes, D., Hall, T., Petri\u0107, J., et\u00a0al. (2017). How good are my tests? In: Proceedings of the International Workshop on Emerging Trends in Software Metrics (pp. 9\u201314). WETSoM.","DOI":"10.1109\/WETSoM.2017.2"},{"issue":"2","key":"9698_CR9","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1007\/s11219-019-09465-2","volume":"28","author":"P Chatzipetrou","year":"2020","unstructured":"Chatzipetrou, P., Papatheocharous, E., Wnuk, K., et al. (2020). Component attributes and their importance in decisions and component selection. Software Quality Journal, 28(2), 567\u2013593.","journal-title":"Software Quality Journal"},{"issue":"1","key":"9698_CR10","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/52.903172","volume":"18","author":"Y Chernak","year":"2001","unstructured":"Chernak, Y. (2001). Validating and improving test-case effectiveness. IEEE Software, 18(1), 81\u201386.","journal-title":"IEEE Software"},{"key":"9698_CR11","doi-asserted-by":"crossref","unstructured":"Cruzes, D. S., & Dyba, T. (2011). Recommended steps for thematic synthesis in software engineering. In: 2011 International Symposium on Empirical Software Engineering and Measurement (pp. 275\u2013284).","DOI":"10.1109\/ESEM.2011.36"},{"key":"9698_CR12","doi-asserted-by":"crossref","unstructured":"Daka, E., Campos, J., Fraser, G., et\u00a0al. (2015). Modeling readability to improve unit tests. In: Proceeedings of the 10th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (pp. 107\u2013118). ESEC\/FSE 2015.","DOI":"10.1145\/2786805.2786838"},{"key":"9698_CR13","unstructured":"de\u00a0Mello, R. M., da\u00a0Silva, P. C., & Travassos, G. H. (2014). Investigating probabilistic sampling approaches for large-scale surveys in software engineering. In: Proceedings of the 17th Ibero-American Conference Software Engineering, CIBSE (pp. 364\u2013377)."},{"key":"9698_CR14","doi-asserted-by":"crossref","unstructured":"De\u00a0Oliveira\u00a0Neto, F. G., Feldt, R., Erlenhov, L., et\u00a0al. (2018). Visualizing test diversity to support test optimisation. In: Proceedings of the Asia-Pacific Software Engineering Conference, APSEC (pp. 149\u2013158).","DOI":"10.1109\/APSEC.2018.00029"},{"issue":"1","key":"9698_CR15","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1080\/10871200903244250","volume":"15","author":"MD Duda","year":"2010","unstructured":"Duda, M. D., & Nobile, J. L. (2010). The fallacy of online surveys: No data are better than bad data. Human Dimensions of Wildlife, 15(1), 55\u201364.","journal-title":"Human Dimensions of Wildlife"},{"key":"9698_CR16","doi-asserted-by":"crossref","unstructured":"Feitosa, D., Ampatzoglou, A., Avgeriou, P., et\u00a0al. (2015). Investigating quality trade-offs in open source critical embedded systems. In: Proceedings of the 11th International ACM SIGSOFT Conference on Quality of Software Architectures (pp. 113\u2013122). Association for Computing Machinery, New York, NY, USA, QoSA \u201915.","DOI":"10.1145\/2737182.2737190"},{"key":"9698_CR17","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1016\/j.jss.2015.06.063","volume":"123","author":"B Fitzgerald","year":"2017","unstructured":"Fitzgerald, B., & Stol, K. J. (2017). Continuous software engineering: A roadmap and agenda. Journal of Systems and Software, 123, 176\u2013189.","journal-title":"Journal of Systems and Software"},{"key":"9698_CR18","doi-asserted-by":"crossref","unstructured":"Forward, A., & Lethbridge, T. C. (2008). A taxonomy of software types to facilitate search and evidence-based software engineering. In: Proceedings of the Conference of the Center for Advanced Studies, CASCON\u201908.","DOI":"10.1145\/1463788.1463807"},{"key":"9698_CR19","doi-asserted-by":"crossref","unstructured":"Fulcini, T., Coppola, R., Ardito, L., et\u00a0al. (2023). A review on tools, mechanics, benefits, and challenges of gamified software testing. ACM Computing Surveys, 55(14s).","DOI":"10.1145\/3582273"},{"key":"9698_CR20","doi-asserted-by":"crossref","first-page":"999","DOI":"10.3758\/s13428-013-0328-z","volume":"45","author":"MA Garc\u00eda-P\u00e9rez","year":"2013","unstructured":"Garc\u00eda-P\u00e9rez, M. A. (2013). Statistical criteria for parallel tests: A comparison of accuracy and power. Behavior Research Methods, 45, 999\u20131010.","journal-title":"Behavior Research Methods"},{"key":"9698_CR21","doi-asserted-by":"crossref","unstructured":"Garousi, V., Felderer, M., Kuhrmann, M., et\u00a0al. (2017). What industry wants from academia in software testing? hearing practitioners\u2019 opinions. In: Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering (pp. 65\u201369).","DOI":"10.1145\/3084226.3084264"},{"key":"9698_CR22","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.infsof.2014.06.009","volume":"58","author":"V Garousi","year":"2015","unstructured":"Garousi, V., Amannejad, Y., & Betin Can, A. (2015). Software test-code engineering: A systematic mapping. Information and Software Technology, 58, 123\u2013147.","journal-title":"Information and Software Technology"},{"issue":"8","key":"9698_CR23","first-page":"e2251","volume":"32","author":"V Garousi","year":"2020","unstructured":"Garousi, V., Felderer, M., Kuhrmann, M., et al. (2020). Exploring the industry\u2019s challenges in software testing: An empirical study. Journal of Software: Evolution and Process, 32(8), e2251.","journal-title":"Journal of Software: Evolution and Process"},{"key":"9698_CR24","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.jss.2017.12.013","volume":"138","author":"V Garousi","year":"2018","unstructured":"Garousi, V., & K\u00fc\u00e7\u00fck, B. (2018). Smells in software test code: A survey of knowledge in industry and academia. Journal of Systems and Software, 138, 52\u201381.","journal-title":"Journal of Systems and Software"},{"issue":"3","key":"9698_CR25","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/MS.2018.2875843","volume":"36","author":"V Garousi","year":"2019","unstructured":"Garousi, V., Kucuk, B., & Felderer, M. (2019). What we know about smells in software test code. IEEE Software, 36(3), 61\u201373.","journal-title":"IEEE Software"},{"key":"9698_CR26","doi-asserted-by":"crossref","unstructured":"Goodenough, J. B., & Gerhart, S. L. (1975). Toward a theory of test data selection. IEEE Transactions on Software Engineering, SE-1(2), 156\u2013173.","DOI":"10.1109\/TSE.1975.6312836"},{"key":"9698_CR27","doi-asserted-by":"crossref","unstructured":"Grano, G., De\u00a0Iaco, C., Palomba, F., et\u00a0al. (2020). Pizza versus pinsa: On the perception and measurability of unit test code quality. In: Proceedings of the 36th IEEE International Conference on Software Maintenance and Evolution (pp. 336\u2013347). IEEE.","DOI":"10.1109\/ICSME46990.2020.00040"},{"key":"9698_CR28","doi-asserted-by":"crossref","unstructured":"Grano, G., Scalabrino, S., Gall, H. C., et\u00a0al. (2018). An empirical investigation on the readability of manual and generated test cases. In: Proceedings of the 26th Conference on Program Comprehension (pp. 348\u2013351). ACM, ICPC \u201918.","DOI":"10.1145\/3196321.3196363"},{"key":"9698_CR29","unstructured":"ISO\/IEC JTC\u00a01\/SC\u00a07 Software and systems engineering (2011). ISO\/IEC 25010:2011 Systems and software engineering \u2013 Systems and software Quality Requirements and Evaluation (SQuaRE) \u2013 System and software quality models. https:\/\/www.iso.org\/standard\/35733.html"},{"key":"9698_CR30","doi-asserted-by":"crossref","unstructured":"Jabbari, R., bin Ali N, Petersen K, et al. (2018). Towards a benefits dependency network for devops based on a systematic literature review. Journal of Software: Evolution and Process, 30(11), e1957.","DOI":"10.1002\/smr.1957"},{"issue":"1","key":"9698_CR31","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1007\/s11219-020-09523-0","volume":"29","author":"K Juhnke","year":"2021","unstructured":"Juhnke, K., Tichy, M., & Houdek, F. (2021). Challenges concerning test case specifications in automotive software testing: assessment of frequency and criticality. Software Quality Journal, 29(1), 39\u2013100.","journal-title":"Software Quality Journal"},{"issue":"5","key":"9698_CR32","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1145\/949952.940086","volume":"28","author":"GM Kapfhammer","year":"2003","unstructured":"Kapfhammer, G. M., & Soffa, M. L. (2003). A family of test adequacy criteria for database-driven applications. ACM SIGSOFT Software Engineering Notes, 28(5), 98\u2013107.","journal-title":"ACM SIGSOFT Software Engineering Notes"},{"key":"9698_CR33","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/978-1-84800-044-5_3","volume-title":"Guide to Advanced Empirical Software Engineering","author":"BA Kitchenham","year":"2008","unstructured":"Kitchenham, B. A., & Pfleeger, S. L. (2008). Personal opinion surveys. In F. Shull, J. Singer, & D. I. K. Sj\u00f8berg (Eds.), Guide to Advanced Empirical Software Engineering (pp. 63\u201392). Springer."},{"key":"9698_CR34","doi-asserted-by":"crossref","unstructured":"Kochhar, P. S., Xia, X., & Lo, D. (2019). Practitioners\u2019 views on good software testing practices. In: Proceeedings of the 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) (pp. 61\u201370). IEEE.","DOI":"10.1109\/ICSE-SEIP.2019.00015"},{"key":"9698_CR35","doi-asserted-by":"crossref","unstructured":"Kotonya, G., Sommerville, I., & Hall, S. (2003). Towards a classification model for component-based software engineering research. In: Proceedings of the 29th EUROMICRO Conference (pp. 43\u201352).","DOI":"10.1109\/EURMIC.2003.1231566"},{"issue":"1","key":"9698_CR36","first-page":"43","volume":"19","author":"J Kotrlik","year":"2001","unstructured":"Kotrlik, J., & Higgins, C. (2001). Organizational research: Determining appropriate sample size in survey research appropriate sample size in survey research. Information Technology, Learning, and Performance Journal, 19(1), 43.","journal-title":"Information Technology, Learning, and Performance Journal"},{"key":"9698_CR37","doi-asserted-by":"crossref","first-page":"77","DOI":"10.2478\/ausi-2014-0006","volume":"5","author":"A Kov\u00e1cs","year":"2014","unstructured":"Kov\u00e1cs, A., & Szabados, K. (2014). Test software quality issues and connections to international standards. Acta Universitatis Sapientiae, Informatica, 5, 77\u2013102.","journal-title":"Acta Universitatis Sapientiae, Informatica"},{"issue":"6","key":"9698_CR38","doi-asserted-by":"crossref","first-page":"862","DOI":"10.1016\/j.jss.2006.08.022","volume":"80","author":"OAL Lemos","year":"2007","unstructured":"Lemos, O. A. L., Vincenzi, A. M. R., Maldonado, J. C., et al. (2007). Control and data flow structural testing criteria for aspect-oriented programs. Journal of Systems and Software, 80(6), 862\u2013882.","journal-title":"Journal of Systems and Software"},{"key":"9698_CR39","doi-asserted-by":"crossref","unstructured":"Lo, D., Nagappan, N., & Zimmermann, T. (2015). How practitioners perceive the relevance of software engineering research. In: Proceeedings of the 10th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, ESEC\/FSE (pp. 415\u2013425).","DOI":"10.1145\/2786805.2786809"},{"key":"9698_CR40","volume-title":"xUnit Test Patterns: Refactoring Test Code","author":"G Meszaros","year":"2007","unstructured":"Meszaros, G. (2007). xUnit Test Patterns: Refactoring Test Code (1st ed.). Addison-Wesley Professional.","edition":"1"},{"issue":"4","key":"9698_CR41","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1007\/s10009-008-0075-0","volume":"10","author":"H Neukirchen","year":"2008","unstructured":"Neukirchen, H., Zeiss, B., & Grabowski, J. (2008). An approach to quality engineering of TTCN-3 test specifications. International Journal on Software Tools for Technology Transfer, 10(4), 309.","journal-title":"International Journal on Software Tools for Technology Transfer"},{"key":"9698_CR42","doi-asserted-by":"crossref","unstructured":"Pei, K., Cao, Y., Yang, J., et\u00a0al. (2017). Deepxplore: Automated whitebox testing of deep learning systems. In: Proceedings of the 26th ACM Symposium on Operating Systems Principles - SOSP (pp. 1\u201318).","DOI":"10.1145\/3132747.3132785"},{"key":"9698_CR43","doi-asserted-by":"crossref","unstructured":"Ray, B., Posnett, D., Filkov, V., et\u00a0al. (2014). A large scale study of programming languages and code quality in github. In: Proceedings of the ACM SIGSOFT Symposium on the Foundations of Software Engineering (pp. 155\u2013165).","DOI":"10.1145\/2635868.2635922"},{"key":"9698_CR44","doi-asserted-by":"crossref","unstructured":"Santos, R. E., Bener, A., Baldassarre, M. T., et\u00a0al. (2019). Mind the gap: Are practitioners and researchers in software testing speaking the same language? In: Proceeedings of the 7th International Workshop on Conducting Empirical Studies in Industry (CESI) and 6th International Workshop on Software Engineering Research and Industrial Practice (SER &IP) (pp. 10\u201317).","DOI":"10.1109\/CESSER-IP.2019.00010"},{"issue":"2","key":"9698_CR45","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1007\/s11219-019-09478-x","volume":"28","author":"D Sas","year":"2020","unstructured":"Sas, D., & Avgeriou, P. (2020). Quality attribute trade-offs in the embedded systems industry: An exploratory case study. Software Quality Journal, 28(2), 505\u2013534.","journal-title":"Software Quality Journal"},{"key":"9698_CR46","doi-asserted-by":"crossref","DOI":"10.1201\/9780429186196","volume-title":"Handbook of parametric and nonparametric statistical procedures","author":"DJ Sheskin","year":"2020","unstructured":"Sheskin, D. J. (2020). Handbook of parametric and nonparametric statistical procedures. CRC Press."},{"key":"9698_CR47","unstructured":"Software IJS, systems engineering (2022) Iso\/iec\/ieee International Standard - Software and Systems Engineering \u2013Software Testing \u2013Part 1:General Concepts. ISO\/IEC\/IEEE 29119-1:2022(E) (pp. 1\u201360)."},{"issue":"1","key":"9698_CR48","doi-asserted-by":"crossref","first-page":"59","DOI":"10.3233\/AO-170177","volume":"12","author":"\u00c9Fd Souza","year":"2017","unstructured":"Souza, \u00c9Fd., Falbo, Rd. A., & Vijaykumar, N. L. (2017). ROoST: Reference ontology on software testing. Applied Ontology, 12(1), 59\u201390.","journal-title":"Applied Ontology"},{"key":"9698_CR49","doi-asserted-by":"crossref","unstructured":"Spadini, D., Palomba, F., Zaidman, A., et\u00a0al. (2018). On the relation of test smells to software code quality. In: Proceedings of IEEE International Conference on Software Maintenance and Evolution (ICSME) (pp. 1\u201312).","DOI":"10.1109\/ICSME.2018.00010"},{"key":"9698_CR50","doi-asserted-by":"crossref","unstructured":"Tran, H. K. V., Ali, N. B., B\u00f6rstler, J., et\u00a0al. (2019). Test-Case Quality \u2013 Understanding Practitioners\u2019 Perspectives. In: Proceedings of the 20th International Conference on Product-Focused Software Process Improvement (PROFES) (pp. 37\u201352). Springer.","DOI":"10.1007\/978-3-030-35333-9_3"},{"key":"9698_CR51","doi-asserted-by":"crossref","first-page":"106620","DOI":"10.1016\/j.infsof.2021.106620","volume":"139","author":"HKV Tran","year":"2021","unstructured":"Tran, H. K. V., Unterkalmsteiner, M., B\u00f6rstler, J., et al. (2021). Assessing test artifact quality\u2013a tertiary study. Information and Software Technology, 139, 106620.","journal-title":"Information and Software Technology"},{"key":"9698_CR52","unstructured":"Van\u00a0Deursen, A., Moonen, L., Van Den\u00a0Bergh. A,, et\u00a0al. (2001) Refactoring test code. In: Proceedings of the 2nd International Conference on Extreme Programming and Flexible Processes in Software Engineering (XP) (pp. 92\u201395)."},{"issue":"5","key":"9698_CR53","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1109\/MS.2015.26","volume":"33","author":"LR Vijayasarathy","year":"2016","unstructured":"Vijayasarathy, L. R., & Butler, C. W. (2016). Choice of software development methodologies: Do organizational, project, and team characteristics matter? IEEE Software, 33(5), 86\u201394.","journal-title":"IEEE Software"},{"key":"9698_CR54","doi-asserted-by":"crossref","unstructured":"Wahler, M., Eidenbenz, R., Monot, A., et\u00a0al. (2017). Quality attribute trade-offs in industrial software systems. In: Proceedings of the IEEE International Conference on Software Architecture Workshops (ICSAW) (pp. 251\u2013254).","DOI":"10.1109\/ICSAW.2017.10"},{"key":"9698_CR55","doi-asserted-by":"crossref","first-page":"111061","DOI":"10.1016\/j.jss.2021.111061","volume":"182","author":"M Waseem","year":"2021","unstructured":"Waseem, M., Liang, P., Shahin, M., et al. (2021). Design, monitoring, and testing of microservices systems: The practitioners\u2019 perspective. Journal of Systems and Software, 182, 111061.","journal-title":"Journal of Systems and Software"},{"key":"9698_CR56","doi-asserted-by":"crossref","unstructured":"Zaidman, A., Van\u00a0Rompaey, B., Demeyer, S., et\u00a0al. (2008). Mining software repositories to study co-evolution of production & test code. In: Proceedings of the 1st International Conference on Software Testing, Verification and Validation, ICST 2008 (pp. 220\u2013229).","DOI":"10.1109\/ICST.2008.47"},{"key":"9698_CR57","unstructured":"Zeiss, B., Vega, D., Schieferdecker, I., et\u00a0al. (2007). Applying the ISO 9126 quality model to test specifications\u2013exemplified for TTCN-3 test specifications. In: Software Engineering 2007\u2013Fachtagung des GI-Fachbereichs Softwaretechnik"},{"issue":"4","key":"9698_CR58","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1145\/267580.267590","volume":"29","author":"H Zhu","year":"1997","unstructured":"Zhu, H., Hall, P. A., & May, J. H. (1997). Software unit test coverage and adequacy. ACM Computing Surveys, 29(4), 366\u2013427.","journal-title":"ACM Computing Surveys"}],"container-title":["Software Quality Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-024-09698-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11219-024-09698-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-024-09698-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,30]],"date-time":"2025-03-30T21:36:09Z","timestamp":1743370569000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11219-024-09698-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,15]]},"references-count":58,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["9698"],"URL":"https:\/\/doi.org\/10.1007\/s11219-024-09698-w","relation":{},"ISSN":["0963-9314","1573-1367"],"issn-type":[{"value":"0963-9314","type":"print"},{"value":"1573-1367","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,15]]},"assertion":[{"value":"17 October 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 January 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Before deciding to answer the survey questionnaire, the participants were informed that the survey was anonymous such that their identities were not retained (stated in the introduction of the survey instrument).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval and Consent to Participate"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing nterests"}},{"value":"Before deciding to answer the survey questionnaire, the participants were informed that only aggregated results would be published in a scientific publication (stated in the introduction of the survey instrument).","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}}],"article-number":"9"}}