{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T17:07:55Z","timestamp":1778864875058,"version":"3.51.4"},"reference-count":128,"publisher":"Association for Computing Machinery (ACM)","issue":"12","license":[{"start":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T00:00:00Z","timestamp":1778803200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2026,9,30]]},"abstract":"<jats:p>Minimizing software testing efforts and improving test effectiveness at the design level has paramount importance and garnered substantial research attention during software engineering practice. We present a systematic literature review of \u201cdesign for testability\u201d in software systems, particularly the approaches, tools, artifacts, granularity, and testing levels, benchmarks, metrics, and affected quality attributes. Most studies focus on testability measurement with correlation analysis at the class level in object-oriented systems, using source code and UML diagrams. Java is the predominant programming language, and over half of the solutions are dedicated to unit testing. The lack of design for testability at various abstraction levels, disagreement on the impact of design metrics on testability, and the lack of examining approaches in non-object-oriented programming paradigms are critical challenges in \u201cdesign for testability\u201d.<\/jats:p>","DOI":"10.1145\/3787493","type":"journal-article","created":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T07:25:48Z","timestamp":1778225148000},"page":"1-44","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["A Systematic Literature Review on Design for Testability Approaches in Software Systems"],"prefix":"10.1145","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-7319-4296","authenticated-orcid":false,"given":"Narges","family":"Abbasi","sequence":"first","affiliation":[{"name":"School of Computer Engineering, Iran University of Science and Technology","place":["Tehran, Iran"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4381-2773","authenticated-orcid":false,"given":"Saeed","family":"Parsa","sequence":"additional","affiliation":[{"name":"School of Computer Engineering, Iran University of Science and Technology","place":["Tehran, Iran"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4289-0606","authenticated-orcid":false,"given":"Morteza","family":"Zakeri","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Amirkabir University of Technology (Tehran Polytechnic)","place":["Tehran, Iran"]},{"name":"School of Computer Science, Institute for Research in Fundamental Sciences","place":["Tehran, Iran"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,5,15]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.5555\/533100"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/METRIC.2002.1011325"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/METRIC.2003.1232455"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/1134285.1134469"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/52.382180"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/CSMR.1998.665760"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2006.02.036"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2005.17"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2018.12.003"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2024.107511"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3453478"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2005.01.006"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3439961.3439972"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/182987.184077"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/AUTEST.2001.948921"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.295895"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/0164-1212(94)90099-X"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/302405.302654"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.544352"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/METRIC.1996.492446"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.935855"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2005.112"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/METRIC.1999.809745"},{"key":"e_1_3_3_25_2","volume-title":"Software Engineering at Google: Lessons Learned from Programming Over Time","author":"Winters Titus","year":"2020","unstructured":"Titus Winters, Tom Manshreck, and Hyrum Wright. 2020. Software Engineering at Google: Lessons Learned from Programming Over Time. O'Reilly Media."},{"key":"e_1_3_3_26_2","unstructured":"2025. google\/guice: Guice (pronounced \u2019juice\u2019) is a lightweight dependency injection framework for Java 11 and above brought to you by Google. Retrieved July 22 2025 from https:\/\/github.com\/google\/guice"},{"key":"e_1_3_3_27_2","unstructured":"2025. Dagger. Retrieved July 22 2025 from https:\/\/dagger.dev\/"},{"key":"e_1_3_3_28_2","volume-title":"Object-Oriented Analysis and Design with Applications","author":"Maksimchuk Robert A.","year":"2007","unstructured":"Robert A. Maksimchuk, Michael W. Engle, Bobbi J. Young, Jim Conallen, Kelli A. Houston, and Grady Booch. 2007. Object-Oriented Analysis and Design with Applications, Addison-Wesley Professional (Ed.). Retrieved from www.awprofessional.com\/otseries"},{"key":"e_1_3_3_29_2","volume-title":"Refactoring: Improving the Design of Existing Code","author":"Fowler Martin","year":"1999","unstructured":"Martin Fowler, Kent Beck, John Brant, William Opdyke, and don Roberts. 1999. Refactoring: Improving the Design of Existing Code. Addison-Wesley Longman Publishing Co."},{"key":"e_1_3_3_30_2","author":"Martin Robert C.","year":"2017","unstructured":"Robert C. Martin. 2017. Clean Architecture: A Craftsman's Guide to Software Structure and Design, Pearson (Ed.). (2017).","journal-title":"Clean Architecture: A Craftsman's Guide to Software Structure and Design"},{"key":"e_1_3_3_31_2","author":"Suryanarayana G.","unstructured":"G. Suryanarayana, G. Samarthyam, and T. Sharma. 2014. Refactoring for Software Design Smells\u202f: Managing Technical Debt. Morgan Kaufmann.","journal-title":"Refactoring for Software Design Smells\u202f: Managing Technical Debt"},{"key":"e_1_3_3_32_2","volume-title":"Object-oriented Software Construction","author":"Meyer Bertrand","year":"1997","unstructured":"Bertrand Meyer. 1997. Object-oriented Software Construction (2nd ed.). Division of simon and schuster one lake street upper saddle river, NJ, United States: Prentice-Hall, Inc..","edition":"2"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2005.09.003"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2018.12.003"},{"key":"e_1_3_3_35_2","unstructured":"IEEE. 1990. IEEE standard glossary of software engineering terminology. IEEE Computer Sociey 1990."},{"key":"e_1_3_3_36_2","unstructured":"2024. ISO\/IEC 25010:2011 - Systems and software engineering \u2014 Systems and software Quality Requirements and Evaluation (SQuaRE) \u2014 System and software quality models. Retrieved May 24 2024 from https:\/\/www.iso.org\/standard\/35733.html"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1002\/int.22722"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/CSICC52343.2021.9420548"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2022.109562"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.5555\/861448"},{"key":"e_1_3_3_41_2","volume-title":"Digital Systems Testing and Testable Design","author":"Abramovici Miron","year":"1990","unstructured":"Miron Abramovici, Melvin A. Breuer, and Arthur D. Friedman. 1990. Digital Systems Testing and Testable Design. Computer Science Press."},{"issue":"5","key":"e_1_3_3_42_2","first-page":"34","article-title":"Design for testability for object-oriented software","volume":"7","author":"Payne Jeffery E.","year":"1997","unstructured":"Jeffery E. Payne, Roger T. Alexander, and Charles D. Hutchinson. 1997. Design for testability for object-oriented software. Object Magzine 7, 5 (1997), 34\u201343.","journal-title":"Object Magzine"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/AUTEST.2011.6058776"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.357"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCCT.2010.5640467"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2012.04.007"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-014-9338-4"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442694"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/GUCON.2018.8675006"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1049\/iet-sen.2018.5446"},{"key":"e_1_3_3_51_2","author":"Kitchenham Barbara","year":"2007","unstructured":"Barbara Kitchenham and Charters. 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical report, EBSE Technical Report EBSE-2007-01.","journal-title":"Guidelines for Performing Systematic Literature Reviews in Software Engineering"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/2976767.2976795"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/PLEASE.2013.6608666"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639206"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3624486.3624494"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/2601248.2601268"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/2961111.2962630"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/SCAM.2004.16"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-002-0004-8"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICICS55353.2022.9811192"},{"key":"e_1_3_3_61_2","article-title":"Object-oriented measures as testability indicators: An empirical study","author":"Bajeh Amos O.","year":"2020","unstructured":"Amos O. Bajeh, Onilede-Jacobs Oluwatosin, Shuib Basri, Abimbola G. Akintola, and Abdullateef O. Balogun. 2020. Object-oriented measures as testability indicators: An empirical study. Journal of Engineering Science and Technology 15, 2 (April 2020), 1092--1108.","journal-title":"Journal of Engineering Science and Technology"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","unstructured":"J. Petri\u0107 T. Hall and D. Bowes. 2020. Zones of pain: Visualising the relationship between software architecture and defects. 266 (2020) 135\u2013143. DOI:10.1007\/978-3-030-58793-2_11","DOI":"10.1007\/978-3-030-58793-2_11"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.02.024"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","unstructured":"A. O. Bajeh S. Basri and L. T. Jung. 2015. An empirical validation of coupling and cohesion metrics as testability indicators. 339 (2015) 915\u2013922. DOI:10.1007\/978-3-662-46578-3_109","DOI":"10.1007\/978-3-662-46578-3_109"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-012-4745-x"},{"issue":"2","key":"e_1_3_3_66_2","first-page":"69","article-title":"An empirical analysis of lack of cohesion metrics for predicting testability of classes","volume":"5","author":"Badri L.","year":"2011","unstructured":"L. Badri, M. Badri, and F. Tour\u00e9. 2011. An empirical analysis of lack of cohesion metrics for predicting testability of classes. International Journal of Software Engineering and Its Applications 5, 2 (2011), 69\u201385.","journal-title":"International Journal of Software Engineering and Its Applications"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","unstructured":"M. Nazir and R. A. Khan. 2012. Testability estimation model (TEMOOD). 86 (2012) 178\u2013187. DOI:10.1007\/978-3-642-27317-9_19","DOI":"10.1007\/978-3-642-27317-9_19"},{"key":"e_1_3_3_68_2","volume-title":"Proceedings of the 23rd International Conference on Software Engineering and Knowledge Engineering","author":"Badri M.","year":"2011","unstructured":"M. Badri and F. Tour\u00e9. 2011. Empirical analysis for investigating the effect of control flow dependencies on testability of classes. In Proceedings of the 23rd International Conference on Software Engineering and Knowledge Engineering."},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","unstructured":"L. Badri M. Badri and F. Toure. 2010. Exploring empirically the relationship between lack of cohesion and testability in object-oriented systems. 117 (2010) 78\u201392. DOI:10.1007\/978-3-642-17578-7_9","DOI":"10.1007\/978-3-642-17578-7_9"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/3530019.3535347"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/1507195.1507204"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3524843.3528092"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/1988997.1989020"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/DASC.2011.6096129"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSA.2015.25"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSEA.2009.27"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1109\/SCCC.2017.8405117"},{"key":"e_1_3_3_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2002.1167775"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2008.27"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDIM.2007.369323"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.1109\/SCAM55253.2022.00013"},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1109\/SCCC.2016.7835998"},{"key":"e_1_3_3_83_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2015.7107407"},{"key":"e_1_3_3_84_2","volume-title":"Proceedings of the 12th International Workshop on Software Measurement","author":"Jungmayr S.","year":"2002","unstructured":"S. Jungmayr. 2002. Testability measurement and software dependencies. In Proceedings of the 12th International Workshop on Software Measurement."},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.4236\/jsea.2012.57060"},{"key":"e_1_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.5220\/0004883400380047"},{"key":"e_1_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.17706\/jsw.12.8.671-681"},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.387"},{"key":"e_1_3_3_89_2","doi-asserted-by":"publisher","unstructured":"A. Tahir S. MacDonell and J. Buchan. 2015. A study of the relationship between class testability and runtime properties. 551 (2015) 63\u201378. DOI:10.1007\/978-3-319-27218-4_5","DOI":"10.1007\/978-3-319-27218-4_5"},{"key":"e_1_3_3_90_2","doi-asserted-by":"publisher","DOI":"10.1504\/IJCAT.2012.048204"},{"key":"e_1_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1109\/IC3I.2014.7019595"},{"key":"e_1_3_3_92_2","unstructured":"2024. ANTLR. Retrieved August 08 2024 from https:\/\/www.antlr.org\/"},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-023-10373-0"},{"key":"e_1_3_3_94_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-018-9651-4"},{"key":"e_1_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397366"},{"key":"e_1_3_3_96_2","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635920"},{"key":"e_1_3_3_97_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2024.3458184"},{"key":"e_1_3_3_98_2","unstructured":"2024. Borland history and product links | opentext. Retrieved March 03 2024 from https:\/\/www.microfocus.com\/en-us\/products\/borland\/overview"},{"key":"e_1_3_3_99_2","unstructured":"2024. Eclipse metrics plugin continued. Retrieved March 03 2024 from https:\/\/metrics2.sourceforge.net\/"},{"key":"e_1_3_3_100_2","unstructured":"2024. GitHub - marceloeler\/CP4SE: constraing profiling for symbolic execution. Retrieved March 03 2024 from https:\/\/github.com\/marceloeler\/CP4SE"},{"key":"e_1_3_3_101_2","unstructured":"2024. GitHub - lancsunise\/JavaMetrics: Powerful and extensible Java static code metric tool that works on source code. Retrieved March 03 2024 from https:\/\/github.com\/lancsunise\/JavaMetrics"},{"key":"e_1_3_3_102_2","unstructured":"2024. MetricsReloaded - IntelliJ IDEs plugin | marketplace. Retrieved March 03 2024 from https:\/\/plugins.jetbrains.com\/plugin\/93-metricsreloaded"},{"key":"e_1_3_3_103_2","unstructured":"2024. SDMetrics - the design quality metrics tool for UML models. Retrieved March 03 2024 from https:\/\/www.sdmetrics.com\/"},{"key":"e_1_3_3_104_2","unstructured":"2024. Understand: The software developer's multi-tool. Retrieved March 03 2024 from https:\/\/scitools.com\/"},{"key":"e_1_3_3_105_2","unstructured":"2024. Cenqua clover code coverage for Java. Retrieved March 03 2024 from https:\/\/cenqua.com\/"},{"key":"e_1_3_3_106_2","unstructured":"2024. prot\u00e9g\u00e9. Retrieved March 03 2024 from https:\/\/protege.stanford.edu\/"},{"key":"e_1_3_3_107_2","unstructured":"2024. Apache commons BCELTM \u2013 home. Retrieved March 03 2024 from https:\/\/commons.apache.org\/proper\/commons-bcel\/"},{"key":"e_1_3_3_108_2","unstructured":"2024. Classycle. Retrieved March 03 2024 from https:\/\/classycle.sourceforge.net\/"},{"key":"e_1_3_3_109_2","unstructured":"2024. Hyams development. Retrieved March 03 2024 from https:\/\/www.curveexpert.net\/"},{"key":"e_1_3_3_110_2","unstructured":"2024. EMMA: a free Java code coverage tool. Retrieved March 03 2024 from https:\/\/emma.sourceforge.net\/"},{"key":"e_1_3_3_111_2","unstructured":"2024. EclEmma - Java code coverage for eclipse. Retrieved March 03 2024 from https:\/\/www.eclemma.org\/"},{"key":"e_1_3_3_112_2","unstructured":"2024. GitHub - clarkware\/jdepend: A Java package dependency analyzer that generates design quality metrics. Retrieved March 03 2024 from https:\/\/github.com\/clarkware\/jdepend"},{"key":"e_1_3_3_113_2","unstructured":"2024. EclEmma - JaCoCo Java code coverage library. Retrieved March 03 2024 from https:\/\/www.eclemma.org\/jacoco\/"},{"key":"e_1_3_3_114_2","unstructured":"2024. JTracor: A framework to trace execution of java programs. Retrieved March 03 2024 from http:\/\/franck.fleurey.free.fr\/JTracor\/index.htm"},{"key":"e_1_3_3_115_2","unstructured":"2024. objectaid.com. Retrieved March 03 2024 from http:\/\/www1.objectaid.com\/?tm=1&subid4=1709492385.0304310000&KW1=UML%20Diagram%20Design%20Tool&KW2=Sequence%20Diagram%20Tool&KW3=Software%20Update%20Management%20Tools&searchbox=0&domainname=0&backfill=0"},{"key":"e_1_3_3_116_2","unstructured":"2024. PIT mutation testing. Retrieved March 03 2024 from https:\/\/pitest.org\/"},{"key":"e_1_3_3_117_2","unstructured":"2024. R: The R project for statistical computing. Retrieved March 03 2024 from https:\/\/www.r-project.org\/"},{"key":"e_1_3_3_118_2","unstructured":"2024. Umetrics suite of data analytics software | sartorius. Retrieved March 03 2024 from https:\/\/www.sartorius.com\/en\/products\/process-analytical-technology\/data-analytics-software"},{"key":"e_1_3_3_119_2","unstructured":"2024. IBM SPSS statistics. Retrieved March 03 2024 from https:\/\/www.ibm.com\/br-pt\/products\/spss-statistics"},{"key":"e_1_3_3_120_2","unstructured":"2024. TestLink. Retrieved March 03 2024 from https:\/\/testlink.org\/"},{"key":"e_1_3_3_121_2","unstructured":"2024. Home \u00b7 TortoiseSVN. Retrieved March 03 2024 from https:\/\/tortoisesvn.net\/"},{"key":"e_1_3_3_122_2","unstructured":"2024. Wind River Diab compiler | for safety-critical applications. Retrieved March 03 2024 from https:\/\/www.windriver.com\/products\/diab-compiler-old"},{"key":"e_1_3_3_123_2","unstructured":"2024. XLSTAT | Statistical software for excel. Retrieved March 03 2024 from https:\/\/www.xlstat.com\/en\/"},{"key":"e_1_3_3_124_2","unstructured":"2024. JHawk - the java metrics tool - product overview. Retrieved March 03 2024 from http:\/\/www.virtualmachinery.com\/jhawkprod.htm"},{"key":"e_1_3_3_125_2","unstructured":"2024. JUnit 5. Retrieved March 03 2024 from https:\/\/junit.org\/junit5\/"},{"key":"e_1_3_3_126_2","unstructured":"2024. Machine learning project at the University of Waikato in New Zealand. Retrieved March 03 2024 from https:\/\/www.cs.waikato.ac.nz\/ml\/index.html"},{"key":"e_1_3_3_127_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2016.44"},{"key":"e_1_3_3_128_2","unstructured":"2025. GitHub Actions \u00b7 GitHub. Retrieved July 08 2025 from https:\/\/github.com\/features\/actions"},{"key":"e_1_3_3_129_2","doi-asserted-by":"publisher","unstructured":"D. E. Rzig A. Houerbi R. G. Chavan and F. Hassan. 2025. Empirical analysis on CI\/CD pipeline evolution in machine learning projects. DOI:10.48550\/arXiv.2403.12199","DOI":"10.48550\/arXiv.2403.12199"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3787493","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T16:10:56Z","timestamp":1778861456000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3787493"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,15]]},"references-count":128,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2026,9,30]]}},"alternative-id":["10.1145\/3787493"],"URL":"https:\/\/doi.org\/10.1145\/3787493","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,15]]},"assertion":[{"value":"2024-10-14","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-12-26","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-05-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}