{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T03:28:40Z","timestamp":1783740520887,"version":"3.55.0"},"reference-count":84,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2015,9,2]],"date-time":"2015-09-02T00:00:00Z","timestamp":1441152000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["CCF-0746856, CNS-0958199, CCF-1012759, and CCF-1054876"],"award-info":[{"award-number":["CCF-0746856, CNS-0958199, CCF-1012759, and CCF-1054876"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2015,9,2]]},"abstract":"<jats:p>\n            A fundamental question in software testing research is how to compare test suites, often as a means for comparing test-generation techniques that produce those test suites. Researchers frequently compare test suites by measuring their\n            <jats:italic>coverage<\/jats:italic>\n            . A coverage criterion\n            <jats:italic>C<\/jats:italic>\n            provides a set of test requirements and measures how many requirements a given suite satisfies. A suite that satisfies 100% of the feasible requirements is called\n            <jats:italic>C-adequate<\/jats:italic>\n            . Previous rigorous evaluations of coverage criteria mostly focused on such\n            <jats:italic>adequate<\/jats:italic>\n            test suites: given two criteria\n            <jats:italic>C<\/jats:italic>\n            and\n            <jats:italic>C<\/jats:italic>\n            \u2032, are\n            <jats:italic>C<\/jats:italic>\n            -adequate suites on average more effective than\n            <jats:italic>C<\/jats:italic>\n            \u2032-adequate suites? However, in many realistic cases, producing adequate suites is impractical or even impossible.\n          <\/jats:p>\n          <jats:p>\n            This article presents the first extensive study that evaluates coverage criteria for the common case of\n            <jats:italic>non-adequate<\/jats:italic>\n            test suites: given two criteria\n            <jats:italic>C<\/jats:italic>\n            and\n            <jats:italic>C<\/jats:italic>\n            \u2032, which one is better to use to compare test suites? Namely, if suites\n            <jats:italic>T<\/jats:italic>\n            <jats:sub>1<\/jats:sub>\n            ,\n            <jats:italic>T<\/jats:italic>\n            <jats:sub>2<\/jats:sub>\n            ,\u2026,\n            <jats:italic>\n              T\n              <jats:sub>n<\/jats:sub>\n            <\/jats:italic>\n            have coverage values\n            <jats:italic>c<\/jats:italic>\n            <jats:sub>1<\/jats:sub>\n            ,\n            <jats:italic>c<\/jats:italic>\n            <jats:sub>2<\/jats:sub>\n            ,\u2026,\n            <jats:italic>\n              c\n              <jats:sub>n<\/jats:sub>\n            <\/jats:italic>\n            for\n            <jats:italic>C<\/jats:italic>\n            and\n            <jats:italic>c<\/jats:italic>\n            <jats:sub>1<\/jats:sub>\n            \u2032,\n            <jats:italic>c<\/jats:italic>\n            <jats:sub>2<\/jats:sub>\n            \u2032,\u2026,\n            <jats:italic>c<\/jats:italic>\n            <jats:sub>n<\/jats:sub>\n            \u2032 for\n            <jats:italic>C<\/jats:italic>\n            \u2032, is it better to compare suites based on\n            <jats:italic>c<\/jats:italic>\n            <jats:sub>1<\/jats:sub>\n            ,\n            <jats:italic>c<\/jats:italic>\n            <jats:sub>2<\/jats:sub>\n            ,\u2026,\n            <jats:italic>\n              c\n              <jats:sub>n<\/jats:sub>\n            <\/jats:italic>\n            or based on\n            <jats:italic>c<\/jats:italic>\n            <jats:sub>1<\/jats:sub>\n            \u2032,\n            <jats:italic>c<\/jats:italic>\n            <jats:sub>2<\/jats:sub>\n            \u2032,\u2026,\n            <jats:italic>\n              c\n              <jats:sub>n<\/jats:sub>\n              \u2032\n            <\/jats:italic>\n            ? We evaluate a large set of plausible criteria, including basic criteria such as statement and branch coverage, as well as stronger criteria used in recent studies, including criteria based on program paths, equivalence classes of covered statements, and predicate states. The criteria are evaluated on a set of Java and C programs with both manually written and automatically generated test suites. The evaluation uses three correlation measures. Based on these experiments, two criteria perform best: branch coverage and an intraprocedural acyclic path coverage. We provide guidelines for testing researchers aiming to evaluate test suites using coverage criteria as well as for other researchers evaluating coverage criteria for research use.\n          <\/jats:p>","DOI":"10.1145\/2660767","type":"journal-article","created":{"date-parts":[[2015,9,8]],"date-time":"2015-09-08T12:36:15Z","timestamp":1441715775000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":50,"title":["Guidelines for Coverage-Based Comparisons of Non-Adequate Test Suites"],"prefix":"10.1145","volume":"24","author":[{"given":"Milos","family":"Gligoric","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alex","family":"Groce","sequence":"additional","affiliation":[{"name":"Oregon State University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chaoqiang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Oregon State University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rohan","family":"Sharma","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad Amin","family":"Alipour","sequence":"additional","affiliation":[{"name":"Oregon State University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Darko","family":"Marinov","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2015,9,2]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Industrial validation of test coverage quality. Master's thesis","author":"Adolfsen Martijn","unstructured":"Martijn Adolfsen . 2011. Industrial validation of test coverage quality. Master's thesis . University of Twente . Martijn Adolfsen. 2011. Industrial validation of test coverage quality. Master's thesis. University of Twente."},{"key":"e_1_2_1_2_1","volume-title":"Introduction to Software Testing","author":"Ammann Paul","unstructured":"Paul Ammann and Jeff Offutt . 2008. Introduction to Software Testing . Cambridge University Press . Paul Ammann and Jeff Offutt. 2008. Introduction to Software Testing. Cambridge University Press."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1062455.1062530"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2006.83"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985795"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/11561163_1"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the International Symposium on Microarchitecture. 46--57","author":"Ball Thomas","unstructured":"Thomas Ball and James R. Larus . 1996. Efficient path profiling . In Proceedings of the International Symposium on Microarchitecture. 46--57 . Thomas Ball and James R. Larus. 1996. Efficient path profiling. In Proceedings of the International Symposium on Microarchitecture. 46--57."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the Workshop on Model Checking of Software. 103--122","author":"Ball Thomas","unstructured":"Thomas Ball and Sriram K. Rajamani . 2001. Automatically validating temporal safety properties of interfaces . In Proceedings of the Workshop on Model Checking of Software. 103--122 . Thomas Ball and Sriram K. Rajamani. 2001. Automatically validating temporal safety properties of interfaces. In Proceedings of the Workshop on Model Checking of Software. 103--122."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1134285.1134299"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1083274.1083288"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39724-3_5"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1029894.1029908"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2009.5070506"},{"key":"e_1_2_1_15_1","volume-title":"Ordinal Methods for Behavioral Data Analysis","author":"Cliff Norman","unstructured":"Norman Cliff . 1996. Ordinal Methods for Behavioral Data Analysis . Pyschology Press . Norman Cliff. 1996. Ordinal Methods for Behavioral Data Analysis. Pyschology Press."},{"key":"e_1_2_1_16_1","unstructured":"Cloc. 2013. Count lines of code. http:\/\/cloc.sourceforge.net\/.  Cloc. 2013. Count lines of code. http:\/\/cloc.sourceforge.net\/."},{"key":"e_1_2_1_17_1","unstructured":"Cobertura. 2013. Cobertura. http:\/\/cobertura.sourceforge.net\/.  Cobertura. 2013. Cobertura. http:\/\/cobertura.sourceforge.net\/."},{"key":"e_1_2_1_18_1","unstructured":"CoCo. 2014. CoCo. http:\/\/mir.cs.illinois.edu\/coco\/.  CoCo. 2014. CoCo. http:\/\/mir.cs.illinois.edu\/coco\/."},{"key":"e_1_2_1_19_1","unstructured":"T. H. Cormen C. E. Leiserson R. L. Rivest and C. Stein. 2009. Introduction to Algorithms 3rd Ed. The MIT Press.   T. H. Cormen C. E. Leiserson R. L. Rivest and C. Stein. 2009. Introduction to Algorithms 3rd Ed. The MIT Press."},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Herbert L. Costner. 1965. Criteria for measures of association. Amer. Sociological Revi. 3.  Herbert L. Costner. 1965. Criteria for measures of association. Amer. Sociological Revi. 3.","DOI":"10.2307\/2090715"},{"key":"e_1_2_1_21_1","unstructured":"Coverage. 2013. Instrumented container classes - Predicate coverage. http:\/\/mir.cs.illinois.edu\/coverage\/.  Coverage. 2013. Instrumented container classes - Predicate coverage. http:\/\/mir.cs.illinois.edu\/coverage\/."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/C-M.1978.218136"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-005-3861-2"},{"key":"e_1_2_1_24_1","unstructured":"Eclipse. 2013. Eclipse. http:\/\/http:\/\/www.eclipse.org\/.  Eclipse. 2013. Eclipse. http:\/\/http:\/\/www.eclipse.org\/."},{"key":"e_1_2_1_25_1","unstructured":"Emma. 2013. EMMA. http:\/\/emma.sourceforge.net\/.  Emma. 2013. EMMA. http:\/\/emma.sourceforge.net\/."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/288195.288298"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.238581"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1117696.1117705"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1831708.1831712"},{"key":"e_1_2_1_30_1","unstructured":"gcov. 2013. gcov--a Test Coverage Program. http:\/\/gcc.gnu.org\/onlinedocs\/gcc\/Gcov.html.  gcov. 2013. gcov--a Test Coverage Program. http:\/\/gcc.gnu.org\/onlinedocs\/gcc\/Gcov.html."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2483760.2483769"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1190216.1190226"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568278"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2134243.2134249"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2011.6100077"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2012.1"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.68"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2338965.2336763"},{"key":"e_1_2_1_39_1","volume-title":"Fundamental Statistics in Psychology and Education","author":"Guilford Joy Paul","unstructured":"Joy Paul Guilford . 1956. Fundamental Statistics in Psychology and Education . McGraw-Hill . Joy Paul Guilford. 1956. Fundamental Statistics in Psychology and Education. McGraw-Hill."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10009-007-0059-5"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1977.231145"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the International Conference on Software Engineering. 60--71","author":"Harder Michael","unstructured":"Michael Harder , Jeff Mellen , and Michael D. Ernst . 2003. Improving test suites via operational abstraction . In Proceedings of the International Conference on Software Engineering. 60--71 . Michael Harder, Jeff Mellen, and Michael D. Ernst. 2003. Improving test suites via operational abstraction. In Proceedings of the International Conference on Software Engineering. 60--71."},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the International Conference on Software Engineering. 172--181","author":"Hassan Mohammad Mahdi","unstructured":"Mohammad Mahdi Hassan and James H. Andrews . 2013. Comparing multi-point stride coverage and dataflow coverage . In Proceedings of the International Conference on Software Engineering. 172--181 . Mohammad Mahdi Hassan and James H. Andrews. 2013. Comparing multi-point stride coverage and dataflow coverage. In Proceedings of the International Conference on Software Engineering. 172--181."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/503272.503279"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-93900-9_15"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the International Conference on Software Engineering. 191--200","author":"Hutchins Monica","year":"1994","unstructured":"Monica Hutchins , Herb Foster , Tarak Goradia , and Thomas Ostrand . 1994 . Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria . In Proceedings of the International Conference on Software Engineering. 191--200 . Monica Hutchins, Herb Foster, Tarak Goradia, and Thomas Ostrand. 1994. Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proceedings of the International Conference on Software Engineering. 191--200."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568271"},{"key":"e_1_2_1_48_1","volume-title":"Predicting test suite effectiveness for Java programs. Master's thesis","author":"McLean Inozemtseva Laura Michelle","unstructured":"Laura Michelle McLean Inozemtseva . 2012. Predicting test suite effectiveness for Java programs. Master's thesis , University of Waterloo . Laura Michelle McLean Inozemtseva. 2012. Predicting test suite effectiveness for Java programs. Master's thesis, University of Waterloo."},{"key":"e_1_2_1_49_1","unstructured":"JFreeChart. 2013. JFreeChart. http:\/\/www.jfree.org\/jfreechart\/.  JFreeChart. 2013. JFreeChart. http:\/\/www.jfree.org\/jfreechart\/."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.62"},{"key":"e_1_2_1_51_1","unstructured":"JodaTime. 2013. JodaTime. http:\/\/joda-time.sourceforge.net\/.  JodaTime. 2013. JodaTime. http:\/\/joda-time.sourceforge.net\/."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2012.31"},{"key":"e_1_2_1_53_1","doi-asserted-by":"crossref","unstructured":"Maurice Kendall. 1938. A new measure of rank correlation. Biometrika 1--2 81--89.  Maurice Kendall. 1938. A new measure of rank correlation. Biometrika 1--2 81--89.","DOI":"10.2307\/2332226"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/301618.301678"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2009.30"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1572272.1572280"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1368088.1368136"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.5555\/647478.727796"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.5555\/257572.257597"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2013.6693096"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.37"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2014.11"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/360128.360160"},{"key":"e_1_2_1_64_1","unstructured":"Purify. 2013. IBM Rational purify documentation. ftp:\/\/ftp.software.ibm.com\/software\/rational\/docs\/documentation\/manuals\/unixsuites\/pdf\/purify\/purify.pdf.  Purify. 2013. IBM Rational purify documentation. ftp:\/\/ftp.software.ibm.com\/software\/rational\/docs\/documentation\/manuals\/unixsuites\/pdf\/purify\/purify.pdf."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.962562"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the International Conference on Software Maintenance. 82--91","author":"Rountev Atanas","year":"2004","unstructured":"Atanas Rountev . 2004 . Precise identification of side-effect-free methods in Java . In Proceedings of the International Conference on Software Maintenance. 82--91 . Atanas Rountev. 2004. Precise identification of side-effect-free methods in Java. In Proceedings of the International Conference on Software Maintenance. 82--91."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30579-8_14"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/1595696.1595750"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1497"},{"key":"e_1_2_1_70_1","doi-asserted-by":"crossref","unstructured":"Rohan Sharma Milos Gligoric Andrea Arcuri Gordon Fraser and Darko Marinov. 2011. Testing container classes: Random or systematic? In Fundamental Approaches to Software Engineering 262--277.   Rohan Sharma Milos Gligoric Andrea Arcuri Gordon Fraser and Darko Marinov. 2011. Testing container classes: Random or systematic? In Fundamental Approaches to Software Engineering 262--277.","DOI":"10.1007\/978-3-642-19811-3_19"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2010.7"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.2307\/1412159"},{"key":"e_1_2_1_73_1","unstructured":"SQLite. 2013. SQLite. http:\/\/www.sqlite.org\/.  SQLite. 2013. SQLite. http:\/\/www.sqlite.org\/."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/1146238.1146243"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1007\/11763864_38"},{"key":"e_1_2_1_76_1","unstructured":"VMSpec. 2013. Java class file format. http:\/\/docs.oracle.com\/javase\/specs\/jvms\/se5.0\/html\/ClassFile.doc.html.  VMSpec. 2013. Java class file format. http:\/\/docs.oracle.com\/javase\/specs\/jvms\/se5.0\/html\/ClassFile.doc.html."},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the International Conference on Software Maintenance. 44--53","author":"Filipos","unstructured":"Filipos I. Vokolos and Phyllis G. Frankl. 1998. Empirical evaluation of the textual differencing regression testing technique . In Proceedings of the International Conference on Software Maintenance. 44--53 . Filipos I. Vokolos and Phyllis G. Frankl. 1998. Empirical evaluation of the textual differencing regression testing technique. In Proceedings of the International Conference on Software Maintenance. 44--53."},{"key":"e_1_2_1_78_1","volume-title":"WALA: T. J. Watson Libraries for Analysis","author":"WALA.","year":"2013","unstructured":"WALA. 2013 . WALA: T. J. Watson Libraries for Analysis . http:\/\/wala.sf.net. WALA. 2013. WALA: T. J. Watson Libraries for Analysis. http:\/\/wala.sf.net."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101908.1101966"},{"key":"e_1_2_1_80_1","volume-title":"Is branch coverage a good measure of testing effectiveness? In Empirical Software Engineering and Verification","author":"Wei Yi","unstructured":"Yi Wei , Bertrand Meyer , and Manuel Oriol . 2012. Is branch coverage a good measure of testing effectiveness? In Empirical Software Engineering and Verification , Bertrand Meyer and Martin Nordio (Eds.), vol. 7007 , Springer Berlin , Heidelberg , 194--212. Yi Wei, Bertrand Meyer, and Manuel Oriol. 2012. Is branch coverage a good measure of testing effectiveness? In Empirical Software Engineering and Verification, Bertrand Meyer and Martin Nordio (Eds.), vol. 7007, Springer Berlin, Heidelberg, 194--212."},{"key":"e_1_2_1_81_1","volume-title":"Proceedings of the International Symposium on Software Reliability. 230--238","author":"Wong W. Eric","unstructured":"W. Eric Wong , Joseph R. Horgan , Saul London , and Aditya P. Mathur . 1994. Effect of test set size and block coverage on fault detection effectiveness . In Proceedings of the International Symposium on Software Reliability. 230--238 . W. Eric Wong, Joseph R. Horgan, Saul London, and Aditya P. Mathur. 1994. Effect of test set size and block coverage on fault detection effectiveness. In Proceedings of the International Symposium on Software Reliability. 230--238."},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/225014.225018"},{"key":"e_1_2_1_83_1","volume-title":"YAFFS: A flash file system for embedded use","year":"2013","unstructured":"YAFFS2. 2013 . YAFFS: A flash file system for embedded use . http:\/\/www.yaffs.net. YAFFS2. 2013. YAFFS: A flash file system for embedded use. http:\/\/www.yaffs.net."},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2013.6693070"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/1806799.1806863"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2660767","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2660767","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:56:13Z","timestamp":1750229773000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2660767"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,9,2]]},"references-count":84,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,9,2]]}},"alternative-id":["10.1145\/2660767"],"URL":"https:\/\/doi.org\/10.1145\/2660767","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,9,2]]},"assertion":[{"value":"2014-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-09-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}