{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T20:02:13Z","timestamp":1773086533231,"version":"3.50.1"},"reference-count":16,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2004,9,1]],"date-time":"2004-09-01T00:00:00Z","timestamp":1093996800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2004,9]]},"abstract":"<jats:p>A large gap exists between the state-of-the-art in software testing literature, and the state of software testing practice. Empirical research should (and could) play a first class role for bridging this gap. Empirical studies in software testing have focused mainly on the evaluation of techniques for test case selection. But effective selection of test cases by itself is not sufficient to warrant successful testing: we need also empirical studies to start collecting proven patterns that test practitioners can use to predictably solve software testing problems.<\/jats:p>","DOI":"10.1145\/1022494.1022540","type":"journal-article","created":{"date-parts":[[2004,10,7]],"date-time":"2004-10-07T17:39:09Z","timestamp":1097170749000},"page":"1-4","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["The (Im)maturity level of software testing"],"prefix":"10.1145","volume":"29","author":[{"given":"Antonia","family":"Bertolino","sequence":"first","affiliation":[{"name":"Istituto di Scienza e Tecnologie dell'Informazione \"A. Faedo\"-ISTI-CNR, Pisa, Italy"}]}],"member":"320","published-online":{"date-parts":[[2004,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/1754749.1754751"},{"key":"e_1_2_1_2_1","volume-title":"Proc. 1st European Conf. on Model Driven Softw. Eng.","author":"Craggs I.","year":"2003","unstructured":"Craggs I. , Sardis M. , and Heuillard T . AGEDIS Case Studies: Model-based Testing in Industry . Proc. 1st European Conf. on Model Driven Softw. Eng. ( Nuremberg, Germany , Dec. 2003 ), imbus AG, 106--117. Craggs I., Sardis M., and Heuillard T. AGEDIS Case Studies: Model-based Testing in Industry. Proc. 1st European Conf. on Model Driven Softw. Eng. (Nuremberg, Germany, Dec. 2003), imbus AG, 106--117."},{"key":"e_1_2_1_3_1","first-page":"4","volume":"10","author":"Duran J. W.","year":"1984","unstructured":"Duran , J. W. and Ntafos , S. C. An Evaluation of Random Testing. IEEE Trans. Software Engineering. 10 , 4 ( 1984 ) 438--444. Duran, J. W. and Ntafos, S. C. An Evaluation of Random Testing. IEEE Trans. Software Engineering. 10, 4 (1984) 438--444.","journal-title":"An Evaluation of Random Testing. IEEE Trans. Software Engineering."},{"key":"e_1_2_1_4_1","volume-title":"Design Patterns Elements of reusable Object-Oriented Software","author":"Gamma E.","year":"1996","unstructured":"Gamma , E. , , Design Patterns Elements of reusable Object-Oriented Software , Addison-Wesley , Reading, Mass ., 1996 . Gamma, E., et al., Design Patterns Elements of reusable Object-Oriented Software, Addison-Wesley, Reading, Mass., 1996."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/257734.257766"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/566172.566205"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:EMSE.0000013513.48963.1b"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.888629"},{"key":"e_1_2_1_9_1","volume-title":"Software Testing Patterns. On line at http:\/\/www.testing.com\/test-patterns\/index.html (accessed","author":"Marick B.","year":"2004","unstructured":"Marick , B. Software Testing Patterns. On line at http:\/\/www.testing.com\/test-patterns\/index.html (accessed April 21, 2004 ). Marick, B. Software Testing Patterns. On line at http:\/\/www.testing.com\/test-patterns\/index.html (accessed April 21, 2004)."},{"key":"e_1_2_1_10_1","volume-title":"Proc. of the 26th Int. Conf. on Softw. Eng. (ICSE'04)","author":"Mohagheghi P.","year":"2004","unstructured":"Mohagheghi , P. , An Empirical Study of Software Reuse vs. Reliability and Stability . In Proc. of the 26th Int. Conf. on Softw. Eng. (ICSE'04) (Edinburgh, Scotland, UK , 23-28 May 2004 ). Mohagheghi, P., et al. An Empirical Study of Software Reuse vs. Reliability and Stability. In Proc. of the 26th Int. Conf. on Softw. Eng. (ICSE'04) (Edinburgh, Scotland, UK, 23-28 May 2004)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007512.1007533"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007512.1007524"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/236156.236164"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009844119158"},{"key":"e_1_2_1_15_1","volume-title":"on line at http:\/\/www.sce.carleton.ca\/squall\/WERST2004\/ ((accessed","author":"Call","year":"2004","unstructured":"WERST 2004 Call for Papers , on line at http:\/\/www.sce.carleton.ca\/squall\/WERST2004\/ ((accessed April 21, 2004 ). WERST 2004 Call for Papers, on line at http:\/\/www.sce.carleton.ca\/squall\/WERST2004\/ ((accessed April 21, 2004)."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/267895.267915"}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1022494.1022540","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1022494.1022540","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:41:25Z","timestamp":1750282885000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1022494.1022540"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,9]]},"references-count":16,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2004,9]]}},"alternative-id":["10.1145\/1022494.1022540"],"URL":"https:\/\/doi.org\/10.1145\/1022494.1022540","relation":{},"ISSN":["0163-5948"],"issn-type":[{"value":"0163-5948","type":"print"}],"subject":[],"published":{"date-parts":[[2004,9]]},"assertion":[{"value":"2004-09-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}