{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T03:45:36Z","timestamp":1760586336831,"version":"3.41.0"},"reference-count":14,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2004,9,1]],"date-time":"2004-09-01T00:00:00Z","timestamp":1093996800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2004,9]]},"abstract":"<jats:p>Testing technique-related empirical studies have been performed for 25 years. We have managed to accumulate a fair number of experiments in this time, which might lead us to think that we now could have a sizeable empirically backed body of knowledge (BoK) on testing techniques. However, the experiments in this field have some flaws, and, consequently, the empirical BoK we have on testing techniques is far from solid. In this paper, we use the results of a survey that we did on empirical testing techniques studies to identify and discuss solutions that could lead to the formation of a solid empirical BoK. The solutions are related to two fundamental experimental issues: (1) the rigorousness of the experimental design and analysis, and (2) the need for a series of community-wide agreements to coordinate empirical research and assure that studies ratify and complement each other.<\/jats:p>","DOI":"10.1145\/1022494.1022544","type":"journal-article","created":{"date-parts":[[2004,10,7]],"date-time":"2004-10-07T17:39:09Z","timestamp":1097170749000},"page":"1-4","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Towards building a solid empirical body of knowledge in testing techniques"],"prefix":"10.1145","volume":"29","author":[{"given":"N.","family":"Juristo","sequence":"first","affiliation":[{"name":"Universidad Polit\u00e9cnica de Madrid, Campus de Montegancedo, Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A. M.","family":"Moreno","sequence":"additional","affiliation":[{"name":"Universidad Polit\u00e9cnica de Madrid, Campus de Montegancedo, Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S.","family":"Vegas","sequence":"additional","affiliation":[{"name":"Universidad Polit\u00e9cnica de Madrid, Campus de Montegancedo, Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2004,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1987.232881"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1049\/sej.1992.0005"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/288195.288298"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0164-1212(96)00154-9"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.238581"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/257734.257766"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:EMSE.0000013513.48963.1b"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/645385.651507"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/227607.227610"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.286422"},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4615-0419-1","volume-title":"Identifying Relevant Information for Testing Technique Selection. An Instantiated Characterisation Schema","author":"Vegas S.","year":"2003","unstructured":"S. Vegas , N. Juristo , V. Basili . Identifying Relevant Information for Testing Technique Selection. An Instantiated Characterisation Schema . Kluwer 2003 . S. Vegas, N. Juristo, V. Basili. Identifying Relevant Information for Testing Technique Selection. An Instantiated Characterisation Schema. Kluwer 2003."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.44376"},{"key":"e_1_2_1_13_1","volume-title":"Fault Detection Effectiveness of Mutation and Data-flow Testing. Software Quality Journal","author":"Wong E.","year":"1995","unstructured":"E. Wong and A. P. Mathur . Fault Detection Effectiveness of Mutation and Data-flow Testing. Software Quality Journal . Volume 4 . Pages 69--83. 1995 . E. Wong and A. P. Mathur. Fault Detection Effectiveness of Mutation and Data-flow Testing. Software Quality Journal. Volume 4. Pages 69--83. 1995."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/267895.267915"}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1022494.1022544","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1022494.1022544","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:41:25Z","timestamp":1750282885000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1022494.1022544"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,9]]},"references-count":14,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2004,9]]}},"alternative-id":["10.1145\/1022494.1022544"],"URL":"https:\/\/doi.org\/10.1145\/1022494.1022544","relation":{},"ISSN":["0163-5948"],"issn-type":[{"type":"print","value":"0163-5948"}],"subject":[],"published":{"date-parts":[[2004,9]]},"assertion":[{"value":"2004-09-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}