{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T04:43:17Z","timestamp":1771562597070,"version":"3.50.1"},"reference-count":19,"publisher":"World Scientific Pub Co Pte Lt","issue":"08","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Soft. Eng. Knowl. Eng."],"published-print":{"date-parts":[[2020,8]]},"abstract":"<jats:p>For the test case prioritization problems, the average percent of faults detected (APFD) and its variant versions are widely used as metrics to evaluate prioritized test suite\u2019s efficiency of fault detection. By a revisit of metrics for test case prioritization, we observe that APFD is only available for the scenarios where all test suites under evaluation contain the same number of test cases. Such a limitation is often overlooked, and lead to incorrect results when comparing fault detection efficiency of test suites with different sizes. Moreover, APFD cannot precisely illustrate the process of fault detection in the real world. Besides the APFD, most of its variants, including the NAPFD and the APFD[Formula: see text], have similar problems. This paper points out these limitations in detail by analyzing the physical explanation of APFD series metrics formally. In order to eliminate these limitations, we propose a series of improved metrics, including the relative average percent of faults detected (RAPFD) and the relative cost-cognizant weighted average percent of faults detected (RAPFD[Formula: see text]), to evaluate the efficiency of the test suite. Furthermore, for the scenario of parallel testing, a series of metrics including the relative average percent of faults detected in parallel testing ([Formula: see text]-RAPFD) and the relative cost-cognizant weighted average percent of faults detected in parallel testing ([Formula: see text]-RAPFD[Formula: see text]) are proposed too. All the proposed metrics refer to both the speed of fault detection and the constraint of the testing resource. A formal analysis and some examples show that all the proposed metrics provide much more precise illustrations of the fault detection process.<\/jats:p>","DOI":"10.1142\/s0218194020500291","type":"journal-article","created":{"date-parts":[[2020,10,15]],"date-time":"2020-10-15T09:52:14Z","timestamp":1602755534000},"page":"1139-1167","source":"Crossref","is-referenced-by-count":6,"title":["A Revisit of Metrics for Test Case Prioritization Problems"],"prefix":"10.1142","volume":"30","author":[{"given":"Ziyuan","family":"Wang","sequence":"first","affiliation":[{"name":"School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing, Jiangsu 210023, P.\u00a0R.\u00a0China"}]},{"given":"Chunrong","family":"Fang","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, Jiangsu 210023, P.\u00a0R.\u00a0China"}]},{"given":"Lin","family":"Chen","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, Jiangsu 210023, P.\u00a0R.\u00a0China"}]},{"given":"Zhiyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu 210016, P.\u00a0R.\u00a0China"}]}],"member":"219","published-online":{"date-parts":[[2020,10,13]]},"reference":[{"key":"S0218194020500291BIB001","first-page":"562","volume-title":"Proc. 27th Int. Conf. Software Engineering and Knowledge Engineering","author":"Wang Z.","year":"2015"},{"key":"S0218194020500291BIB002","first-page":"102","volume-title":"Proc. Int. Symp. Software Testing and Analysis","author":"Elbaum S.","year":"2000"},{"issue":"10","key":"S0218194020500291BIB003","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1109\/32.962562","volume":"27","author":"Rothermel G.","year":"2001","journal-title":"IEEE Trans. Softw. Eng."},{"key":"S0218194020500291BIB004","first-page":"255","volume-title":"Proc. IEEE Int. Conf. Software Maintenance","author":"Qu X.","year":"2007"},{"key":"S0218194020500291BIB005","first-page":"329","volume-title":"Proc. Int. Conf. Software Engineering","author":"Elbaum S.","year":"2001"},{"key":"S0218194020500291BIB006","first-page":"1451","volume-title":"Proc. 26th ACM Symp. Applied Computing","author":"You D.","year":"2011"},{"issue":"2","key":"S0218194020500291BIB007","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1002\/stvr.1562","volume":"25","author":"Xu Z.","year":"2015","journal-title":"Softw. Test. Verific. Reliabil."},{"key":"S0218194020500291BIB008","first-page":"1","volume-title":"Proc. Int. Symp. Software Testing and Analysis","author":"Walcott K. R.","year":"2006"},{"key":"S0218194020500291BIB009","first-page":"213","volume-title":"Proc. Int. Symp. Software Testing and Analysis","author":"Zhang L.","year":"2009"},{"key":"S0218194020500291BIB010","first-page":"150","volume-title":"Proc. 11th Int. Conf. Quality Software","author":"WeiBleder S.","year":"2011"},{"key":"S0218194020500291BIB011","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1145\/2245276.2231963","volume-title":"Proc. 27th ACM Symp. Applied Computing","author":"Wang Z.","year":"2012"},{"issue":"3","key":"S0218194020500291BIB012","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1145\/152388.152391","volume":"2","author":"Harrold M. J.","year":"1993","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"S0218194020500291BIB013","first-page":"15","volume-title":"Proc. 7th Int. Conf. Quality Software","author":"Zhang X.","year":"2008"},{"key":"S0218194020500291BIB014","first-page":"1","volume-title":"Proc. Workshop on Domain-Specific Approaches to Software Test Automation","author":"Bryce R. C.","year":"2007"},{"key":"S0218194020500291BIB015","doi-asserted-by":"publisher","DOI":"10.1142\/S0218194011005499"},{"issue":"4","key":"S0218194020500291BIB016","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1109\/TSE.2007.38","volume":"33","author":"Li Z.","year":"2007","journal-title":"IEEE Trans. Softw. Eng."},{"issue":"6","key":"S0218194020500291BIB017","first-page":"1104","volume":"39","author":"Qu B.","year":"2009","journal-title":"J. Southeast Univ. Nat. Sci. Edn."},{"key":"S0218194020500291BIB018","first-page":"125","volume-title":"Proc. Web Information Systems and Applications Conf.","author":"Zhang X.","year":"2011"},{"key":"S0218194020500291BIB020","first-page":"211","volume-title":"Proc. 8th IEEE Int. Conf. Web Services","author":"Zhai K.","year":"2010"}],"container-title":["International Journal of Software Engineering and Knowledge Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218194020500291","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,8]],"date-time":"2021-04-08T22:58:54Z","timestamp":1617922734000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218194020500291"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8]]},"references-count":19,"journal-issue":{"issue":"08","published-print":{"date-parts":[[2020,8]]}},"alternative-id":["10.1142\/S0218194020500291"],"URL":"https:\/\/doi.org\/10.1142\/s0218194020500291","relation":{},"ISSN":["0218-1940","1793-6403"],"issn-type":[{"value":"0218-1940","type":"print"},{"value":"1793-6403","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8]]}}}