{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T12:34:06Z","timestamp":1791549246317,"version":"4.3.4"},"reference-count":59,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2022,9,27]],"date-time":"2022-09-27T00:00:00Z","timestamp":1664236800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,9,27]],"date-time":"2022-09-27T00:00:00Z","timestamp":1664236800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100018933","name":"Technische Universit\u00e4t Clausthal","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100018933","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Context:<\/jats:title>\n                    <jats:p>Performance metrics are a core component of the evaluation of any machine learning model and used to compare models and estimate their usefulness. Recent work started to question the validity of many performance metrics for this purpose in the context of software defect prediction.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective:<\/jats:title>\n                    <jats:p>Within this study, we explore the relationship between performance metrics and the cost saving potential of defect prediction models. We study whether performance metrics are suitable proxies to evaluate the cost saving capabilities and derive a theory for the relationship between performance metrics and cost saving potential.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>We measure performance metrics and cost saving potential in defect prediction experiments. We use a multinomial logit model, decision, and random forest to model the relationship between the metrics and the cost savings.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>We could not find a stable relationship between cost savings and performance metrics. We attribute the lack of the relationship to the inability of performance metrics to account for the property that a small proportion of very large software artifacts are the main driver of the costs.<\/jats:p>\n                    <jats:p>fact that performance metrics are incapable of accurately considering the costs associate with individual artifacts, which is required due to the exponential distribution of artifact sizes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>Any defect prediction study interested in finding the best prediction model, must consider cost savings directly, because no reasonable claims regarding the economic benefits of defect prediction can be made otherwise.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s10664-022-10224-4","type":"journal-article","created":{"date-parts":[[2022,9,27]],"date-time":"2022-09-27T04:02:46Z","timestamp":1664251366000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Exploring the relationship between performance metrics and cost saving potential of defect prediction models"],"prefix":"10.1007","volume":"27","author":[{"given":"Steffen","family":"Tunkel","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9765-2803","authenticated-orcid":false,"given":"Steffen","family":"Herbold","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,9,27]]},"reference":[{"key":"10224_CR1","doi-asserted-by":"publisher","unstructured":"Agrawal A, Menzies T (2018) Is \u201cbetter data\u201d better than \u201cbetter data miners\u201d? on the benefits of tuning smote for defect prediction. In: Proceedings of the 40th international conference on software engineering, association for computing machinery, New York, ICSE \u201918, pp 1050\u20131061. https:\/\/doi.org\/10.1145\/3180155.3180197","DOI":"10.1145\/3180155.3180197"},{"issue":"2","key":"10224_CR2","doi-asserted-by":"publisher","first-page":"1573","DOI":"10.1007\/s10664-019-09777-8","volume":"25","author":"S Amasaki","year":"2020","unstructured":"Amasaki S (2020) Cross-version defect prediction: use historical data, cross-project data, or both? Empirical Softw Eng 25(2):1573\u20131595. https:\/\/doi.org\/10.1007\/s10664-019-09777-8","journal-title":"Empirical Softw Eng"},{"key":"10224_CR3","doi-asserted-by":"crossref","unstructured":"Arisholm E, Briand LC (2006) Predicting fault-prone components in a Java legacy system. In: Proceeding 5th ACM\/IEEE Int Symp Emp Softw Eng (ISESE) ACM","DOI":"10.1145\/1159733.1159738"},{"issue":"6","key":"10224_CR4","doi-asserted-by":"publisher","first-page":"5047","DOI":"10.1007\/s10664-020-09878-9","volume":"25","author":"AA Bangash","year":"2020","unstructured":"Bangash AA, Sahar H, Hindle A, Ali K (2020) On the time-based conclusion stability of cross-project defect prediction models. Empirical Softw Eng 25 (6):5047\u20135083. https:\/\/doi.org\/10.1007\/s10664-020-09878-9","journal-title":"Empirical Softw Eng"},{"issue":"1","key":"10224_CR5","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Random forests. Mach Learn 45(1):5\u201332. https:\/\/doi.org\/10.1023\/A:1010933404324","journal-title":"Mach Learn"},{"key":"10224_CR6","volume-title":"Classification and Regression Trees","author":"L Breiman","year":"1984","unstructured":"Breiman L, Friedman J, Olshen R, Stone C (1984) Classification and Regression Trees. Wadsworth and Brooks, Monterey, CA"},{"key":"10224_CR7","doi-asserted-by":"publisher","unstructured":"Camargo Cruz AE, Ochimizu K (2009) Towards logistic regression models for predicting fault-prone code across software projects. In: Proceeding 3rd international symp on empirical software eng and measurement (ESEM), IEEE computer society. https:\/\/doi.org\/10.1109\/ESEM.2009.5316002","DOI":"10.1109\/ESEM.2009.5316002"},{"key":"10224_CR8","doi-asserted-by":"crossref","unstructured":"Canfora G, Lucia AD, Penta MD, Oliveto R, Panichella A, Panichella S (2013) Multi-objective cross-project defect prediction. In: Proceeding 6th IEEE int conf softw testing, verification and validation (ICST)","DOI":"10.1109\/ICST.2013.38"},{"key":"10224_CR9","unstructured":"Cook TD, Campbell DT, Day A (1979) Quasi-experimentation: design & analysis issues for field settings, vol 351. Houghton Mifflin Boston"},{"issue":"1","key":"10224_CR10","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1007\/s10994-006-8199-5","volume":"65","author":"C Drummond","year":"2006","unstructured":"Drummond C, Holte R (2006) Cost curves: an improved method for visualizing classifier performance. Mach Learn 65(1):95\u2013130. https:\/\/doi.org\/10.1007\/s10994-006-8199-5","journal-title":"Mach Learn"},{"issue":"1","key":"10224_CR11","first-page":"3133","volume":"15","author":"M Fern\u00e1ndez-Delgado","year":"2014","unstructured":"Fern\u00e1ndez-Delgado M, Cernadas E, Barro S, Amorim D (2014) Do we need hundreds of classifiers to solve real world classification problems? J Mach Learn Res 15(1):3133\u20133181","journal-title":"J Mach Learn Res"},{"key":"10224_CR12","unstructured":"Feurer M, Klein A, Eggensperger K, Springenberg J, Blum M, Hutter F (2015) Efficient and robust automated machine learning. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R (eds) Advances in neural information processing systems 28, Curran Associates, Inc., pp 2962\u20132970. http:\/\/papers.nips.cc\/paper\/5872-efficient-and-robust-automated-machine-learning.pdf"},{"issue":"6","key":"10224_CR13","doi-asserted-by":"publisher","first-page":"1276","DOI":"10.1109\/TSE.2011.103","volume":"38","author":"T Hall","year":"2012","unstructured":"Hall T, Beecham S, Bowes D, Gray D, Counsell S (2012) A systematic literature review on fault prediction performance in software engineering. IEEE Trans Softw Eng 38(6):1276\u20131304. https:\/\/doi.org\/10.1109\/TSE.2011.103","journal-title":"IEEE Trans Softw Eng"},{"key":"10224_CR14","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1016\/j.infsof.2014.11.006","volume":"59","author":"P He","year":"2015","unstructured":"He P, Li B, Liu X, Chen J, Ma Y (2015) An empirical study on software defect prediction with a simplified metric set. Inf Softw Technol 59:170 \u2013 190. https:\/\/doi.org\/10.1016\/j.infsof.2014.11.006, http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0950584914002523","journal-title":"Inf Softw Technol"},{"key":"10224_CR15","doi-asserted-by":"publisher","first-page":"412","DOI":"10.1016\/j.jss.2014.11.040","volume":"103","author":"H Hemmati","year":"2015","unstructured":"Hemmati H, Nagappan M, Hassan AE (2015) Investigating the effect of \u201cdefect co-fix\u201d on quality assurance resource allocation: a search-based approach. J Syst Softw 103:412\u2013422. https:\/\/doi.org\/10.1016\/j.jss.2014.11.040","journal-title":"J Syst Softw"},{"key":"10224_CR16","doi-asserted-by":"crossref","unstructured":"Herbold S (2015) Crosspare: a tool for benchmarking cross-project defect predictions. In: 2015 30th IEEE\/ACM international conference on automated software engineering workshop (ASEW), pp 90\u201396. 10.1109\/ASEW.2015.8","DOI":"10.1109\/ASEW.2015.8"},{"key":"10224_CR17","unstructured":"Herbold S (2017) A systematic mapping study on cross-project defect prediction. arXiv:1705.06429"},{"key":"10224_CR18","doi-asserted-by":"publisher","unstructured":"Herbold S (2019) On the costs and profit of software defect prediction. IEEE Trans Softw Eng (online first), (01):1\u20131. https:\/\/doi.org\/10.1109\/TSE.2019.2957794","DOI":"10.1109\/TSE.2019.2957794"},{"key":"10224_CR19","unstructured":"Herbold S (2021) Exploring the relationship between performance metrics and cost saving potential of defect prediction models. arXiv:2104.00566"},{"key":"10224_CR20","doi-asserted-by":"crossref","unstructured":"Herbold S, Trautsch A, Grabowski J (2017) Correction of \u201ca comparative study to benchmark cross-project defect prediction\u201d. arXiv:1707.09281","DOI":"10.1145\/3180155.3182542"},{"issue":"9","key":"10224_CR21","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1109\/TSE.2017.2724538","volume":"44","author":"S Herbold","year":"2018","unstructured":"Herbold S, Trautsch A, Grabowski J (2018) A comparative study to benchmark cross-project defect prediction approaches. IEEE Trans Softw Eng 44 (9):811\u2013833","journal-title":"IEEE Trans Softw Eng"},{"key":"10224_CR22","doi-asserted-by":"publisher","unstructured":"Herbold S, Trautsch A, Trautsch F, Ledel B (2022) Problems with SZZ and features: an empirical study of the state of practice of defect prediction data collection. Empirical Softw Eng, vol 27(2). https:\/\/doi.org\/10.1007\/s10664-021-10092-4","DOI":"10.1007\/s10664-021-10092-4"},{"issue":"2","key":"10224_CR23","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1109\/TSE.2017.2770124","volume":"45","author":"S Hosseini","year":"2019","unstructured":"Hosseini S, Turhan B, Gunarathna D (2019) A systematic literature review and meta-analysis on cross project defect prediction. IEEE Trans Softw Eng 45(2):111\u2013147","journal-title":"IEEE Trans Softw Eng"},{"issue":"4","key":"10224_CR24","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1016\/j.eswa.2006.07.007","volume":"33","author":"CL Huang","year":"2007","unstructured":"Huang CL, Chen MC, Wang CJ (2007) Credit scoring with a data mining approach based on support vector machines. Expert Syst Appl 33 (4):847\u2013856. https:\/\/doi.org\/10.1016\/j.eswa.2006.07.007, http:\/\/www.sciencedirect.com\/science\/article\/pii\/S095741740600217X","journal-title":"Expert Syst Appl"},{"issue":"1","key":"10224_CR25","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1109\/TSE.2020.2982385","volume":"48","author":"J Jiarpakdee","year":"2022","unstructured":"Jiarpakdee J, Tantithamthavorn CK, Dam HK, Grundy J (2022) An empirical study of model-agnostic techniques for defect prediction models. IEEE Trans Softw Eng 48(1):166\u2013185. https:\/\/doi.org\/10.1109\/TSE.2020.2982385","journal-title":"IEEE Trans Softw Eng"},{"key":"10224_CR26","doi-asserted-by":"publisher","unstructured":"Jureczko M, Madeyski L (2010) Towards identifying software project clusters with regard to defect prediction. In: Proc 6th Int conf on predictive models in softw eng (PROMISE) ACM. https:\/\/doi.org\/10.1145\/1868328.1868342","DOI":"10.1145\/1868328.1868342"},{"issue":"6","key":"10224_CR27","doi-asserted-by":"publisher","first-page":"757","DOI":"10.1109\/TSE.2012.70","volume":"39","author":"Y Kamei","year":"2013","unstructured":"Kamei Y, Shihab E, Adams B, Hassan AE, Mockus A, Sinha A, Ubayashi N (2013) A large-scale empirical study of just-in-time quality assurance. IEEE Trans Softw Eng 39(6):757\u2013773. https:\/\/doi.org\/10.1109\/TSE.2012.70","journal-title":"IEEE Trans Softw Eng"},{"key":"10224_CR28","doi-asserted-by":"publisher","unstructured":"Kawata K, Amasaki S, Yokogawa T (2015) Improving relevancy filter methods for cross-project defect prediction. In: Applied computing and information technology\/2nd international conference on computational science and intelligence (ACIT-CSI), 2015 3rd international conference on, pp 2\u20137. https:\/\/doi.org\/10.1109\/ACIT-CSI.2015.104","DOI":"10.1109\/ACIT-CSI.2015.104"},{"issue":"3","key":"10224_CR29","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1023\/A:1009736205722","volume":"3","author":"TM Khoshgoftaar","year":"1998","unstructured":"Khoshgoftaar TM, Allen EB (1998) Classification of fault-prone software modules: prior probabilities, costs, and model evaluation. Emp Softw Eng 3(3):275\u2013298. https:\/\/doi.org\/10.1023\/A:1009736205722","journal-title":"Emp Softw Eng"},{"key":"10224_CR30","doi-asserted-by":"crossref","unstructured":"Lewis C, Lin Z, Sadowski C, Zhu X, Ou R, Whitehead Jr EJ (2013) Does bug prediction support human developers? findings from a google case study. In: Proceedings of the 2013 international conference on software engineering, IEEE Press, ICSE \u201913, pp 372\u2013381","DOI":"10.1109\/ICSE.2013.6606583"},{"issue":"6","key":"10224_CR31","doi-asserted-by":"publisher","first-page":"852","DOI":"10.1109\/TSE.2010.51","volume":"36","author":"Y Liu","year":"2010","unstructured":"Liu Y, Khoshgoftaar T, Seliya N (2010) Evolutionary optimization of software quality modeling with multiple repositories. Softw Eng IEEE Trans 36 (6):852\u2013864. https:\/\/doi.org\/10.1109\/TSE.2010.51","journal-title":"Softw Eng IEEE Trans"},{"issue":"2","key":"10224_CR32","first-page":"413","volume":"42","author":"R Lockhart","year":"2014","unstructured":"Lockhart R, Taylor J, Tibshirani RJ, Tibshirani R (2014) A significance test for the lasso. Annals Stat 42(2):413","journal-title":"Annals Stat"},{"key":"10224_CR33","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1016\/j.patcog.2019.02.023","volume":"91","author":"A Luque","year":"2019","unstructured":"Luque A, Carrasco A, Mart\u00edn A, De Las Heras A (2019) The impact of class imbalance in classification performance metrics based on the binary confusion matrix. Pattern Recognit 91:216\u2013231. https:\/\/doi.org\/10.1016\/j.patcog.2019.02.023, https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0031320319300950","journal-title":"Pattern Recognit"},{"issue":"4","key":"10224_CR34","doi-asserted-by":"publisher","first-page":"2764","DOI":"10.1007\/s10664-019-09714-9","volume":"24","author":"MAA Mamunm","year":"2019","unstructured":"Mamunm MAA, Berger C, Hansson J (2019) Effects of measurements on correlations of software code metrics. Empirical Softw Eng 24(4):2764\u20132818. https:\/\/doi.org\/10.1007\/s10664-019-09714-9","journal-title":"Empirical Softw Eng"},{"key":"10224_CR35","unstructured":"McFadden D (1974) Conditional logit analysis of qualitative choice behavior. Frontiers in Econometrics:105\u2013142"},{"issue":"5","key":"10224_CR36","doi-asserted-by":"publisher","first-page":"3977","DOI":"10.1007\/s10664-020-09861-4","volume":"25","author":"S Morasca","year":"2020","unstructured":"Morasca S, Lavazza L (2020) On the assessment of software defect prediction models via ROC curves. Empirical Softw Eng 25(5):3977\u20134019. https:\/\/doi.org\/10.1007\/s10664-020-09861-4","journal-title":"Empirical Softw Eng"},{"key":"10224_CR37","doi-asserted-by":"publisher","unstructured":"Nam J, Kim S (2015) Clami: defect prediction on unlabeled datasets (t). In: 2015 30th IEEE\/ACM international conference on automated software engineering (ASE), pp 452\u2013463. https:\/\/doi.org\/10.1109\/ASE.2015.56","DOI":"10.1109\/ASE.2015.56"},{"issue":"9","key":"10224_CR38","doi-asserted-by":"publisher","first-page":"874","DOI":"10.1109\/TSE.2017.2720603","volume":"44","author":"J Nam","year":"2018","unstructured":"Nam J, Fu W, Kim S, Menzies T, Tan L (2018) Heterogeneous defect prediction. IEEE Trans Softw Eng 44(9):874\u2013896. https:\/\/doi.org\/10.1109\/TSE.2017.2720603","journal-title":"IEEE Trans Softw Eng"},{"issue":"12","key":"10224_CR39","doi-asserted-by":"publisher","first-page":"886","DOI":"10.1109\/32.553637","volume":"22","author":"N Ohlsson","year":"1996","unstructured":"Ohlsson N, Alberg H (1996) Predicting fault-prone software modules in telephone switches. IEEE Trans Softw Eng 22(12):886\u2013894. https:\/\/doi.org\/10.1109\/32.553637","journal-title":"IEEE Trans Softw Eng"},{"key":"10224_CR40","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825\u20132830","journal-title":"J Mach Learn Res"},{"issue":"8","key":"10224_CR41","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1109\/TSE.2013.6","volume":"39","author":"F Peters","year":"2013","unstructured":"Peters F, Menzies T, Gong L, Zhang H (2013) Balancing privacy and utility in cross-company defect prediction. Softw Eng IEEE Trans 39(8):1054\u20131068. https:\/\/doi.org\/10.1109\/TSE.2013.6","journal-title":"Softw Eng IEEE Trans"},{"key":"10224_CR42","doi-asserted-by":"publisher","unstructured":"Peters F, Menzies T, Layman L (2015) Lace2: better privacy-preserving data sharing for cross project defect prediction. In: Software engineering (ICSE), 2015 IEEE\/ACM 37th IEEE international conference on, vol 1, pp 801\u2013811. https:\/\/doi.org\/10.1109\/ICSE.2015.92","DOI":"10.1109\/ICSE.2015.92"},{"key":"10224_CR43","doi-asserted-by":"crossref","unstructured":"Qing A (2009) Differential evolution: fundamentals and applications in electrical engineering. Wiley","DOI":"10.1002\/9780470823941"},{"key":"10224_CR44","doi-asserted-by":"publisher","unstructured":"Rahman F, Posnett D, Devanbu P (2012) Recalling the \u201cimprecision\u201d of cross-project defect prediction. In: Proc ACM SIGSOFT 20th Int Symp Found Softw Eng (FSE) ACM. https:\/\/doi.org\/10.1145\/2393596.2393669","DOI":"10.1145\/2393596.2393669"},{"issue":"2","key":"10224_CR45","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1007\/s10664-008-9102-8","volume":"14","author":"P Runeson","year":"2009","unstructured":"Runeson P, H\u00f6st M (2009) Guidelines for conducting and reporting case study research in software engineering. Empir Softw Eng 14(2):131\u2013164","journal-title":"Empir Softw Eng"},{"issue":"6","key":"10224_CR46","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1109\/TSE.2014.2322358","volume":"40","author":"M Shepperd","year":"2014","unstructured":"Shepperd M, Bowes D, Hall T (2014) Researcher bias: the use of machine learning in software defect prediction. IEEE Trans Softw Eng 40(6):603\u2013616. https:\/\/doi.org\/10.1109\/TSE.2014.2322358","journal-title":"IEEE Trans Softw Eng"},{"issue":"11","key":"10224_CR47","doi-asserted-by":"publisher","first-page":"1129","DOI":"10.1109\/TSE.2017.2731308","volume":"44","author":"M Shepperd","year":"2018","unstructured":"Shepperd M, Hall T, Bowes D (2018) Authors\u2019 reply to comments on researcher bias: the use of machine learning in software defect prediction. IEEE Trans Softw Eng 44(11):1129\u20131131. https:\/\/doi.org\/10.1109\/TSE.2017.2731308","journal-title":"IEEE Trans Softw Eng"},{"issue":"11","key":"10224_CR48","doi-asserted-by":"publisher","first-page":"1981","DOI":"10.1016\/j.infsof.2013.06.002","volume":"55","author":"E Shihab","year":"2013","unstructured":"Shihab E, Kamei Y, Adams B, Hassan AE (2013) Is lines of code a good measure of effort in effort-aware models? Inf Softw Technol 55 (11):1981\u20131993. https:\/\/doi.org\/10.1016\/j.infsof.2013.06.002, https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0950584913001316","journal-title":"Inf Softw Technol"},{"issue":"3\/4","key":"10224_CR49","doi-asserted-by":"publisher","first-page":"441","DOI":"10.2307\/1422689","volume":"100","author":"C Spearman","year":"1987","unstructured":"Spearman C (1987) The proof and measurement of association between two things. The American J Psychology 100(3\/4):441\u2013471. http:\/\/www.jstor.org\/stable\/1422689","journal-title":"The American J Psychology"},{"key":"10224_CR50","doi-asserted-by":"publisher","unstructured":"Tantithamthavorn C, McIntosh S, Hassan AE, Matsumoto K (2016) Automated parameter optimization of classification techniques for defect prediction models. In: Proc of the 38th int conf on software engineering ACM. https:\/\/doi.org\/10.1145\/2884781.2884857","DOI":"10.1145\/2884781.2884857"},{"issue":"11","key":"10224_CR51","doi-asserted-by":"publisher","first-page":"1092","DOI":"10.1109\/TSE.2016.2553030","volume":"42","author":"C Tantithamthavorn","year":"2016","unstructured":"Tantithamthavorn C, McIntosh S, Hassan AE, Matsumoto K (2016) Comments on \u201cresearcher bias: the use of machine learning in software defect prediction\u201d. IEEE Trans Softw Eng 42(11):1092\u20131094. https:\/\/doi.org\/10.1109\/TSE.2016.2553030","journal-title":"IEEE Trans Softw Eng"},{"issue":"1","key":"10224_CR52","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TSE.2016.2584050","volume":"43","author":"C Tantithamthavorn","year":"2017","unstructured":"Tantithamthavorn C, McIntosh S, Hassan AE, Matsumoto K (2017) An empirical comparison of model validation techniques for defect prediction models. IEEE Trans Softw Eng 43(1):1\u201318. https:\/\/doi.org\/10.1109\/TSE.2016.2584050","journal-title":"IEEE Trans Softw Eng"},{"issue":"6","key":"10224_CR53","doi-asserted-by":"publisher","first-page":"1101","DOI":"10.1016\/j.infsof.2012.10.003","volume":"55","author":"B Turhan","year":"2013","unstructured":"Turhan B, Misirli AT, Bener A (2013) Empirical evaluation of the effects of mixed project data on learning defect predictors. Inf Softw Technol 55 (6):1101\u20131118. https:\/\/doi.org\/10.1016\/j.infsof.2012.10.003","journal-title":"Inf Softw Technol"},{"key":"10224_CR54","doi-asserted-by":"publisher","unstructured":"Watanabe S, Kaiya H, Kaijiri K (2008) Adapting a fault prediction model to allow inter language reuse. In: Proc 4th int workshop on predictor models in softw eng (PROMISE) ACM. https:\/\/doi.org\/10.1145\/1370788.1370794","DOI":"10.1145\/1370788.1370794"},{"key":"10224_CR55","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29044-2","volume-title":"Experimentation in Software Engineering","author":"C Wohlin","year":"2012","unstructured":"Wohlin C, Runeson P, H\u00f6st M, Ohlsson MC, Regnell B, Wesslen A (2012) Experimentation in Software Engineering. Springer Publishing Company, Incorporated"},{"key":"10224_CR56","doi-asserted-by":"publisher","first-page":"106664","DOI":"10.1016\/j.infsof.2021.106664","volume":"139","author":"J Yao","year":"2021","unstructured":"Yao J, Shepperd M (2021) The impact of using biased performance metrics on software defect prediction research. Inf Softw Technol 139:106664. https:\/\/doi.org\/10.1016\/j.infsof.2021.106664, https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0950584921001270","journal-title":"Inf Softw Technol"},{"key":"10224_CR57","doi-asserted-by":"publisher","unstructured":"Zhang F, Mockus A, Keivanloo I, Zou Y (2015a) Towards building a universal defect prediction model with rank transformed predictors. Empirical Softw Eng:1\u201339. https:\/\/doi.org\/10.1007\/s10664-015-9396-2","DOI":"10.1007\/s10664-015-9396-2"},{"key":"10224_CR58","doi-asserted-by":"publisher","unstructured":"Zhang Y, Lo D, Xia X, Sun J (2015b) An empirical study of classifier combination for cross-project defect prediction. In: Computer software and applications conference (COMPSAC), 2015 IEEE 39th annual, vol 2, pp 264\u2013269. https:\/\/doi.org\/10.1109\/COMPSAC.2015.58","DOI":"10.1109\/COMPSAC.2015.58"},{"key":"10224_CR59","doi-asserted-by":"publisher","unstructured":"Zimmermann T, Nagappan N, Gall H, Giger E, Murphy B (2009) Cross-project defect prediction: a large scale experiment on data vs. domain vs. process. In: Proc the 7th joint meet europe software engineering conference (ESEC) and the ACM SIGSOFT Symp Found Softw Eng (FSE), ACM, pp 91\u2013100. https:\/\/doi.org\/10.1145\/1595696.1595713","DOI":"10.1145\/1595696.1595713"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10224-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-022-10224-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10224-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,20]],"date-time":"2023-02-20T13:11:17Z","timestamp":1676898677000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-022-10224-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,27]]},"references-count":59,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["10224"],"URL":"https:\/\/doi.org\/10.1007\/s10664-022-10224-4","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,27]]},"assertion":[{"value":"10 August 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"182"}}