{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T05:19:56Z","timestamp":1792646396197,"version":"4.5.0"},"reference-count":65,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2020,9,21]],"date-time":"2020-09-21T00:00:00Z","timestamp":1600646400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,21]],"date-time":"2020-09-21T00:00:00Z","timestamp":1600646400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["402774445"],"award-info":[{"award-number":["402774445"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2020,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Automated static analysis tools (ASATs) have become a major part of the software development workflow. Acting on the generated warnings, i.e., changing the code indicated in the warning, should be part of, at latest, the code review phase. Despite this being a best practice in software development, there is still a lack of empirical research regarding the usage of ASATs in the wild. In this work, we want to study ASAT warning trends in software via the example of PMD as an ASAT and its usage in open source projects. We analyzed the commit history of 54 projects (with 112,266 commits in total), taking into account 193 PMD rules and 61 PMD releases. We investigate trends of ASAT warnings over up to 17 years for the selected study subjects regarding changes of warning types, short and long term impact of ASAT use, and changes in warning severities. We found that large global changes in ASAT warnings are mostly due to coding style changes regarding braces and naming conventions. We also found that, surprisingly, the influence of the presence of PMD in the build process of the project on warning removal trends for the number of warnings per lines of code is small and not statistically significant. Regardless, if we consider defect density as a proxy for external quality, we see a positive effect if PMD is present in the build configuration of our study subjects.<\/jats:p>","DOI":"10.1007\/s10664-020-09880-1","type":"journal-article","created":{"date-parts":[[2020,9,21]],"date-time":"2020-09-21T01:02:43Z","timestamp":1600650163000},"page":"5137-5192","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["A longitudinal study of static analysis warning evolution and the effects of PMD on software quality in Apache open source projects"],"prefix":"10.1007","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5236-7953","authenticated-orcid":false,"given":"Alexander","family":"Trautsch","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9765-2803","authenticated-orcid":false,"given":"Steffen","family":"Herbold","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jens","family":"Grabowski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,9,21]]},"reference":[{"key":"9880_CR1","unstructured":"Abdi H (2007) Bonferroni and Sidak corrections for multiple comparisons. In: Encyclopedia of Measurement and Statistics, Sage, Thousand Oaks, CA, pp 103\u2013107"},{"key":"9880_CR2","doi-asserted-by":"publisher","first-page":"110427","DOI":"10.1016\/j.jss.2019.110427","volume":"158","author":"B Aloraini","year":"2019","unstructured":"Aloraini B, Nagappan M, German DM, Hayashi S, Higo Y (2019) An empirical study of security warnings from static application security testing tools. J Syst Softw 158:110427. https:\/\/doi.org\/10.1016\/j.jss.2019.110427. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0164121219302018","journal-title":"J Syst Softw"},{"key":"9880_CR3","doi-asserted-by":"crossref","unstructured":"Aversano L, Canfora G, Cerulo L, Del Grosso C, Di Penta M (2007) An empirical study on the evolution of design patterns. In: Proceedings of the the 6th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering, ACM, New York, NY, USA, ESEC-FSE \u201907, pp 385\u2013394. http:\/\/doi.acm.org\/10.1145\/1287624.1287680","DOI":"10.1145\/1287624.1287680"},{"key":"9880_CR4","doi-asserted-by":"crossref","unstructured":"Bakota T, Hegedu\u030bs P, K\u00f6rtv\u00e9lyesi P, Ferenc R, Gyim\u00f3thy T (2011) A probabilistic software quality model. In: 2011 27th IEEE International Conference on Software Maintenance (ICSM), pp 243\u2013252","DOI":"10.1109\/ICSM.2011.6080791"},{"key":"9880_CR5","doi-asserted-by":"crossref","unstructured":"Beller M, Bholanath R, McIntosh S, Zaidman A (2016) Analyzing the state of static analysis: A large-scale evaluation in open source software. In: 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER), 1, pp 470\u2013481","DOI":"10.1109\/SANER.2016.105"},{"key":"9880_CR6","doi-asserted-by":"crossref","unstructured":"Bird C, Rigby PC, Barr ET, Hamilton DJ, German DM, Devanbu P (2009) The promises and perils of mining git. In: 2009 6th IEEE International Working Conference on Mining Software Repositories, pp 1\u201310","DOI":"10.1109\/MSR.2009.5069475"},{"key":"9880_CR7","unstructured":"Boehm BW, Brown JR, Lipow M (1976) Quantitative evaluation of software quality. In: Proceedings of the 2Nd International Conference on Software Engineering, IEEE Computer Society Press, Los Alamitos, CA, USA, ICSE \u201976, pp 592\u2013605. http:\/\/dl.acm.org\/citation.cfm?id=800253.807736"},{"issue":"6634","key":"9880_CR8","doi-asserted-by":"publisher","first-page":"1454","DOI":"10.1136\/bmj.296.6634.1454","volume":"296","author":"MJ Campbell","year":"1988","unstructured":"Campbell MJ, Gardner MJ (1988) Statistics in medicine: Calculating confidence intervals for some non-parametric analyses. BMJ 296(6634):1454\u20131456. https:\/\/doi.org\/10.1136\/bmj.296.6634.1454. https:\/\/www.bmj.com\/content\/296\/6634\/1454.full.pdf, https:\/\/www.bmj.com\/content\/296\/6634\/1454","journal-title":"BMJ"},{"key":"9880_CR9","doi-asserted-by":"crossref","unstructured":"Christakis M, Bird C (2016) What developers want and need from program analysis: An empirical study. In: Proceedings of the 31st IEEE\/ACM International Conference on Automated Software Engineering, ACM, New York, NY, USA, ASE 2016, pp 332\u2013343. http:\/\/doi.acm.org\/10.1145\/2970276.2970347","DOI":"10.1145\/2970276.2970347"},{"key":"9880_CR10","unstructured":"Cohen J (1988) Statistical power analysis for the behavioral sciences, L. Erlbaum Associates"},{"key":"9880_CR11","doi-asserted-by":"crossref","unstructured":"Devanbu P, Zimmermann T, Bird C (2016) Belief evidence in empirical software engineering. In: 2016 IEEE\/ACM 38th International Conference on Software Engineering (ICSE), pp 108\u2013119","DOI":"10.1145\/2884781.2884812"},{"key":"9880_CR12","doi-asserted-by":"crossref","unstructured":"Digkas G, Lungu M, Avgeriou P, Chatzigeorgiou A, Ampatzoglou A (2018) How do developers fix issues and pay back technical debt in the apache ecosystem?. In: 2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER), pp 153\u2013163","DOI":"10.1109\/SANER.2018.8330205"},{"issue":"1","key":"9880_CR13","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1007\/BF01386390","volume":"1","author":"EW Dijkstra","year":"1959","unstructured":"Dijkstra EW (1959) A note on two problems in connexion with graphs. Numer Math 1(1):269\u2013271. https:\/\/doi.org\/10.1007\/BF01386390","journal-title":"Numer Math"},{"issue":"8","key":"9880_CR14","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1145\/3338112","volume":"62","author":"D Distefano","year":"2019","unstructured":"Distefano D, F\u00e4hndrich M, Logozzo F, O\u2019Hearn PW (July 2019) Scaling static analyses at facebook. Commun. ACM 62(8):62\u201370. https:\/\/doi.org\/10.1145\/3338112","journal-title":"Commun. ACM"},{"key":"9880_CR15","doi-asserted-by":"crossref","unstructured":"Farag\u00f3 C, Hegedu\u030bs P, Ferenc R (2015) Code ownership: Impact on maintainability. In: Gervasi O, Murgante B, Misra S, Gavrilova ML, Rocha A M AC, Torre C, Taniar D, Apduhan BO (eds) Computational Science and Its Applications \u2013 ICCSA 2015, Springer International Publishing, Cham, pp 3\u201319","DOI":"10.1007\/978-3-319-21413-9_1"},{"key":"9880_CR16","doi-asserted-by":"publisher","DOI":"10.1201\/b17461","volume-title":"Software metrics: A rigorous and practical approach","author":"N Fenton","year":"2014","unstructured":"Fenton N, Bieman J (2014) Software metrics: A rigorous and practical approach, 3rd edn. CRC Press, Inc., Boca Raton, FL, USA","edition":"3rd edn."},{"key":"9880_CR17","doi-asserted-by":"publisher","unstructured":"Ferenc R, Hegedu\u030bs P, Gyim\u00f3thy T (2014) Software product quality models. In: Mens T, Serebrenik A, Cleve A (eds) Evolving Software Systems, Springer Berlin Heidelberg, Berlin, Heidelberg, pp 65\u2013100, DOI https:\/\/doi.org\/10.1007\/978-3-642-45398-4_3, (to appear in print)","DOI":"10.1007\/978-3-642-45398-4_3"},{"key":"9880_CR18","doi-asserted-by":"publisher","unstructured":"Ferenc R, T\u00f3th Z, Lad\u00e1nyi G, Siket I, Gyim\u00f3thy T (2020) A public unified bug dataset for java and its assessment regarding metrics and bug prediction. Softw Qual J. https:\/\/doi.org\/10.1007\/s11219-020-09515-0","DOI":"10.1007\/s11219-020-09515-0"},{"key":"9880_CR19","volume-title":"Refactoring: Improving the design of existing code","author":"M Fowler","year":"1999","unstructured":"Fowler M (1999) Refactoring: Improving the design of existing code. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA"},{"key":"9880_CR20","unstructured":"FrontEndART (2019) Sourcemeter. https:\/\/www.sourcemeter.com\/"},{"key":"9880_CR21","doi-asserted-by":"crossref","unstructured":"Habib A, Pradel M (2018) How many of all bugs do we find? a study of static bug detectors. In: Proceedings of the 33rd ACM\/IEEE International Conference on Automated Software Engineering, ACM, New York, NY, USA, ASE 2018, pp 317\u2013328. http:\/\/doi.acm.org\/10.1145\/3238147.3238213","DOI":"10.1145\/3238147.3238213"},{"key":"9880_CR22","unstructured":"Hagberg AA, Schult DA, Swart PJ (2008) Exploring network structure, dynamics, and function using NetworkX. In: Proceedings of the 7th Python in Science Conference (SciPy2008), Pasadena, CA USA, pp 11\u201315"},{"key":"9880_CR23","doi-asserted-by":"crossref","unstructured":"Heckman S, Williams L (2009) A model building process for identifying actionable static analysis alerts. In: 2009 International Conference on Software Testing Verification and Validation, pp 161\u2013170","DOI":"10.1109\/ICST.2009.45"},{"issue":"4","key":"9880_CR24","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1016\/j.infsof.2010.12.007","volume":"53","author":"S Heckman","year":"2011","unstructured":"Heckman S, Williams L (April 2011) A systematic literature review of actionable alert identification techniques for automated static code analysis. Inf. Softw. Technol. 53(4):363\u2013387. https:\/\/doi.org\/10.1016\/j.infsof.2010.12.007. https:\/\/doi.org\/10.1016\/j.infsof.2010.12.007","journal-title":"Inf. Softw. Technol."},{"key":"9880_CR25","unstructured":"Herbold S, Trautsch A, Trautsch F (2019) Issues with szz: An empirical assessment of the state of practice of defect prediction data collection. arxiv:1911.08938, Article is currently in submission to IEEE Transactions on Software Engineering"},{"key":"9880_CR26","doi-asserted-by":"crossref","unstructured":"Johnson B, Song Y, Murphy-Hill E, Bowdidge R (2013) Why don't software developers use static analysis tools to find bugs?. In: Proceedings of the 2013 International Conference on Software Engineering, IEEE Press, Piscataway, NJ, USA, ICSE \u201913, pp 672\u2013681. http:\/\/dl.acm.org\/citation.cfm?id=2486788.2486877","DOI":"10.1109\/ICSE.2013.6606613"},{"key":"9880_CR27","unstructured":"Jones E, Oliphant T, Peterson P, et al. (2001) SciPy: Open source scientific tools for Python. http:\/\/www.scipy.org\/, [Online; accessed 17.09.2018]"},{"key":"9880_CR28","unstructured":"Kendall MG (1955) Rank correlation methods. Charles Griffin & Co. Ltd"},{"key":"9880_CR29","doi-asserted-by":"publisher","unstructured":"Kim S, Ernst MD (2007) Prioritizing warning categories by analyzing software history. In: Proceedings of the Fourth International Workshop on Mining Software Repositories, IEEE Computer Society, Washington, DC, USA, MSR \u201907, pp 27\u2013, DOI https:\/\/doi.org\/10.1109\/MSR.2007.26, (to appear in print)","DOI":"10.1109\/MSR.2007.26"},{"key":"9880_CR30","doi-asserted-by":"crossref","unstructured":"Kim S, Ernst MD (2007) Which warnings should i fix first?. In: Proceedings of the the 6th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering, ACM, New York, NY, USA, ESEC-FSE \u201907, pp 45\u201354","DOI":"10.1145\/1287624.1287633"},{"issue":"1","key":"9880_CR31","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1109\/52.476281","volume":"13","author":"B Kitchenham","year":"1996","unstructured":"Kitchenham B, Pfleeger SL (1996) Software quality: the elusive target [special issues section]. IEEE Softw 13(1):12\u201321. https:\/\/doi.org\/10.1109\/52.476281","journal-title":"IEEE Softw"},{"key":"9880_CR32","doi-asserted-by":"crossref","unstructured":"Kitchenham BA, Dyba T, Jorgensen M (2004) Evidence-based software engineering. In: Proceedings of the 26th International Conference on Software Engineering, IEEE Computer Society, Washington, DC, USA, ICSE \u201904, pp 273\u2013281. http:\/\/dl.acm.org\/citation.cfm?id=998675.999432","DOI":"10.1109\/ICSE.2004.1317449"},{"key":"9880_CR33","volume-title":"Advanced engineering mathematics: Maple computer guide","author":"E Kreyszig","year":"2000","unstructured":"Kreyszig E (2000) Advanced engineering mathematics: Maple computer guide, 8th edn. John Wiley & Sons, Inc., New York, NY, USA","edition":"8th edn."},{"issue":"6","key":"9880_CR34","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/MS.2012.167","volume":"29","author":"P Kruchten","year":"2012","unstructured":"Kruchten P, Nord RL, Ozkaya I (2012) Technical debt: From metaphor to theory and practice. IEEE Softw 29(6):18\u201321. https:\/\/doi.org\/10.1109\/MS.2012.167","journal-title":"IEEE Softw"},{"key":"9880_CR35","doi-asserted-by":"crossref","unstructured":"Lehman MM (1996) Laws of software evolution revisited. In: Proceedings of the 5th European Workshop on Software Process Technology, Springer-Verlag, Berlin, Heidelberg, EWSPT \u201996, pp 108\u2013124. http:\/\/dl.acm.org\/citation.cfm?id=646195.681473","DOI":"10.1007\/BFb0017737"},{"key":"9880_CR36","unstructured":"Levene H (1960) Robust tests for equality of variances. In: Contributions to probability and statistics, Stanford Univ. Press, Stanford, Calif., pp 278\u2013292"},{"key":"9880_CR37","doi-asserted-by":"publisher","unstructured":"Liu K, Kim D, Bissyande TF, Yoo S, Le Traon Y (2018) Mining fix patterns for findbugs violations. IEEE Trans Softw Eng, p 1\u20131. https:\/\/doi.org\/10.1109\/TSE.2018.2884955","DOI":"10.1109\/TSE.2018.2884955"},{"issue":"2","key":"9880_CR38","doi-asserted-by":"publisher","first-page":"751","DOI":"10.1007\/s10664-018-9637-2","volume":"24","author":"BA Malloy","year":"2019","unstructured":"Malloy BA, Power JF (2019) An empirical analysis of the transition from python 2 to python 3. Empir Softw Eng 24(2):751\u2013778. https:\/\/doi.org\/10.1007\/s10664-018-9637-2","journal-title":"Empir Softw Eng"},{"issue":"1","key":"9880_CR39","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1214\/aoms\/1177730491","volume":"18","author":"HB Mann","year":"1947","unstructured":"Mann HB, Whitney DR (1947) On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat 18(1):50\u201360","journal-title":"Ann Math Stat"},{"key":"9880_CR40","doi-asserted-by":"publisher","unstructured":"Marcilio D, Bonif\u00e1cio R, Monteiro E, Canedo E, Luz W, Pinto G (2019) Are static analysis violations really fixed?: A closer look at realistic usage of sonarqube. In: Proceedings of the 27th International Conference on Program Comprehension, IEEE Press, Piscataway, NJ, USA, ICPC \u201919, pp 209\u2013219. https:\/\/doi.org\/10.1109\/ICPC.2019.00040","DOI":"10.1109\/ICPC.2019.00040"},{"issue":"4","key":"9880_CR41","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1109\/TSE.1976.233837","volume":"2","author":"TJ McCabe","year":"1976","unstructured":"McCabe TJ (July 1976) A complexity measure. IEEE Trans. Softw. Eng. 2(4):308\u2013320. https:\/\/doi.org\/10.1109\/TSE.1976.233837","journal-title":"IEEE Trans. Softw. Eng."},{"key":"9880_CR42","unstructured":"McCall JA, Richards PK, Walters GF (1977) Factors in software quality: concept and definitions of software quality. Rome Air Development Center, Air Force Systems Command, Griffiss Air Force Base, New York, (13)"},{"key":"9880_CR43","doi-asserted-by":"crossref","unstructured":"Panichella S, Arnaoudova V, Di Penta M, Antoniol G (2015) Would static analysis tools help developers with code reviews?. In: 2015 IEEE 22nd International Conference on Software Analysis, Evolution, and Reengineering (SANER), pp 161\u2013170","DOI":"10.1109\/SANER.2015.7081826"},{"key":"9880_CR44","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: Machine learning in Python. J Mach Learn Res 12:2825\u20132830","journal-title":"J Mach Learn Res"},{"issue":"10","key":"9880_CR45","doi-asserted-by":"publisher","first-page":"1469","DOI":"10.1016\/j.infsof.2009.04.013","volume":"51","author":"MD Penta","year":"2009","unstructured":"Penta MD, Cerulo L, Aversano L (2009) The life and death of statically detected vulnerabilities: An empirical study. Inf Softw Technol 51 (10):1469\u20131484. https:\/\/doi.org\/10.1016\/j.infsof.2009.04.013. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0950584909000500, Source Code Analysis and Manipulation, SCAM 2008","journal-title":"Inf Softw Technol"},{"key":"9880_CR46","doi-asserted-by":"crossref","unstructured":"Plosch R, Gruber H, Hentschel A, Pomberger G, Schiffer S (2008) On the relation between external software quality and static code analysis. In: 2008 32nd Annual IEEE Software Engineering Workshop, pp 169\u2013174","DOI":"10.1109\/SEW.2008.17"},{"key":"9880_CR47","doi-asserted-by":"publisher","unstructured":"Querel L-P, Rigby PC (2018) Warningsguru: Integrating statistical bug models with static analysis to provide timely and specific bug warnings. In: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Association for Computing Machinery, New York, NY, USA, ESEC\/FSE 2018, pp 892\u2013895. https:\/\/doi.org\/10.1145\/3236024.3264599","DOI":"10.1145\/3236024.3264599"},{"key":"9880_CR48","doi-asserted-by":"crossref","unstructured":"Rahman F, Khatri S, Barr ET, Devanbu P (2014) Comparing static bug finders and statistical prediction. In: Proceedings of the 36th International Conference on Software Engineering, ACM, New York, NY, USA, ICSE 2014, pp 424\u2013434. http:\/\/doi.acm.org\/10.1145\/2568225.2568269","DOI":"10.1145\/2568225.2568269"},{"key":"9880_CR49","doi-asserted-by":"publisher","unstructured":"Rosen C, Grawi B, Shihab E (2015) Commit guru: Analytics and risk prediction of software commits. In: Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, Association for Computing Machinery, New York, NY, USA, ESEC\/FSE 2015, pp 966\u2013969. https:\/\/doi.org\/10.1145\/2786805.2803183","DOI":"10.1145\/2786805.2803183"},{"issue":"4","key":"9880_CR50","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1145\/3188720","volume":"61","author":"C Sadowski","year":"2018","unstructured":"Sadowski C, Aftandilian E, Eagle A, Miller-Cushon L, Jaspan C (March 2018) Lessons from building static analysis tools at google. Commun. ACM 61(4):58\u201366. https:\/\/doi.org\/10.1145\/3188720","journal-title":"Commun. ACM"},{"issue":"4","key":"9880_CR51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1082983.1083147","volume":"30","author":"J \u015aliwerski","year":"2005","unstructured":"\u015aliwerski J, Zimmermann T, Zeller A (May 2005) When do changes induce fixes?. SIGSOFT Softw. Eng. Notes 30(4):1\u20135. https:\/\/doi.org\/10.1145\/1082983.1083147","journal-title":"SIGSOFT Softw. Eng. Notes"},{"key":"9880_CR52","first-page":"88","volume":"15","author":"C Spearman","year":"1904","unstructured":"Spearman C (1904) The proof and measurement of association between two things. Am J Psychol 15:88\u2013103","journal-title":"Am J Psychol"},{"key":"9880_CR53","doi-asserted-by":"crossref","unstructured":"Sz\u00f3ke G, Antal G, Nagy C, Ferenc R, Gyim\u00f3thy T (2014) Bulk fixing coding issues and its effects on software quality: Is it worth refactoring?. In: 2014 IEEE 14th International Working Conference on Source Code Analysis and Manipulation, pp 95\u2013104","DOI":"10.1109\/SCAM.2014.18"},{"key":"9880_CR54","doi-asserted-by":"crossref","unstructured":"Thung F, Lucia, Lo D, Jiang L, Rahman F, Devanbu PT (2012) To what extent could we detect field defects? an empirical study of false negatives in static bug finding tools. In: 2012 Proceedings of the 27th IEEE\/ACM International Conference on Automated Software Engineering, pp 50\u201359","DOI":"10.1145\/2351676.2351685"},{"key":"9880_CR55","unstructured":"Trautsch A, Herbold S, Grabowski J (2020) A longitudinal study of static analysis warning evolution and the effects of pmd on software quality in apache open source projects - online appendix and replication kit. http:\/\/www.user.informatik.uni-goettingen.de\/~trautsch2\/emse2019"},{"key":"9880_CR56","doi-asserted-by":"publisher","first-page":"1036","DOI":"10.1007\/s10664-017-9537-x","volume":"23","author":"F Trautsch","year":"2017","unstructured":"Trautsch F, Herbold S, Makedonski P, Grabowski J (2017) Addressing problems with replicability and validity of repository mining studies through a smart data platform. Empir Softw Eng 23:1036\u20131083. https:\/\/doi.org\/10.1007\/s10664-017-9537-x","journal-title":"Empir Softw Eng"},{"issue":"4","key":"9880_CR57","doi-asserted-by":"publisher","first-page":"e1838","DOI":"10.1002\/smr.1838","volume":"29","author":"M Tufano","year":"2017","unstructured":"Tufano M, Palomba F, Bavota G, Penta MD, Oliveto R, Lucia AD, Poshyvanyk D (2017) There and back again: Can you compile that snapshot?. J Soft Evol Process 29(4):e1838. http:\/\/dblp.uni-trier.de\/db\/journals\/smr\/smr29.html#TufanoPBPOLP17","journal-title":"J Soft Evol Process"},{"key":"9880_CR58","doi-asserted-by":"publisher","unstructured":"Vassallo C, Panichella S, Palomba F, Proksch S, Gall HC, Zaidman A (2019) How developers engage with static analysis tools in different contexts. Empir Softw Eng, pp 1419\u20131457. https:\/\/doi.org\/10.1007\/s10664-019-09750-5","DOI":"10.1007\/s10664-019-09750-5"},{"key":"9880_CR59","doi-asserted-by":"crossref","unstructured":"Vetro A, Morisio M, Torchiano M (2011) An empirical validation of findbugs issues related to defects. In: 15th Annual Conference on Evaluation Assessment in Software Engineering (EASE 2011), pp 144\u2013153","DOI":"10.1049\/ic.2011.0018"},{"key":"9880_CR60","doi-asserted-by":"crossref","unstructured":"Wagner S, Lochmann K, Heinemann L, Kl\u00e4s M, Trendowicz A, Pl\u00f6sch R, Seidl A, Goeb A, Streit J (2012) The quamoco product quality modelling and assessment approach. In: Proceedings of the 34th International Conference on Software Engineering, IEEE Press, Piscataway, NJ, USA, ICSE \u201912, pp 1133\u20131142. http:\/\/dl.acm.org\/citation.cfm?id=2337223.2337372","DOI":"10.1109\/ICSE.2012.6227106"},{"issue":"3-4","key":"9880_CR61","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1093\/biomet\/52.3-4.591","volume":"52","author":"MB Wilk","year":"1965","unstructured":"Wilk MB, Shapiro SS (1965) An analysis of variance test for normality (complete samples)\u2021. Biometrika 52(3-4):591\u2013611. https:\/\/doi.org\/10.1093\/biomet\/52.3-4.591","journal-title":"Biometrika"},{"key":"9880_CR62","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-4625-2","volume-title":"Experimentation in software engineering: An introduction","author":"C Wohlin","year":"2000","unstructured":"Wohlin C, Runeson P, H\u00f6st M, Ohlsson MC, Regnell B, Wessl\u00e9n A (2000) Experimentation in software engineering: An introduction. Kluwer Academic Publishers, Norwell, MA, USA"},{"key":"9880_CR63","doi-asserted-by":"crossref","unstructured":"Zampetti F, Scalabrino S, Oliveto R, Canfora G, Penta MD (2017) How open source projects use static code analysis tools in continuous integration pipelines. In: 2017 IEEE\/ACM 14th International Conference on Mining Software Repositories (MSR), pp 334\u2013344","DOI":"10.1109\/MSR.2017.2"},{"issue":"4","key":"9880_CR64","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1109\/TSE.2006.38","volume":"32","author":"J Zheng","year":"2006","unstructured":"Zheng J, Williams L, Nagappan N, Snipes W, Hudepohl JP, Vouk MA (2006) On the value of static analysis for fault detection in software. IEEE Trans Softw Eng 32(4):240\u2013253. https:\/\/doi.org\/10.1109\/TSE.2006.38","journal-title":"IEEE Trans Softw Eng"},{"key":"9880_CR65","doi-asserted-by":"publisher","unstructured":"Zimmermann T, Premraj R, Zeller A (2007) Predicting defects for eclipse. In: Proceedings of the Third International Workshop on Predictor Models in Software Engineering, IEEE Computer Society, Washington, DC, USA, PROMISE \u201907, pp 9\u2013. https:\/\/doi.org\/10.1109\/PROMISE.2007.10","DOI":"10.1109\/PROMISE.2007.10"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-020-09880-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-020-09880-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-020-09880-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,20]],"date-time":"2021-09-20T21:14:22Z","timestamp":1632172462000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-020-09880-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,21]]},"references-count":65,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,11]]}},"alternative-id":["9880"],"URL":"https:\/\/doi.org\/10.1007\/s10664-020-09880-1","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,21]]},"assertion":[{"value":"21 September 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}