{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T10:06:19Z","timestamp":1776074779933,"version":"3.50.1"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2013,4,3]],"date-time":"2013-04-03T00:00:00Z","timestamp":1364947200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Software Qual J"],"published-print":{"date-parts":[[2014,9]]},"DOI":"10.1007\/s11219-013-9200-8","type":"journal-article","created":{"date-parts":[[2013,4,2]],"date-time":"2013-04-02T07:51:23Z","timestamp":1364889083000},"page":"403-426","source":"Crossref","is-referenced-by-count":83,"title":["Comparing four approaches for technical debt identification"],"prefix":"10.1007","volume":"22","author":[{"given":"Nico","family":"Zazworka","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antonio","family":"Vetro\u2019","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Clemente","family":"Izurieta","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sunny","family":"Wong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuanfang","family":"Cai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carolyn","family":"Seaman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Forrest","family":"Shull","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2013,4,3]]},"reference":[{"key":"9200_CR1","doi-asserted-by":"crossref","unstructured":"Altman, D.\u00a0G. (1990) Practical Statistics for Medical Research (Statistics texts), 1st\u00a0ed. Chapman & Hall\/CRC, Nov. 1990. [Online]. Available: http:\/\/www.worldcat.org\/-isbn\/-0412276305 .","DOI":"10.1201\/9780429258589"},{"key":"9200_CR2","doi-asserted-by":"crossref","unstructured":"Ayewah, N., Pugh, W. (2010) The google findbugs fixit, In Proceedings of the 19th International Symposium on Software Testing and Analysis (pp. 241\u2013252), ser. ISSTA\u201910. New York, NY, USA: ACM. [Online]. Available: 10.1145\/-1831708.1831738 .","DOI":"10.1145\/1831708.1831738"},{"issue":"6","key":"9200_CR3","doi-asserted-by":"crossref","first-page":"728","DOI":"10.1109\/TSE.1984.5010301","volume":"SE-10","author":"VR Basili","year":"1984","unstructured":"Basili, V. R., & Weiss, D. M. (1984). A methodology for collecting valid software engineering data. Software Engineering, IEEE Transactions on, SE-10(6), 728\u2013738.","journal-title":"Software Engineering, IEEE Transactions on"},{"key":"9200_CR4","unstructured":"Izurieta C., Bieman, J. (2008) Testing consequences of grime buildup in object oriented design patterns, In Software Testing, Verification, and Validation, 2008 1st International Conference on, April 2008, pp. 171\u2013179."},{"key":"9200_CR5","unstructured":"Bieman, J.M., Straw, G., Wang, H., Munger, P.W., Alexander, R.T. (2003) Design patterns and change proneness: An examination of five evolving systems, Software Metrics Symposium, 2003. Proceedings. Ninth International, pp. 40\u201349, 3\u20135 Sept. 2003."},{"key":"9200_CR6","unstructured":"Boogerd, C., Moonen, L. (2009) Evaluating the relation between coding standard violations and faultswithin and across software versions, In Mining Software Repositories, 2009. MSR\u201909. 6th IEEE International Working Conference on, May 2009, pp. 41\u201350."},{"key":"9200_CR7","doi-asserted-by":"crossref","unstructured":"Brown, N., Cai, Y., Guo, Y., Kazman, R., Kim, M., Kruchten, P., Lim, E., MacCormack, A., Nord, R., Ozkaya, I., Sangwan, R., Seaman, C., Sullivan, K., Zazworka, N. (2010) Managing technical debt in software-reliant systems. In Proceedings of the FSE\/SDP workshop on Future of Software Engineering Research (pp. 47\u201352), ser. FoSER\u201910. New York, NY, USA: ACM, [Online]. Available: 10.1145\/-1882362.1882373 .","DOI":"10.1145\/1882362.1882373"},{"key":"9200_CR8","unstructured":"Brown, W.\u00a0J., Malveau, R.\u00a0C., Mowbray, T.\u00a0J. (1998) AntiPatterns: Refactoring software, architectures, and projects in crisis. Wiley, Mar. 1998. [Online]. Available: http:\/\/www.worldcat.org\/-isbn\/-0471197130 ."},{"key":"9200_CR9","unstructured":"CAST, (2010) Cast worldwide application software quality study: Summary of key findings, Tech. Rep."},{"key":"9200_CR10","unstructured":"Cohen, J. (1988) Statistical power analysis for the behavioral sciences: Jacob Cohen., 2nd\u00a0ed. Lawrence Erlbaum, Jan. 1988. [Online]. Available: http:\/\/www.worldcat.org\/-isbn\/-0805802835 ."},{"key":"9200_CR11","doi-asserted-by":"crossref","unstructured":"Cunningham W (1992) The wycash portfolio management system, In Addendum to the Proceedings on Object-Oriented Programming Systems, Languages, and Applications (Addendum), ser. OOPSLA\u201992 (pp. 29\u201330). New York, NY: ACM. [Online]. Available: 10.1145\/-157709.157715 .","DOI":"10.1145\/157709.157715"},{"key":"9200_CR12","doi-asserted-by":"crossref","unstructured":"D\u2019Ambros, M., Bacchelli, A., Lanza, M. (2010) On the impact of design flaws on software defects, In Quality Software (QSIC), 2010 10th International Conference on, July 2010 (pp. 23\u201331).","DOI":"10.1109\/QSIC.2010.58"},{"key":"9200_CR13","doi-asserted-by":"crossref","unstructured":"El\u00a0Emam, K., Wieczorek, I. (1998) The repeatability of code defect classifications, In Software Reliability Engineering, 1998. Proceedings. The Ninth International Symposium on, nov 1998 (pp. 322\u2013333).","DOI":"10.1109\/ISSRE.1998.730897"},{"key":"9200_CR14","unstructured":"Evans, J. (1996) Straightforward Statistics for the Behavioral Sciences. Brooks\/Cole Pub. Co., 1996. [Online]. Available: http:\/\/books.google.com\/-books?id=8Ca2AAAAIAAJ ."},{"key":"9200_CR15","doi-asserted-by":"crossref","unstructured":"Fenton, N., Neil, M., Marsh, W., Hearty, P., Marquez, D., Krause, P., Mishra, R. (2007) Predicting software defects in varying development lifecycles using bayesian nets, Information and Software Technology, 49:(1): 32\u201343, Most Cited Journal Articles in Software Engineering\u20142000. [Online]. Available: http:\/\/www.sciencedirect.com\/-science\/-article\/-pii\/-S0950584906001194 .","DOI":"10.1016\/j.infsof.2006.09.001"},{"key":"9200_CR16","unstructured":"Fleiss, J.\u00a0L. (1981) Statistical Methods for Rates and Proportions, 2nd\u00a0ed., Wiley series in probability and mathematical statistics. New York: Wiley."},{"key":"9200_CR17","volume-title":"Refactoring: Improving the design of existing code","author":"M Fowler","year":"1999","unstructured":"Fowler, M., Beck, K., Brant, J., Opdyke, W., & Roberts, D. (1999). Refactoring: Improving the design of existing code (1st ed.). Jul: Addison-Wesley Professional.","edition":"1"},{"key":"9200_CR18","doi-asserted-by":"crossref","unstructured":"Gat, I., Heintz, J.D., (2011) From assessment to reduction: How cutter consortium helps rein in millions of dollars in technical debt, In Proceedings of the 2nd Workshop on Managing Technical Debt (pp. 24\u201326), ser. MTD\u201911. New York, NY, USA: ACM. [Online]. Available: 10.1145\/-1985362.1985368 .","DOI":"10.1145\/1985362.1985368"},{"key":"9200_CR19","doi-asserted-by":"crossref","unstructured":"Gu\u00e9h\u00e9neuc, Y.-G., Albin-Amiot, H. (2001) Using design patterns and constraints to automate the detection and correction of inter-class design defects, In Proceedings of the 39th International Conference and Exhibition on Technology of Object-Oriented Languages and Systems (TOOLS39) (p 296), ser. TOOLS\u201901. Washington, DC, USA: IEEE Computer Society, 2001, [Online]. Available: http:\/\/dl.acm.org\/-citation.cfm?id=882501.884740 .","DOI":"10.1109\/TOOLS.2001.941682"},{"key":"9200_CR20","doi-asserted-by":"crossref","unstructured":"Hovemeyer, D., Pugh, W. (2004) Finding bugs is easy, SIGPLAN Not., 39: 92\u2013106. [Online]. Available: 10.1145\/-1052883.1052895 .","DOI":"10.1145\/1052883.1052895"},{"key":"9200_CR21","doi-asserted-by":"crossref","unstructured":"Izurieta, C., Bieman, J. (2007) How software designs decay: A pilot study of pattern evolution, In Empirical Software Engineering and Measurement, 2007. ESEM 2007. First International Symposium on, sept. 2007 (pp. 449\u2013451).","DOI":"10.1109\/ESEM.2007.55"},{"key":"9200_CR22","doi-asserted-by":"crossref","unstructured":"Izurieta, C., Bieman, J. (2012) A multiple case study of design pattern decay, grime, and rot in evolving software systems, Springer Software Quality Journal. February 2012, 10.1007\/s11219-012-9175-x .","DOI":"10.1007\/s11219-012-9175-x"},{"key":"9200_CR23","unstructured":"Khomh, F., Di Penta, M., Gueheneuc, Y.-G. (2009) An Exploratory study of the impact of code smells on software change-proneness, Reverse Engineering, 2009. WCRE \u201809. 16th Working Conference on, pp.75\u201384, 13\u201316 Oct. 2009."},{"key":"9200_CR24","doi-asserted-by":"crossref","unstructured":"Kim, S., Ernst, M.\u00a0D. (2007) Prioritizing warning categories by analyzing software history, In Proceedings of the Fourth International Workshop on Mining Software Repositories (p. 27), ser. MSR\u201907. Washington, DC, USA: IEEE Computer Society, [Online]. Available: 10.1109\/-MSR.2007.26 .","DOI":"10.1109\/MSR.2007.26"},{"key":"9200_CR25","doi-asserted-by":"crossref","unstructured":"Kim, S., Ernst, M.\u00a0D. (2007) Which warnings should i fix first? In Proceedings of the 6th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering (pp. 45\u201354), ser. ESEC-FSE\u201907. New York, NY, USA: ACM, [Online]. Available: 10.1145\/-1287624.1287633 .","DOI":"10.1145\/1287624.1287633"},{"issue":"1","key":"9200_CR26","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159\u2013174.","journal-title":"Biometrics"},{"key":"9200_CR27","volume-title":"Object-oriented metrics in practice","author":"M Lanza","year":"2006","unstructured":"Lanza, M., & Marinescu, R. (2006). Object-oriented metrics in practice. Berlin: Springer-Verlag."},{"key":"9200_CR28","first-page":"350","volume":"0","author":"R Marinescu","year":"2004","unstructured":"Marinescu, R. (2004). Detection strategies: Metrics-based rules for detecting design flaws. Software Maintenance, IEEE International Conference on, 0, 350\u2013359.","journal-title":"Software Maintenance, IEEE International Conference on"},{"key":"9200_CR29","unstructured":"Muthanna, S., Kontogiannis, K., Ponnambalam, K. Stacey, B. (2000) A maintainability model for industrial software systems using design level metrics, In Reverse Engineering, 2000. Proceedings. Seventh Working Conference on, 2000, pp. 248\u2013256."},{"key":"9200_CR30","unstructured":"Nagappan, N., Ball, T. (2005) Static analysis tools as early indicators of pre-release defect density, In Software Engineering, 2005. ICSE 2005. Proceedings. 27th International Conference on, may 2005."},{"key":"9200_CR31","doi-asserted-by":"crossref","unstructured":"Nagappan, N., Ball, T., Zeller, A. (2006) Mining metrics to predict component failures, In Proceedings of the 28th International Conference on Software Engineering (pp. 452\u2013461), ser. ICSE\u201906. New York, NY, USA: ACM, [Online]. Available: 10.1145\/-1134285.1134349 .","DOI":"10.1145\/1134285.1134349"},{"key":"9200_CR32","doi-asserted-by":"crossref","unstructured":"Nugroho, A., Visser, J., Kuipers, T. (2011) An empirical model of technical debt and interest, In Proceedings of the 2nd Workshop on Managing Technical Debt (pp. 1\u20138), ser. MTD\u201911. New York, NY, USA: ACM, [Online]. Available: 10.1145\/-1985362.1985364 .","DOI":"10.1145\/1985362.1985364"},{"key":"9200_CR33","doi-asserted-by":"crossref","unstructured":"Olbrich, S. M., Cruzes, D. S., Sjoberg, D. I. K. (2010) Are all code smells harmful? a study of god classes and brain classes in the evolution of three open source systems, In Proceedings of the 2010 IEEE International Conference on Software Maintenance (pp. 1\u201310), ser. ICSM\u201910. Washington, DC, USA: IEEE Computer Society. [Online]. Available: 10.1109\/-ICSM.2010.5609564 .","DOI":"10.1109\/ICSM.2010.5609564"},{"key":"9200_CR34","doi-asserted-by":"crossref","unstructured":"Park, H.-M., Jung, H.-W. (2003) Evaluating interrater agreement with intraclass correlation coefficient in spice-based software process assessment, In Quality Software, 2003. Proceedings of Third International Conference on, Nov. 2003 (pp. 308\u2013314).","DOI":"10.1109\/QSIC.2003.1319115"},{"key":"9200_CR35","doi-asserted-by":"crossref","unstructured":"Riaz, M., Mendes, E., Tempero, E. (2009) A systematic review of software maintainability prediction and metrics, In Empirical Software Engineering and Measurement, 2009. ESEM 2009. 3rd International Symposium on, Oct. 2009 (pp. 367\u2013377).","DOI":"10.1109\/ESEM.2009.5314233"},{"key":"9200_CR36","doi-asserted-by":"crossref","unstructured":"Schumacher, J., Zazworka, N., Shull, F., Seaman, C., Shaw, M. (2010) Building empirical support for automated code smell detection, In Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (pp. 8:1\u20138:10), ser. ESEM\u201910. New York, NY, USA: ACM. [Online]. Available: 10.1145\/-1852786.1852797 .","DOI":"10.1145\/1852786.1852797"},{"issue":"2","key":"9200_CR37","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MS.2011.38","volume":"28","author":"F Shull","year":"2011","unstructured":"Shull, F. (2011). Perfectionists in a world of finite resources. IEEE Software, 28(2), 4\u20136.","journal-title":"IEEE Software"},{"key":"9200_CR38","doi-asserted-by":"crossref","unstructured":"Vetro\u2019, A., Morisio, M., Torchiano, M. (2011) An empirical validation of findbugs issues related to defects, IET Seminar Digests, 2011(1):144\u2013153. [Online]. Available: http:\/\/-link.aip.org\/-link\/-abstract\/-IEESEM\/-v2011\/-i1\/-p144\/-s1.","DOI":"10.1049\/ic.2011.0018"},{"key":"9200_CR39","unstructured":"Vetro\u2019, A., Torchiano, M., Morisio, M. (2010) Assessing the precision of findbugs by mining java projects developed at a university, In Mining Software Repositories (MSR), 2010 7th IEEE Working Conference on, may 2010, pp. 110\u2013113."},{"key":"9200_CR40","doi-asserted-by":"crossref","unstructured":"Wagner, S., J\u00fcrjens, J., Koller, C., Trischberger, P. (2005) Comparing bug finding tools with reviews and tests, In Proceedings of the International Conference on Testing of Communications Systems (pp. 40\u201355).","DOI":"10.1007\/11430230_4"},{"key":"9200_CR41","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4615-4625-2","volume-title":"Experimentation in software engineering: An introduction","author":"C Wohlin","year":"2000","unstructured":"Wohlin, C., Runeson, P., H\u00f6st, M., Ohlsson, M. C., Regnell, B., & Wessl\u00e9n, A. (2000). Experimentation in Software Engineering: An Introduction. Norwell, MA, USA: Kluwer Academic Publishers."},{"key":"9200_CR42","unstructured":"Wong, S., Cai, Y., Kim, M., Dalton, M. (2011) Detecting software modularity violations, In Proceedings of 33th International Conference on Software Engineering (pp. 411\u2013420), May 2011."},{"key":"9200_CR43","doi-asserted-by":"crossref","unstructured":"Zazworka, N., Shaw, M. A., Shull, F., Seaman, C. (2011) Investigating the impact of design debt on software quality, In Proceeding of the 2nd Working on Managing Technical Debt (pp. 17\u201323), ser. MTD\u201911. New York, NY, USA: ACM, [Online]. Available: 10.1145\/-1985362.1985366 .","DOI":"10.1145\/1985362.1985366"}],"container-title":["Software Quality Journal"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-013-9200-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11219-013-9200-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-013-9200-8","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,30]],"date-time":"2025-04-30T02:49:59Z","timestamp":1745981399000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11219-013-9200-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,4,3]]},"references-count":43,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,9]]}},"alternative-id":["9200"],"URL":"https:\/\/doi.org\/10.1007\/s11219-013-9200-8","relation":{},"ISSN":["0963-9314","1573-1367"],"issn-type":[{"value":"0963-9314","type":"print"},{"value":"1573-1367","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,4,3]]}}}