{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T17:21:45Z","timestamp":1778779305193,"version":"3.51.4"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2020,9,14]],"date-time":"2020-09-14T00:00:00Z","timestamp":1600041600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,14]],"date-time":"2020-09-14T00:00:00Z","timestamp":1600041600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Dutch 4TU project \u201dBig Softwareon the Run\u201d"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2020,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Open source software projects often use issue repositories, where project contributors submit bug reports. Using these repositories, more bugs in software projects may be identified and fixed. However, the content and therefore quality of bug reports vary. In this study, we aim to understand the significance of different elements in bug reports. We interviewed 35 developers to gain insights into their perceptions on the importance of various contents in bug reports. To assess our findings, we surveyed 305 developers. The results show developers find it highly important that bug reports include crash description, reproducing steps or test cases, and stack traces. Software version, fix suggestions, code snippets, and attached contents have lower importance for software debugging. Furthermore, to evaluate the quality of currently available bug reports, we mined issue repositories of 250 most popular projects on Github. Statistical analysis on the mined issues shows that crash reproducing steps, stack traces, fix suggestions, and user contents, have statistically significant impact on bug resolution times, for \u223c70%, \u223c76%, \u223c55%, and \u223c33% of the projects. However, on avarage, over 70% of bug reports lack these elements.<\/jats:p>","DOI":"10.1007\/s10664-020-09882-z","type":"journal-article","created":{"date-parts":[[2020,9,14]],"date-time":"2020-09-14T15:03:46Z","timestamp":1600095826000},"page":"5255-5294","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["The significance of bug report elements"],"prefix":"10.1007","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2788-796X","authenticated-orcid":false,"given":"Mozhan","family":"Soltani","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Felienne","family":"Hermans","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"B\u00e4ck","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,9,14]]},"reference":[{"issue":"4","key":"9882_CR1","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1007\/s10664-010-9152-6","volume":"16","author":"S Adolph","year":"2011","unstructured":"Adolph S, Hall W, Kruchten P (2011) Using grounded theory to study the experience of software development. Empir Softw Eng 16(4):487\u2013513","journal-title":"Empir Softw Eng"},{"key":"9882_CR2","doi-asserted-by":"crossref","unstructured":"Anvik J, Hiew L, Murphy GC (2005) Coping with an open bug repository. In: Proceedings of the 2005 OOPSLA workshop on Eclipse technology eXchange, ACM, pp 35\u201339","DOI":"10.1145\/1117696.1117704"},{"issue":"2","key":"9882_CR3","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1111\/j.1365-2648.1994.tb01088.x","volume":"19","author":"KL Barriball","year":"1994","unstructured":"Barriball KL, While A (1994) Collecting data using a semi-structured interview: a discussion paper. J Adv Nursing-Institut Subscript 19(2):328\u2013335","journal-title":"J Adv Nursing-Institut Subscript"},{"issue":"4","key":"9882_CR4","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1109\/32.799939","volume":"25","author":"VR Basili","year":"1999","unstructured":"Basili VR, Shull F, Lanubile F (1999) Building knowledge through families of experiments. IEEE Trans Softw Eng 25(4):456\u2013473","journal-title":"IEEE Trans Softw Eng"},{"key":"9882_CR5","unstructured":"Borges H, Valente MT, Hora A, Coelho J (2015) On the popularity of github applications: a preliminary note. arXiv:1507.00604"},{"issue":"2","key":"9882_CR6","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","volume":"3","author":"V Braun","year":"2006","unstructured":"Braun V, Clarke V (2006) Using thematic analysis in psychology. Qual Res Psycho 3(2):77\u2013101","journal-title":"Qual Res Psycho"},{"issue":"2","key":"9882_CR7","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1109\/TSE.2014.2363469","volume":"41","author":"N Chen","year":"2015","unstructured":"Chen N, Kim S (2015) Star: stack trace based automatic crash reproduction via symbolic execution. IEEE Tr Sw Eng 41(2):198\u2013220","journal-title":"IEEE Tr Sw Eng"},{"key":"9882_CR8","volume-title":"Research design: qualitative, quantitative, and mixed methods approaches","author":"JW Creswell","year":"2017","unstructured":"Creswell JW, Creswell JD (2017) Research design: qualitative, quantitative, and mixed methods approaches. Sage Publications, California"},{"key":"9882_CR9","doi-asserted-by":"publisher","DOI":"10.4324\/9780203519196","volume-title":"Surveys in social research","author":"D De Vaus","year":"2013","unstructured":"De Vaus D, de Vaus D (2013) Surveys in social research. Routledge, Abingdon"},{"key":"9882_CR10","doi-asserted-by":"publisher","DOI":"10.4135\/9781412986328","volume-title":"The survey handbook","author":"A Fink","year":"2003","unstructured":"Fink A (2003) The survey handbook. Sage, Newbury Park"},{"key":"9882_CR11","doi-asserted-by":"crossref","first-page":"38","DOI":"10.4135\/9781849208574.n4","volume-title":"Thematic coding and categorizing. analyzing qualitative data","author":"GR Gibbs","year":"2007","unstructured":"Gibbs GR (2007) Thematic coding and categorizing. analyzing qualitative data. Sage, London, pp 38\u201356"},{"key":"9882_CR12","unstructured":"developer.github (2015) https:\/\/developer.github.com\/v3\/issues\/, accessed on 2015-05-01"},{"key":"9882_CR13","unstructured":"Github (2019a) https:\/\/github.com\/netty\/netty\/issues\/8285, accessed on 2019-06-20"},{"key":"9882_CR14","unstructured":"Github (2019b) https:\/\/github.com\/axios\/axios\/issues\/376, accessed on 2019-06-20"},{"key":"9882_CR15","unstructured":"Github (2019c) https:\/\/github.com\/axios\/axios\/issues\/246, accessed on 2019-06-20"},{"key":"9882_CR16","unstructured":"Github (2019d) https:\/\/github.com\/apache\/dubbo\/issues\/1500, accessed on 2019-06-20"},{"key":"9882_CR17","unstructured":"Github (2019e) https:\/\/github.com\/apache\/dubbo\/issues\/3236, accessed on 2019-06-20"},{"key":"9882_CR18","unstructured":"Github (2019f) https:\/\/github.com\/activeadmin\/activeadmin\/issues\/2623, accessed on 2019-06-20"},{"key":"9882_CR19","unstructured":"Github (2019g) https:\/\/github.com\/activeadmin\/activeadmin\/issues\/3185, accessed on 2019-06-20"},{"key":"9882_CR20","unstructured":"Github (2019h) https:\/\/github.com\/activeadmin\/activeadmin\/issues\/4650, accessed on 2019-06-20"},{"key":"9882_CR21","unstructured":"Github (2019i) https:\/\/github.com\/angular\/angular.js\/issues\/16697, accessed on 2019-06-20"},{"key":"9882_CR22","unstructured":"Github (2019j) https:\/\/github.com\/ageitgey\/face_recognition\/issues\/854, accessed on 2019-06-20"},{"key":"9882_CR23","unstructured":"Github (2019k) https:\/\/github.com\/airbnb\/lottie-android\/issues\/1202, accessed on 2019-06-20"},{"key":"9882_CR24","unstructured":"Github (2019l) https:\/\/github.com\/barryvdh\/laravel-debugbar\/issues\/237, accessed on 2019-06-20"},{"key":"9882_CR25","unstructured":"Github (2019m) https:\/\/github.com\/activeadmin\/activeadmin\/issues\/4250, accessed on 2019-06-20"},{"key":"9882_CR26","unstructured":"Glaser BG, Holton J (2004) Remodeling grounded theory. In: Forum qualitative sozialforschung\/forum: qualitative social research, vol 5"},{"key":"9882_CR27","doi-asserted-by":"crossref","unstructured":"Hooimeijer P, Weimer W (2007) Modeling bug report quality. In: Proceedings of the twenty-second IEEE\/ACM international conference on automated software engineering, ACM, pp 34\u201343","DOI":"10.1145\/1321631.1321639"},{"key":"9882_CR28","unstructured":"Hove SE, Anda B (2005) Experiences from conducting semi-structured interviews in empirical software engineering research. In: 11Th IEEE international software metrics symposium (METRICS\u201905), IEEE, pp 10\u2013pp"},{"issue":"42","key":"9882_CR29","first-page":"1","volume":"17","author":"SA Jacob","year":"2012","unstructured":"Jacob SA, Furgerson SP (2012) Writing interview protocols and conducting interviews: Tips for students new to the field of qualitative research. Qual Rep 17(42):1\u201310","journal-title":"Qual Rep"},{"issue":"2","key":"9882_CR30","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1145\/511152.511155","volume":"27","author":"BA Kitchenham","year":"2002","unstructured":"Kitchenham BA, Pfleeger SL (2002) Principles of survey research: part 3: constructing a survey instrument. ACM SIGSOFT Softw Eng Notes 27 (2):20\u201324","journal-title":"ACM SIGSOFT Softw Eng Notes"},{"key":"9882_CR31","unstructured":"Likert R (1932) A technique for the measurement of attitudes. Archives of psychology"},{"issue":"1","key":"9882_CR32","first-page":"52","volume":"16","author":"A Moghaddam","year":"2006","unstructured":"Moghaddam A (2006) Coding issues in grounded theory. Issues Educ Res 16(1):52\u201366","journal-title":"Issues Educ Res"},{"issue":"1","key":"9882_CR33","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1016\/j.infoandorg.2006.11.001","volume":"17","author":"MD Myers","year":"2007","unstructured":"Myers MD, Newman M (2007) The qualitative interview in is research: examining the craft. Inform Organ 17(1):2\u201326","journal-title":"Inform Organ"},{"key":"9882_CR34","doi-asserted-by":"crossref","unstructured":"Nayrolles M, Hamou-Lhadj A, Tahar S, Larsson A (2015) Jcharming: a bug reproduction approach using crash traces and directed model checking. In: 2015 IEEE 22nd international conference on software analysis, evolution, and reengineering (SANER), IEEE, pp 101\u2013110","DOI":"10.1109\/SANER.2015.7081820"},{"issue":"6","key":"9882_CR35","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1145\/505532.505535","volume":"26","author":"SL Pfleeger","year":"2001","unstructured":"Pfleeger SL, Kitchenham BA (2001) Principles of survey research: part 1: turning lemons into lemonade. ACM SIGSOFT Softw Eng Notes 26(6):16\u201318","journal-title":"ACM SIGSOFT Softw Eng Notes"},{"key":"9882_CR36","doi-asserted-by":"crossref","unstructured":"Schroter A, Schr\u00f6ter A., Bettenburg N, Premraj R (2010) Do stack traces help developers fix bugs?. In: 2010 7th IEEE working conference on mining software repositories (MSR 2010), IEEE, pp 118\u2013121","DOI":"10.1109\/MSR.2010.5463280"},{"key":"9882_CR37","unstructured":"Soltani M, Panichella A, Van Deursen A (2018) Search-based crash reproduction and its impact on debugging. IEEE Trans Softw Eng"},{"key":"9882_CR38","unstructured":"The state of the octoverse (2017) https:\/\/octoverse.github.com\/2017\/, accessed on 2019-05-012019"},{"key":"9882_CR39","unstructured":"The state of the octoverse (2018) Top programming languages of. https:\/\/github.blog\/2018-11-15-state-of-the-octoverse-top-programming-languages\/, accessed on 2019-05-01"},{"key":"9882_CR40","unstructured":"The state of the octoverse (2019) https:\/\/octoverse.github.com\/, accessed on 2019-05-01"},{"issue":"2","key":"9882_CR41","first-page":"101","volume":"25","author":"A Vargha","year":"2000","unstructured":"Vargha A, Delaney HD (2000) A critique and improvement of the CL common language effect size statistics of McGraw and Wong. J Educ Behav Stat 25(2):101\u2013132","journal-title":"J Educ Behav Stat"},{"key":"9882_CR42","doi-asserted-by":"crossref","unstructured":"Weiss C, Premraj R, Zimmermann T, Zeller A (2007) How long will it take to fix this bug?. In: Fourth international workshop on mining software repositories (MSR\u201907: ICSE workshops 2007), IEEE, pp 1\u20131","DOI":"10.1109\/MSR.2007.13"},{"key":"9882_CR43","unstructured":"Zeng H, Rine D (2004) Estimation of software defects fix effort using neural networks. In: Proceedings of the 28th annual international computer software and applications conference, 2004. COMPSAC 2004. IEEE, vol 2, pp 20\u201321"},{"issue":"5","key":"9882_CR44","doi-asserted-by":"publisher","first-page":"618","DOI":"10.1109\/TSE.2010.63","volume":"36","author":"T Zimmermann","year":"2010","unstructured":"Zimmermann T, Premraj R, Bettenburg N, Just S, Schroter A, Weiss C (2010) What makes a good bug report?. IEEE Trans Softw Eng 36(5):618\u2013643","journal-title":"IEEE Trans Softw Eng"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-020-09882-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-020-09882-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-020-09882-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,18]],"date-time":"2022-11-18T06:22:40Z","timestamp":1668752560000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-020-09882-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,14]]},"references-count":44,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,11]]}},"alternative-id":["9882"],"URL":"https:\/\/doi.org\/10.1007\/s10664-020-09882-z","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,14]]},"assertion":[{"value":"14 September 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}