{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T00:49:58Z","timestamp":1772498998775,"version":"3.50.1"},"reference-count":76,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,7,16]],"date-time":"2019-07-16T00:00:00Z","timestamp":1563235200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,7,16]],"date-time":"2019-07-16T00:00:00Z","timestamp":1563235200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001602","name":"Science Foundation Ireland","doi-asserted-by":"crossref","award":["13\/RC\/2094"],"award-info":[{"award-number":["13\/RC\/2094"]}],"id":[{"id":"10.13039\/501100001602","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2020,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Feature Location (FL) aims to locate observable functionalities in source code. Considering its key role in software maintenance, a vast array of automated and semi-automated Feature Location Techniques (FLTs) have been proposed. To compare FLTs, an open, standard set of non-subjective, reproducible \u201ccompare-to\u201d FLT techniques (baseline techniques) should be used for evaluation. In order to relate the performance of FLTs compared against different baseline techniques, these compare-to techniques should be evaluated against each other. But evaluation across FLTs is confounded by empirical designs that incorporate different FL goals and evaluation criteria. This paper moves towards standardizing FLT comparability by assessing eight baseline techniques in an empirical design that addresses these confounding factors. These baseline techniques are assessed in twelve case studies to rank their performance. Results of the case studies suggest that different baseline techniques perform differently and that VSM-Lucene and LSI-Matlab performed better than other implementations. By presenting the relative performances of baseline techniques this paper facilitates empirical cross-comparison of existing and future FLTs. Finally, the results suggest that the performance of FLTs partially depends on system\/benchmark characteristics, in addition to the FLTs themselves.<\/jats:p>","DOI":"10.1007\/s10664-019-09734-5","type":"journal-article","created":{"date-parts":[[2019,7,16]],"date-time":"2019-07-16T06:02:51Z","timestamp":1563256971000},"page":"266-321","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["An empirical assessment of baseline feature location techniques"],"prefix":"10.1007","volume":"25","author":[{"given":"Abdul","family":"Razzaq","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Le Gear","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris","family":"Exton","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jim","family":"Buckley","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,7,16]]},"reference":[{"issue":"5","key":"9734_CR1","doi-asserted-by":"publisher","first-page":"725","DOI":"10.1109\/TSE.2012.71","volume":"39","author":"N Ali","year":"2013","unstructured":"Ali N, Gu\u00e9h\u00e9neuc YG, Antoniol G (2013) Trustrace: mining software repositories to improve the accuracy of requirement traceability links. IEEE Trans Softw Eng 39(5):725\u2013741","journal-title":"IEEE Trans Softw Eng"},{"issue":"10","key":"9734_CR2","doi-asserted-by":"publisher","first-page":"970","DOI":"10.1109\/TSE.2002.1041053","volume":"28","author":"G Antoniol","year":"2002","unstructured":"Antoniol G, Canfora G, Casazza G, De Lucia A, Merlo E (2002) Recovering traceability links between code and documentation. IEEE Trans Softw Eng 28(10):970\u2013983","journal-title":"IEEE Trans Softw Eng"},{"issue":"6","key":"9734_CR3","doi-asserted-by":"publisher","first-page":"2972","DOI":"10.1007\/s10664-017-9499-z","volume":"22","author":"WKG Assun\u00e7\u00e3o","year":"2017","unstructured":"Assun\u00e7\u00e3o WKG, Lopez-Herrejon RE, Linsbauer L, Vergilio SR, Egyed A (2017) Reengineering legacy applications into software product lines: a systematic mapping. Empir Softw Eng 22(6):2972\u20133016. https:\/\/doi.org\/10.1007\/s10664-017-9499-z","journal-title":"Empir Softw Eng"},{"key":"9734_CR4","doi-asserted-by":"crossref","unstructured":"Bassett B, Kraft N (2013) Structural information based term weighting in text retrieval for feature location. In: 2013 IEEE 21st international conference on program comprehension (ICPC). IEEE, pp 133\u2013141","DOI":"10.1109\/ICPC.2013.6613841"},{"key":"9734_CR5","doi-asserted-by":"crossref","unstructured":"Beard M, Kraft N, Etzkorn L, Lukins S (2011) Measuring the accuracy of information retrieval based bug localization techniques. In: 2011 18th working conference on reverse engineering (WCRE). IEEE, pp 124\u2013128","DOI":"10.1109\/WCRE.2011.23"},{"issue":"3","key":"9734_CR6","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1007\/s10664-012-9224-x","volume":"19","author":"LR Biggers","year":"2014","unstructured":"Biggers LR, Bocovich C, Capshaw R, Eddy BP, Etzkorn LH, Kraft N (2014) Configuring latent dirichlet allocation based feature location. Empir Softw Eng 19(3):465\u2013500","journal-title":"Empir Softw Eng"},{"key":"9734_CR7","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1016\/j.jss.2014.11.013","volume":"101","author":"D Binkley","year":"2015","unstructured":"Binkley D, Lawrie D, Uehlinger C, Heinz D (2015) Enabling improved ir-based feature location. J Syst Softw 101:30\u201342","journal-title":"J Syst Softw"},{"issue":"6","key":"9734_CR8","doi-asserted-by":"publisher","first-page":"1565","DOI":"10.1007\/s10664-013-9255-y","volume":"19","author":"M Borg","year":"2014","unstructured":"Borg M, Runeson P, Ard\u00f6 A (2014) Recovering from a decade: a systematic mapping of information retrieval approaches to software traceability. Empir Softw Eng 19(6):1565\u20131616","journal-title":"Empir Softw Eng"},{"issue":"6","key":"9734_CR9","doi-asserted-by":"publisher","first-page":"864","DOI":"10.1109\/TSE.2009.42","volume":"35","author":"M Cataldo","year":"2009","unstructured":"Cataldo M, Mockus A, Roberts JA, Herbsleb JD (2009) Software dependencies, work dependencies, and their impact on failures. IEEE Trans Softw Eng 35(6):864\u2013878","journal-title":"IEEE Trans Softw Eng"},{"key":"9734_CR10","doi-asserted-by":"crossref","unstructured":"Chen K, Rajlich V (2000) Case study of feature location using dependence graph. In: 8th international workshop on program comprehension, 2000. Proceedings. IWPC 2000. IEEE, pp 241\u2013247","DOI":"10.1109\/WPC.2000.852498"},{"key":"9734_CR11","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1016\/j.infsof.2017.04.003","volume":"88","author":"M Chochlov","year":"2017","unstructured":"Chochlov M, English M, Buckley J (2017) A historical, textual analysis approach to feature location. Inf Softw Technol 88:110\u2013126","journal-title":"Inf Softw Technol"},{"issue":"1","key":"9734_CR12","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1007\/s10664-008-9095-3","volume":"14","author":"B Cleary","year":"2009","unstructured":"Cleary B, Exton C, Buckley J, English M (2009) An empirical analysis of information retrieval based concept location techniques in software comprehension. Empir Softw Eng 14(1):93\u2013130","journal-title":"Empir Softw Eng"},{"issue":"3","key":"9734_CR13","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1145\/2812803","volume":"59","author":"C Collberg","year":"2016","unstructured":"Collberg C, Proebsting TA (2016) Repeatability in computer systems research. Commun ACM 59(3): 62\u201369","journal-title":"Commun ACM"},{"key":"9734_CR14","doi-asserted-by":"crossref","unstructured":"Corley CS, Damevski K, Kraft N (2015) Exploring the use of deep learning for feature location. In: 2015 IEEE International conference on software maintenance and evolution (ICSME). IEEE, pp 556\u2013560","DOI":"10.1109\/ICSM.2015.7332513"},{"issue":"5","key":"9734_CR15","doi-asserted-by":"publisher","first-page":"684","DOI":"10.1109\/TSE.2009.28","volume":"35","author":"B Cornelissen","year":"2009","unstructured":"Cornelissen B, Zaidman A, Van Deursen A, Moonen L, Koschke R (2009) A systematic survey of program comprehension through dynamic analysis. IEEE Trans Softw Eng 35(5):684\u2013702","journal-title":"IEEE Trans Softw Eng"},{"key":"9734_CR16","doi-asserted-by":"publisher","unstructured":"Couto MV, Valente MT, Figueiredo E (2011) Extracting software product lines: a case study using conditional compilation. In: 2011 15th European conference on software maintenance and reengineering. https:\/\/doi.org\/10.1109\/CSMR.2011.25, pp 191\u2013200","DOI":"10.1109\/CSMR.2011.25"},{"key":"9734_CR17","doi-asserted-by":"crossref","unstructured":"De Lucia A, Di Penta M, Oliveto R, Panichella A, Panichella S (2011) Improving ir-based traceability recovery using smoothing filters. In: 2011 IEEE 19th international conference on program comprehension (ICPC). IEEE, pp 21\u201330","DOI":"10.1109\/ICPC.2011.34"},{"issue":"6","key":"9734_CR18","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1002\/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9","volume":"41","author":"S Deerwester","year":"1990","unstructured":"Deerwester S, Dumais ST, Furnas GW, Landauer TK, Harshman R (1990) Indexing by latent semantic analysis. J Am Soc Inf Sci 41(6):391\u2013407","journal-title":"J Am Soc Inf Sci"},{"key":"9734_CR19","doi-asserted-by":"crossref","unstructured":"Diaz D, Bavota G, Marcus A, Oliveto R, Takahashi S, De Lucia A (2013) Using code ownership to improve ir-based traceability link recovery. In: 2013 IEEE 21st international conference on program comprehension (ICPC). IEEE, pp 123\u2013132","DOI":"10.1109\/ICPC.2013.6613840"},{"key":"9734_CR20","doi-asserted-by":"crossref","unstructured":"Dit B, Guerrouj L, Poshyvanyk D, Antoniol G (2011) Can better identifier splitting techniques help feature location?. In: 2011 19th IEEE international conference on program comprehension. IEEE, pp 11\u201320","DOI":"10.1109\/ICPC.2011.47"},{"key":"9734_CR21","doi-asserted-by":"crossref","unstructured":"Dit B, Holtzhauer A, Poshyvanyk D, Kagdi H (2013) A dataset from change history to support evaluation of software maintenance tasks. In: Proceedings of the 10th working conference on mining software repositories. IEEE Press, pp 131\u2013134","DOI":"10.1109\/MSR.2013.6624019"},{"issue":"5","key":"9734_CR22","doi-asserted-by":"publisher","first-page":"1198","DOI":"10.1007\/s10664-014-9339-3","volume":"20","author":"B Dit","year":"2015","unstructured":"Dit B, Moritz E, Linares-V\u00e1squez M, Poshyvanyk D, Cleland-Huang J (2015) Supporting and accelerating reproducible empirical research in software evolution and maintenance using tracelab component library. Empir Softw Eng 20(5):1198\u20131236","journal-title":"Empir Softw Eng"},{"issue":"1","key":"9734_CR23","first-page":"53","volume":"25","author":"B Dit","year":"2013","unstructured":"Dit B, Revelle M, Gethers M, Poshyvanyk D (2013) Feature location in source code: a taxonomy and survey. Journal of software: Evolution and Process 25 (1):53\u201395","journal-title":"Journal of software: Evolution and Process"},{"issue":"2","key":"9734_CR24","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1007\/s10664-011-9194-4","volume":"18","author":"B Dit","year":"2013","unstructured":"Dit B, Revelle M, Poshyvanyk D (2013) Integrating information retrieval, execution and link analysis algorithms to improve feature location in software. Empir Softw Eng 18(2):277\u2013309","journal-title":"Empir Softw Eng"},{"issue":"4","key":"9734_CR25","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1109\/TSE.2008.36","volume":"34","author":"M Eaddy","year":"2008","unstructured":"Eaddy M, Zimmermann T, Sherwood KD, Garg V, Murphy GC, Nagappan N, Aho AV (2008) Do crosscutting concerns cause defects? IEEE Trans Softw Eng 34(4):497\u2013515","journal-title":"IEEE Trans Softw Eng"},{"key":"9734_CR26","doi-asserted-by":"crossref","unstructured":"Easterbrook S, Singer J, Storey MA, Damian D (2008) Selecting empirical methods for software engineering research. In: Guide to advanced empirical software engineering. Springer, pp 285\u2013311","DOI":"10.1007\/978-1-84800-044-5_11"},{"issue":"3","key":"9734_CR27","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1109\/TSE.2003.1183929","volume":"29","author":"T Eisenbarth","year":"2003","unstructured":"Eisenbarth T, Koschke R, Simon D (2003) Locating features in source code. IEEE Trans Softw Eng 29(3):210\u2013224","journal-title":"IEEE Trans Softw Eng"},{"key":"9734_CR28","doi-asserted-by":"crossref","unstructured":"Gethers M, Oliveto R, Poshyvanyk D, De Lucia A (2011) On integrating orthogonal information retrieval methods to improve traceability recovery. In: 2011 27th IEEE international conference on software maintenance (ICSM). IEEE, pp 133\u2013142","DOI":"10.1109\/ICSM.2011.6080780"},{"issue":"12","key":"9734_CR29","first-page":"1280","volume":"26","author":"P Heck","year":"2014","unstructured":"Heck P, Zaidman A (2014) Horizontal traceability for just-in-time requirements: the case for open source feature requests. Journal of Software: Evolution and Process 26(12):1280\u20131296","journal-title":"Journal of Software: Evolution and Process"},{"key":"9734_CR30","doi-asserted-by":"crossref","unstructured":"Hill E, Shepherd D, Pollock L (2015) Exploring the use of concern element role information in feature location evaluation. In: Proceedings of the 2015 IEEE 23rd international conference on program comprehension. IEEE Press, pp 140\u2013150","DOI":"10.1109\/ICPC.2015.23"},{"key":"9734_CR31","doi-asserted-by":"crossref","unstructured":"Juristo N, G\u00f3mez OS (2012) Replication of software engineering experiments. In: Empirical software engineering and verification. Springer, pp 60\u201388","DOI":"10.1007\/978-3-642-25231-0_2"},{"key":"9734_CR32","doi-asserted-by":"crossref","unstructured":"Just R, Jalali D, Ernst MD (2014) Defects4j: a database of existing faults to enable controlled testing studies for java programs. In: Proceedings of the 2014 international symposium on software testing and analysis. ACM, pp 437\u2013440","DOI":"10.1145\/2610384.2628055"},{"issue":"5","key":"9734_CR33","doi-asserted-by":"publisher","first-page":"933","DOI":"10.1007\/s10664-012-9233-9","volume":"18","author":"H Kagdi","year":"2013","unstructured":"Kagdi H, Gethers M, Poshyvanyk D (2013) Integrating conceptual and logical couplings for change impact analysis in software. Empir Softw Eng 18(5):933\u2013969","journal-title":"Empir Softw Eng"},{"issue":"11-12","key":"9734_CR34","doi-asserted-by":"publisher","first-page":"1073","DOI":"10.1016\/j.infsof.2007.02.015","volume":"49","author":"VB Kampenes","year":"2007","unstructured":"Kampenes VB, Dyb\u00e5 T, Hannay JE, Sj\u00f8berg DI (2007) A systematic review of effect size in software engineering experiments. Inf Softw Technol 49(11-12):1073\u20131086","journal-title":"Inf Softw Technol"},{"issue":"1","key":"9734_CR35","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1109\/TSE.2013.45","volume":"40","author":"C K\u00e4stner","year":"2014","unstructured":"K\u00e4stner C, Dreiling A, Ostermann K (2014) Variability mining: consistent semi-automatic detection of product-line features. IEEE Trans Softw Eng 40(1):67\u201382","journal-title":"IEEE Trans Softw Eng"},{"issue":"11","key":"9734_CR36","doi-asserted-by":"publisher","first-page":"1597","DOI":"10.1109\/TSE.2013.24","volume":"39","author":"D Kim","year":"2013","unstructured":"Kim D, Tao Y, Kim S, Zeller A (2013) Where should we fix this bug? a two-phase recommendation model. IEEE Trans Softw Eng 39(11):1597\u20131610","journal-title":"IEEE Trans Softw Eng"},{"issue":"8","key":"9734_CR37","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1002\/stvr.1475","volume":"23","author":"B Li","year":"2013","unstructured":"Li B, Sun X, Leung H, Zhang S (2013) A survey of code-based change impact analysis techniques. Software Testing, Verification and Reliability 23(8):613\u2013646. https:\/\/doi.org\/10.1002\/stvr.1475. https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1002\/stvr.1475","journal-title":"Software Testing, Verification and Reliability"},{"key":"9734_CR38","doi-asserted-by":"crossref","unstructured":"Liu D, Marcus A, Poshyvanyk D, Rajlich V (2007) Feature location via information retrieval based filtering of a single scenario execution trace. In: Proceedings of the twenty-second IEEE\/ACM international conference on Automated software engineering. ACM, pp 234\u2013243","DOI":"10.1145\/1321631.1321667"},{"key":"9734_CR39","doi-asserted-by":"crossref","unstructured":"Lukins SK, Kraft N, Etzkorn LH (2008) Source code retrieval for bug localization using latent dirichlet allocation. In: 2008 15th working conference on reverse engineering. IEEE, pp 155\u2013164","DOI":"10.1109\/WCRE.2008.33"},{"issue":"9","key":"9734_CR40","doi-asserted-by":"publisher","first-page":"972","DOI":"10.1016\/j.infsof.2010.04.002","volume":"52","author":"SK Lukins","year":"2010","unstructured":"Lukins SK, Kraft N, Etzkorn LH (2010) Bug localization using latent dirichlet allocation. Inf Softw Technol 52(9):972\u2013990","journal-title":"Inf Softw Technol"},{"issue":"1","key":"9734_CR41","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1145\/2824251","volume":"25","author":"A Mahmoud","year":"2015","unstructured":"Mahmoud A, Bradshaw G (2015) Estimating semantic relatedness in source code. ACM Trans Softw Eng Methodol (TOSEM) 25(1):10","journal-title":"ACM Trans Softw Eng Methodol (TOSEM)"},{"issue":"3","key":"9734_CR42","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1007\/s00766-013-0199-y","volume":"20","author":"A Mahmoud","year":"2015","unstructured":"Mahmoud A, Niu N (2015) On the role of semantics in automated requirements tracing. Requir Eng 20(3):281\u2013300","journal-title":"Requir Eng"},{"key":"9734_CR43","doi-asserted-by":"crossref","unstructured":"Marcus A, Maletic JI (2003) Recovering documentation-to-source-code traceability links using latent semantic indexing. In: Proceedings of the 25th international conference on software engineering. IEEE Computer Society, pp 125\u2013135","DOI":"10.1109\/ICSE.2003.1201194"},{"key":"9734_CR44","doi-asserted-by":"crossref","unstructured":"Marcus A, Sergeyev A, Rajlich V, Maletic JI (2004) An information retrieval approach to concept location in source code. In: 11th working conference on reverse engineering, 2004. Proceedings. IEEE, pp 214\u2013223","DOI":"10.1109\/WCRE.2004.10"},{"key":"9734_CR45","doi-asserted-by":"crossref","unstructured":"Martinez J, Ordo\u00f1ez N, T\u00ebrnava X, Ziadi T, Aponte J, Figueiredo E, Valente MT (2018) Feature location benchmark with ArgoUML SPL. In: Systems and software product line conference (SPLC). Gothenburg, Sweden. https:\/\/hal.sorbonne-universite.fr\/hal-01722316","DOI":"10.1145\/3233027.3236402"},{"issue":"1","key":"9734_CR46","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1145\/3078841","volume":"26","author":"C Mills","year":"2017","unstructured":"Mills C, Bavota G, Haiduc S, Oliveto R, Marcus A, Lucia AD (2017) Predicting query quality for applications of text retrieval to software engineering tasks. ACM Trans Softw Eng Methodol (TOSEM) 26(1):3","journal-title":"ACM Trans Softw Eng Methodol (TOSEM)"},{"key":"9734_CR47","doi-asserted-by":"crossref","unstructured":"Moreno L, Bavota G, Haiduc S, Di Penta M, Oliveto R, Russo B, Marcus A (2015) Query-based configuration of text retrieval solutions for software engineering tasks. In: Proceedings of the 2015 10th joint meeting on foundations of software engineering. ACM, pp 567\u2013578","DOI":"10.1145\/2786805.2786859"},{"key":"9734_CR48","doi-asserted-by":"crossref","unstructured":"Panichella A, Dit B, Oliveto R, Di Penta M, Poshyvanyk D, De Lucia A (2013) How to effectively use topic models for software engineering tasks? an approach based on genetic algorithms. In: Proceedings of the 2013 international conference on software engineering. IEEE Press, pp 522\u2013531","DOI":"10.1109\/ICSE.2013.6606598"},{"key":"9734_CR49","doi-asserted-by":"crossref","unstructured":"Panichella A, Dit B, Oliveto R, Di Penta M, Poshyvanyk D, De Lucia A (2016) Parameterizing and assembling ir-based solutions for se tasks using genetic algorithms. In: 2016 IEEE 23rd international conference on software analysis, evolution, and reengineering (SANER), vol 1. IEEE, pp 314\u2013325","DOI":"10.1109\/SANER.2016.97"},{"issue":"3","key":"9734_CR50","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1108\/eb046814","volume":"14","author":"MF Porter","year":"1980","unstructured":"Porter MF (1980) An algorithm for suffix stripping. Program 14(3):130\u2013137","journal-title":"Program"},{"issue":"4","key":"9734_CR51","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1145\/2377656.2377660","volume":"21","author":"D Poshyvanyk","year":"2012","unstructured":"Poshyvanyk D, Gethers M, Marcus A (2012) Concept location using formal concept analysis and information retrieval. ACM Trans Softw Eng Methodol (TOSEM) 21(4):23","journal-title":"ACM Trans Softw Eng Methodol (TOSEM)"},{"issue":"6","key":"9734_CR52","doi-asserted-by":"publisher","first-page":"420","DOI":"10.1109\/TSE.2007.1016","volume":"33","author":"D Poshyvanyk","year":"2007","unstructured":"Poshyvanyk D, Gueheneuc YG, Marcus A, Antoniol G, Rajlich V (2007) Feature location using probabilistic ranking of methods based on execution scenarios and information retrieval. IEEE Trans Softw Eng 33(6):420\u2013432","journal-title":"IEEE Trans Softw Eng"},{"key":"9734_CR53","doi-asserted-by":"crossref","unstructured":"Poshyvanyk D, Marcus A, Rajlich V, Gueheneuc YG, Antoniol G (2006) Combining probabilistic ranking and latent semantic indexing for feature identification. In: 14th IEEE international conference on program comprehension, 2006. ICPC 2006. IEEE, pp 137\u2013148","DOI":"10.1109\/ICPC.2006.17"},{"key":"9734_CR54","doi-asserted-by":"crossref","unstructured":"Rao S, Kak A (2011) Retrieval from software libraries for bug localization: a comparative study of generic and composite text models. In: Proceedings of the 8th working conference on mining software repositories. ACM, pp 43\u201352","DOI":"10.1145\/1985441.1985451"},{"issue":"1","key":"9734_CR55","first-page":"2","volume":"28","author":"A Razzaq","year":"2018","unstructured":"Razzaq A, Wasala A, Exton C, Buckley J (2018) The state of empirical evaluation in static feature location. ACM Trans Softw Eng Methodol (TOSEM) 28 (1):2","journal-title":"ACM Trans Softw Eng Methodol (TOSEM)"},{"issue":"6","key":"9734_CR56","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1007\/s10664-011-9159-7","volume":"16","author":"M Revelle","year":"2011","unstructured":"Revelle M, Gethers M, Poshyvanyk D (2011) Using structural and textual information to capture feature coupling in object-oriented software. Empir Softw Eng 16(6):773\u2013811","journal-title":"Empir Softw Eng"},{"issue":"4","key":"9734_CR57","doi-asserted-by":"publisher","first-page":"18:1","DOI":"10.1145\/13487689.13487691","volume":"17","author":"MP Robillard","year":"2008","unstructured":"Robillard MP (2008) Topology analysis of software dependencies. ACM Trans Softw Eng Methodol 17(4):18:1\u201318:36. https:\/\/doi.org\/10.1145\/13487689.13487691","journal-title":"ACM Trans Softw Eng Methodol"},{"key":"9734_CR58","unstructured":"Romano J, Kromrey JD, Coraggio J, Skowronek J (2006) Appropriate statistics for ordinal level data: should we really be using t-test and cohen\u2019sd for evaluating group differences on the nsse and other surveys. In: Annual meeting of the florida association of institutional research, pp 1\u201333"},{"issue":"4","key":"9734_CR59","doi-asserted-by":"publisher","first-page":"516","DOI":"10.1109\/TSE.2008.32","volume":"34","author":"P Roveg\u00e5rd","year":"2008","unstructured":"Roveg\u00e5rd P, Angelis L, Wohlin C (2008) An empirical study on views of importance of change impact analysis issues. IEEE Trans Softw Eng 34(4):516\u2013530","journal-title":"IEEE Trans Softw Eng"},{"key":"9734_CR60","doi-asserted-by":"crossref","unstructured":"Rubin J, Chechik M (2013) A survey of feature location techniques. In: Domain engineering. Springer, pp 29\u201358","DOI":"10.1007\/978-3-642-36654-3_2"},{"key":"9734_CR61","doi-asserted-by":"crossref","unstructured":"Saha RK, Lease M, Khurshid S, Perry DE (2013) Improving bug localization using structured information retrieval. In: 2013 IEEE\/ACM 28th international conference on automated software engineering (ASE). IEEE, pp 345\u2013355","DOI":"10.1109\/ASE.2013.6693093"},{"issue":"11","key":"9734_CR62","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1145\/361219.361220","volume":"18","author":"G Salton","year":"1975","unstructured":"Salton G, Wong A, Yang CS (1975) A vector space model for automatic indexing. Commun ACM 18(11):613\u2013620","journal-title":"Commun ACM"},{"issue":"6","key":"9734_CR63","doi-asserted-by":"publisher","first-page":"1666","DOI":"10.1007\/s10664-014-9327-7","volume":"20","author":"G Scanniello","year":"2015","unstructured":"Scanniello G, Marcus A, Pascale D (2015) Link analysis algorithms for static concept location: an empirical assessment. Empir Softw Eng 20(6):1666\u20131720","journal-title":"Empir Softw Eng"},{"key":"9734_CR64","unstructured":"Shin Y, Hayes JH, Cleland-Huang J (2012) A framework for evaluating traceability benchmark metrics"},{"issue":"2","key":"9734_CR65","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s10664-008-9060-1","volume":"13","author":"FJ Shull","year":"2008","unstructured":"Shull FJ, Carver JC, Vegas S, Juristo N (2008) The role of replications in empirical software engineering. Empir Softw Eng 13(2):211\u2013218","journal-title":"Empir Softw Eng"},{"key":"9734_CR66","doi-asserted-by":"crossref","unstructured":"Starke J, Luce C, Sillito J (2009) Searching and skimming: an exploratory study. In: IEEE international conference on software maintenance, 2009. ICSM 2009. IEEE, pp 157\u2013166","DOI":"10.1109\/ICSM.2009.5306335"},{"issue":"10","key":"9734_CR67","doi-asserted-by":"publisher","first-page":"1427","DOI":"10.1109\/TSE.2013.27","volume":"39","author":"SW Thomas","year":"2013","unstructured":"Thomas SW, Nagappan M, Blostein D, Hassan AE (2013) The impact of classifier configuration and classifier combination on bug localization. IEEE Trans Softw Eng 39(10):1427\u20131443","journal-title":"IEEE Trans Softw Eng"},{"key":"9734_CR68","doi-asserted-by":"publisher","unstructured":"T\u00f3th G, Hegedu\u030bs P, Besz\u00e9des A, Gyim\u00f3thy T, J\u00e1sz J (2010) Comparison of different impact analysis methods and programmer\u2019s opinion: an empirical study. In: Proceedings of the 8th international conference on the principles and practice of programming in Java, PPPJ \u201910. https:\/\/doi.org\/10.1145\/1852761.1852777. ACM, New York, pp 109\u2013118","DOI":"10.1145\/1852761.1852777"},{"key":"9734_CR69","doi-asserted-by":"crossref","unstructured":"Wang S, Lo D (2014) Version history, similar report, and structure: putting them together for improved bug localization. In: Proceedings of the 22nd international conference on program comprehension. ACM, pp 53\u201363","DOI":"10.1145\/2597008.2597148"},{"key":"9734_CR70","doi-asserted-by":"crossref","unstructured":"Wang S, Lo D, Lawall J (2014) Compositional vector space models for improved bug localization. In: 2014 IEEE international conference on software maintenance and evolution (ICSME). IEEE , pp 171\u2013180","DOI":"10.1109\/ICSME.2014.39"},{"key":"9734_CR71","doi-asserted-by":"crossref","unstructured":"Wang S, Lo D, Xing Z, Jiang L (2011) Concern localization using information retrieval: an empirical study on linux kernel. In: 2011 18th working conference on reverse engineering (WCRE). IEEE, pp 92\u201396","DOI":"10.1109\/WCRE.2011.72"},{"key":"9734_CR72","doi-asserted-by":"crossref","unstructured":"Wilde N, Buckellew M, Page H, Rajlich V (2001) A case study of feature location in unstructured legacy fortran code. In: 2001 fifth European conference on software maintenance and reengineering. IEEE, pp 68\u201376","DOI":"10.1109\/CSMR.2001.914970"},{"key":"9734_CR73","doi-asserted-by":"crossref","unstructured":"Wohlin C, Runeson P, H\u00f6st M, Ohlsson MC, Regnell B, Wessl\u00e9n A (2012) Experimentation in software engineering. Springer Science & Business Media","DOI":"10.1007\/978-3-642-29044-2"},{"issue":"4","key":"9734_CR74","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1109\/TSE.2015.2479232","volume":"42","author":"X Ye","year":"2016","unstructured":"Ye X, Bunescu R, Liu C (2016) Mapping bug reports to relevant files: a ranking model, a fine-grained benchmark, and feature evaluation. IEEE Trans Softw Eng 42 (4):379\u2013402","journal-title":"IEEE Trans Softw Eng"},{"issue":"8","key":"9734_CR75","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1016\/j.infsof.2014.03.007","volume":"56","author":"S Zamani","year":"2014","unstructured":"Zamani S, Lee SP, Shokripour R, Anvik J (2014) A noun-based approach to feature location using time-aware term-weighting. Inf Softw Technol 56(8):991\u20131011","journal-title":"Inf Softw Technol"},{"key":"9734_CR76","doi-asserted-by":"crossref","unstructured":"Zhou J, Zhang H, Lo D (2012) Where should the bugs be fixed? more accurate information retrieval-based bug localization based on bug reports. In: 2012 34th international conference on software engineering (ICSE). IEEE, pp 14\u201324","DOI":"10.1109\/ICSE.2012.6227210"}],"updated-by":[{"DOI":"10.1007\/s10664-020-09924-6","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2021,3,31]],"date-time":"2021-03-31T00:00:00Z","timestamp":1617148800000}}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-019-09734-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10664-019-09734-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-019-09734-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,31]],"date-time":"2021-03-31T17:17:29Z","timestamp":1617211049000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10664-019-09734-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,16]]},"references-count":76,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,1]]}},"alternative-id":["9734"],"URL":"https:\/\/doi.org\/10.1007\/s10664-019-09734-5","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s10664-020-09924-6","asserted-by":"object"}]},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,16]]},"assertion":[{"value":"16 July 2019","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 March 2021","order":2,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":3,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":4,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s10664-020-09924-6","URL":"https:\/\/doi.org\/10.1007\/s10664-020-09924-6","order":5,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}}]}}