{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T12:21:48Z","timestamp":1767183708292,"version":"3.37.3"},"reference-count":108,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2022,8,10]],"date-time":"2022-08-10T00:00:00Z","timestamp":1660089600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,10]],"date-time":"2022-08-10T00:00:00Z","timestamp":1660089600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"crossref","award":["DE210101091"],"award-info":[{"award-number":["DE210101091"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001782","name":"University of Melbourne","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001782","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2022,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Story Points (SP) are an effort unit that is used to represent the relative effort of a work item. In Agile software development, SP allows a development team to estimate their delivery capacity and facilitate the sprint planning activities. Although Agile embraces changes, SP changes after the sprint planning may negatively impact the sprint plan. To minimize the impact, there is a need to better understand the SP changes and an automated approach to predict the SP changes. Hence, to better understand the SP changes, we examine the prevalence, accuracy, and impact of information changes on SP changes. Through the analyses based on 19,349 work items spread across seven open-source projects, we find that on average, 10% of the work items have SP changes. These work items typically have SP value increased by 58%-100% relative to the initial SP value when they were assigned to a sprint. We also find that the unchanged SP reflect the development time better than the changed SP. Our qualitative analysis shows that the work items with changed SP often have the information changes relating to updating the scope of work. Our empirical results suggest that SP and the scope of work should be reviewed prior or during sprint planning to achieve a reliable sprint plan. Yet, it could be a tedious task to review all work items in the product (or sprint) backlog. Therefore, we develop a classifier to predict whether a work item will have SP changes after being assigned to a sprint. Our classifier achieves an AUC of 0.69-0.8, which is significantly better than the baselines. Our results suggest that to better manage and prepare for the unreliability in SP estimation, the team can leverage our insights and the classifier during the sprint planning. To facilitate future studies, we provide the replication package and the datasets, which are available online.<\/jats:p>","DOI":"10.1007\/s10664-022-10192-9","type":"journal-article","created":{"date-parts":[[2022,8,10]],"date-time":"2022-08-10T08:03:00Z","timestamp":1660118580000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Story points changes in agile iterative development"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4059-757X","authenticated-orcid":false,"given":"Jirat","family":"Pasuksmit","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6328-8839","authenticated-orcid":false,"given":"Patanamon","family":"Thongtanunam","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7080-5064","authenticated-orcid":false,"given":"Shanika","family":"Karunasekera","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,8,10]]},"reference":[{"key":"10192_CR1","unstructured":"Agrawal A, Fu W, Chen D, Shen X, Menzies T (2019) How to \u201cDODGE\u201d Complex Software Analytics. TSE"},{"key":"10192_CR2","doi-asserted-by":"crossref","unstructured":"Alhamed M, Storer T (2021) Playing Planning Poker in Crowds: Human Computation of Software Effort Estimates. In: Proceedings of the ICSE, pp 1\u201312","DOI":"10.1109\/ICSE43902.2021.00014"},{"key":"10192_CR3","doi-asserted-by":"crossref","unstructured":"Basri S, Kama N, Haneem F, Ismail S A (2016) Predicting effort for requirement changes during software development. In: Procedings of the SoICT, pp 380\u2013387","DOI":"10.1145\/3011077.3011096"},{"issue":"10","key":"10192_CR4","first-page":"932","volume":"44","author":"S Bick","year":"2018","unstructured":"Bick S, Spohrer K, Hoda R, Scheerer A, Heinzl A (2018) Coordination Challenges in Large-Scale Software Development: A Case Study of Planning Misalignment in Hybrid Settings. TSE 44(10):932\u2013950","journal-title":"TSE"},{"key":"10192_CR5","first-page":"993","volume":"3","author":"DM Blei","year":"2003","unstructured":"Blei D M, Ng A Y, Jordan M I (2003) Latent Dirichlet Allocation. JMLR 3:993\u20131022","journal-title":"JMLR"},{"key":"10192_CR6","doi-asserted-by":"crossref","unstructured":"Britto R, Mendes E, B\u00f6rstler J (2015) An Empirical Investigation on Effort Estimation in Agile Global Software Development. In: Proceedings of the ICGSE, pp 38\u201345","DOI":"10.1109\/ICGSE.2015.10"},{"issue":"9","key":"10192_CR7","first-page":"934","volume":"52","author":"N Cerpa","year":"2010","unstructured":"Cerpa N, Bardeen M, Kitchenham B, Verner J (2010) Evaluating logistic regression models to estimate software project outcomes. IST 52(9):934\u2013944","journal-title":"IST"},{"key":"10192_CR8","doi-asserted-by":"crossref","unstructured":"Chaparro O, Lu J, Zampetti F, Moreno L, Di Penta M, Marcus A, Bavota G, Ng V (2017) Detecting Missing Information in Bug Descriptions. In: Proceedings of the ESEC\/FSE, pp 396\u2013407","DOI":"10.1145\/3106237.3106285"},{"key":"10192_CR9","doi-asserted-by":"crossref","unstructured":"Charmaz K (2014) Constructing grounded theory","DOI":"10.1002\/9781405165518.wbeosg070.pub2"},{"key":"10192_CR10","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1613\/jair.953","volume":"16","author":"NV Chawla","year":"2002","unstructured":"Chawla N V, Bowyer K W, Hall L O, Kegelmeyer W P (2002) Smote: synthetic minority over-sampling technique. J Artif Intell Res 16:321\u2013357","journal-title":"J Artif Intell Res"},{"issue":"3","key":"10192_CR11","first-page":"1223","volume":"22","author":"M Choetkiertikul","year":"2017","unstructured":"Choetkiertikul M, Dam H K, Tran T, Ghose A (2017) Predicting the delay of issues with due dates in software projects. EMSE 22(3):1223\u20131263","journal-title":"EMSE"},{"issue":"6","key":"10192_CR12","first-page":"551","volume":"44","author":"M Choetkiertikul","year":"2017","unstructured":"Choetkiertikul M, Dam H K, Tran T, Ghose A, Grundy J (2017) Predicting delivery capability in iterative software development. TSE 44 (6):551\u2013573","journal-title":"TSE"},{"issue":"07","key":"10192_CR13","first-page":"637","volume":"45","author":"M Choetkiertikul","year":"2019","unstructured":"Choetkiertikul M, Dam H K, Tran T, Pham T T M, Ghose A, Menzies T (2019) A deep learning model for estimating story points. TSE 45 (07):637\u2013656","journal-title":"TSE"},{"issue":"7","key":"10192_CR14","doi-asserted-by":"publisher","first-page":"7","DOI":"10.5120\/ijais12-450574","volume":"3","author":"E Coelho","year":"2012","unstructured":"Coelho E, Basu A (2012) Effort Estimation in Agile Software Development using Story Points. IJAIS 3(7):7\u201310","journal-title":"IJAIS"},{"key":"10192_CR15","doi-asserted-by":"crossref","unstructured":"Cohen J (2013) Statistical power analysis for the behavioral sciences","DOI":"10.4324\/9780203771587"},{"key":"10192_CR16","unstructured":"Cohn M (2006) Agile estimating and planning"},{"issue":"2","key":"10192_CR17","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1037\/h0076540","volume":"60","author":"M Coleman","year":"1975","unstructured":"Coleman M, Liau T L (1975) A Computer Readability Formula Designed for Machine Scoring. J Appl Psychol 60(2):283\u2013284","journal-title":"J Appl Psychol"},{"issue":"3","key":"10192_CR18","first-page":"506","volume":"18","author":"A Corazza","year":"2013","unstructured":"Corazza A, Di Martino S, Ferrucci F, Gravino C, Sarro F, Mendes E (2013) Using tabu search to configure support vector regression for effort estimation. EMSE 18(3):506\u2013546","journal-title":"EMSE"},{"key":"10192_CR19","doi-asserted-by":"crossref","unstructured":"Dam H K, Tran T, Grundy J, Ghose A, Kamei Y (2019) Towards effective AI-powered agile project management. In: ICSE-NIER, pp 41\u201344","DOI":"10.1109\/ICSE-NIER.2019.00019"},{"key":"10192_CR20","doi-asserted-by":"crossref","unstructured":"Dehghan A, Neal A, Blincoe K, Linaker J, Damian D (2017) Predicting Likelihood of Requirement Implementation within the Planned Iteration: An Empirical Study at IBM. In: Proceedings of the MSR, pp 124\u2013134","DOI":"10.1109\/MSR.2017.53"},{"issue":"382","key":"10192_CR21","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1080\/01621459.1983.10477973","volume":"78","author":"B Efron","year":"1983","unstructured":"Efron B (1983) Estimating the error rate of a prediction rule: improvement on cross-validation. JASA 78(382):316\u2013331","journal-title":"JASA"},{"key":"10192_CR22","doi-asserted-by":"crossref","unstructured":"El Zanaty F, Hirao T, McIntosh S, Ihara A, Matsumoto K (2018) An Empirical Study of Design Discussions in Code Review. In: Proceedings of the ESEM, pp 11:1\u201311:10","DOI":"10.1145\/3239235.3239525"},{"key":"10192_CR23","doi-asserted-by":"crossref","unstructured":"Fan Y, Xia X, Lo D, Hassan A E (2018) Chaff from the Wheat: Characterizing and Determining Valid Bug Reports. TSE, pp 495\u2013525","DOI":"10.1109\/TSE.2018.2864217"},{"key":"10192_CR24","doi-asserted-by":"crossref","unstructured":"Fisher R A (1992) Statistical Methods for Research Workers","DOI":"10.1007\/978-1-4612-4380-9_6"},{"issue":"3","key":"10192_CR25","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1037\/h0057532","volume":"32","author":"R Flesch","year":"1948","unstructured":"Flesch R (1948) A New Readability Yardstick. J Appl Psychol 32 (3):221\u2013233","journal-title":"J Appl Psychol"},{"key":"10192_CR26","doi-asserted-by":"crossref","unstructured":"Fowler F M (2019) Navigating hybrid scrum environments","DOI":"10.1007\/978-1-4842-4164-6"},{"key":"10192_CR27","volume-title":"An r companion to applied regression","author":"J Fox","year":"2019","unstructured":"Fox J, Weisberg S (2019) An r companion to applied regression, Third. Sage, Thousand Oaks CA","edition":"Third"},{"key":"10192_CR28","doi-asserted-by":"crossref","unstructured":"Fu M, Tantithamthavorn C (2022) GPT2SP: A Transformer-Based Agile Story Point Estimation Approach. TSE. To Appear","DOI":"10.1109\/TSE.2022.3158252"},{"key":"10192_CR29","doi-asserted-by":"crossref","unstructured":"Geiger D, Heckerman D (1994) Learning gaussian networks. In: Uncertainty Proceedings, pp 235\u2013243","DOI":"10.1016\/B978-1-55860-332-5.50035-3"},{"key":"10192_CR30","doi-asserted-by":"crossref","unstructured":"Gralha C, Damian D, Wasserman A, Goul\u00e3o M, Ara\u00fajo J (2018) The evolution of requirements practices in software startups. In: Proceedings of the ICSE, pp 823\u2013833","DOI":"10.1145\/3180155.3180158"},{"key":"10192_CR31","unstructured":"Grenning J (2002) Planning Poker or How to avoid analysis paralysis while release planning, Hawthorn Woods: Renaissance Software Consulting. vol 3, pp 22\u201323"},{"key":"10192_CR32","unstructured":"Gunning R (1952) The Technique of Clear Writing"},{"issue":"1","key":"10192_CR33","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","volume":"143","author":"JA Hanley","year":"1982","unstructured":"Hanley J A, McNeil B J (1982) The Meaning and Use of the Area Under a Receiver Operating Characteristic (ROC) Curve. Radiology 143(1):29\u201336","journal-title":"Radiology"},{"key":"10192_CR34","doi-asserted-by":"crossref","unstructured":"Harrell Jr F E (2015) Regression Modeling Strategies: with Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis","DOI":"10.1007\/978-3-319-19425-7"},{"key":"10192_CR35","unstructured":"Harrell Jr. F E (2019) Package \u2018rms\u2019. https:\/\/CRAN.R-project.org\/package=rms, R package version 5.1-4"},{"key":"10192_CR36","doi-asserted-by":"crossref","unstructured":"Haugen N C (2006) An Empirical Study of Using Planning Poker for User Story Estimation. In: AGILE, pp 9\u201334","DOI":"10.1109\/AGILE.2006.16"},{"key":"10192_CR37","first-page":"245","volume":"117","author":"R Hoda","year":"2016","unstructured":"Hoda R, Murugesan L K (2016) Multi-Level Agile Project Management Challenges: A Self-Organizing Team Perspective. JSS 117:245\u2013257","journal-title":"JSS"},{"issue":"1","key":"10192_CR38","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1023\/A:1022631118932","volume":"11","author":"RC Holte","year":"1993","unstructured":"Holte R C (1993) Very Simple Classification Rules Perform Well on Most Commonly Used Datasets. Mach Learn 11(1):63\u201390","journal-title":"Mach Learn"},{"key":"10192_CR39","doi-asserted-by":"crossref","unstructured":"Hothorn T, Hornik K, Van De Wiel M A, Zeileis A (2006) A Lego system for conditional inference. The American Statistician 60(3):257\u201326","DOI":"10.1198\/000313006X118430"},{"key":"10192_CR40","unstructured":"Hothorn T, Zeileis A, Farebrother R W, Cummins C, Millo G, Mitchell D, Zeileis M A (2019) Package \u2018lmtest\u2019. Testing linear regression models. https:\/\/cran.r-project.org\/web\/packages\/lmtest\/lmtest.pdf"},{"key":"10192_CR41","doi-asserted-by":"crossref","unstructured":"Jiarpakdee J, Tantithamthavorn C, Treude C (2018) AutoSpearman: Automatically Mitigating Correlated Software Metrics for Interpreting Defect Models. In: Proceedings of the ICSME, pp 92\u2013103","DOI":"10.1109\/ICSME.2018.00018"},{"issue":"6","key":"10192_CR42","first-page":"490","volume":"26","author":"Jonathan Anderson","year":"1983","unstructured":"Jonathan Anderson (1983) Lix and Rix: Variations on a Little-known Readability Index. J Read 26(6):490\u2013496","journal-title":"J Read"},{"issue":"3","key":"10192_CR43","first-page":"368","volume":"35","author":"M J\u00f8rgensen","year":"2009","unstructured":"J\u00f8rgensen M, Gruschke T M (2009) The impact of lessons-learned sessions on effort estimation and uncertainty assessments. TSE 35(3):368\u2013383","journal-title":"TSE"},{"key":"10192_CR44","doi-asserted-by":"crossref","unstructured":"Kincaid J P, Fishburne Jr R P, Rogers R L, Chissom B S (1975) Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel","DOI":"10.21236\/ADA006655"},{"issue":"3","key":"10192_CR45","first-page":"65","volume":"6","author":"MM Kirmani","year":"2015","unstructured":"Kirmani M M, Wahid A (2015) Revised use case point (re-ucp) model for software effort estimation. Int J Adv Comput Sci Appl 6(3):65\u201371","journal-title":"Int J Adv Comput Sci Appl"},{"issue":"6","key":"10192_CR46","first-page":"1403","volume":"38","author":"E Kocaguneli","year":"2011","unstructured":"Kocaguneli E, Menzies T, Keung J W (2011) On the Value of Ensemble Effort Estimation. TSE 38(6):1403\u20131416","journal-title":"TSE"},{"issue":"260","key":"10192_CR47","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1080\/01621459.1952.10483441","volume":"47","author":"WH Kruskal","year":"1952","unstructured":"Kruskal W H, Wallis W A (1952) Use of ranks in one-criterion variance analysis. JASA 47(260):583\u2013621","journal-title":"JASA"},{"issue":"1","key":"10192_CR48","doi-asserted-by":"publisher","first-page":"23","DOI":"10.5121\/ijsea.2017.8103","volume":"8","author":"S Kuan","year":"2017","unstructured":"Kuan S (2017) Factors on software effort estimation. IJSEA 8 (1):23\u201332","journal-title":"IJSEA"},{"key":"10192_CR49","unstructured":"Liaw A, Wiener M (2018) Package \u2018randomForest\u2019: Breiman and Cutler\u2019s random forests for classification and regression. https:\/\/CRAN.R-project.org\/package=randomForest, R package version 4.6-14"},{"key":"10192_CR50","doi-asserted-by":"publisher","first-page":"545","DOI":"10.11144\/Javeriana.upsy10-2.cdcp","volume":"10","author":"G Macbeth","year":"2011","unstructured":"Macbeth G, Razumiejczyk E, Ledesma R D (2011) Cliff\u2019s Delta Calculator: A Non-parametric Effect Size Program for Two Groups of Observations. Univ Psychol 10:545\u2013555","journal-title":"Univ Psychol"},{"key":"10192_CR51","unstructured":"Madampe K, Hoda R, Grundy J (2020) A Multi-dimensional Study of Requirements Changes in Agile Software Development Projects. arXiv:2012.03423"},{"issue":"6","key":"10192_CR52","first-page":"30","volume":"3","author":"I Manga","year":"2014","unstructured":"Manga I, Blamah NV (2014) A particle Swarm Optimization-based Framework for Agile Software Effort Estimation. Int J Eng Sci 3(6):30\u201336","journal-title":"Int J Eng Sci"},{"issue":"5","key":"10192_CR53","first-page":"1579","volume":"48","author":"Z Masood","year":"2022","unstructured":"Masood Z, Hoda R, Blincoe K (2022) Real World Scrum A Grounded Theory of Variations in Practice. TSE 48(5):1579\u20131591","journal-title":"TSE"},{"issue":"8","key":"10192_CR54","first-page":"639","volume":"12","author":"GH Mc Laughlin","year":"1969","unstructured":"Mc Laughlin G H (1969) SMOG Grading-a New Readability Formula. J Read 12(8):639\u2013646","journal-title":"J Read"},{"key":"10192_CR55","unstructured":"McCallum A, Nigam K (1998) A Comparison of Event Models for Naive Bayes Text Classification. In: Proceedings of the AAAI-98 workshop on learning for text categorization, pp 41\u201348"},{"key":"10192_CR56","unstructured":"McConnell S (2006) Software estimation: demystifying the black art"},{"issue":"3","key":"10192_CR57","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh M L (2012) Interrater reliability: the kappa statistic. Biochem Med 22(3):276\u2013282","journal-title":"Biochem Med"},{"issue":"5","key":"10192_CR58","first-page":"412","volume":"44","author":"S McIntosh","year":"2017","unstructured":"McIntosh S, Kamei Y (2017) Are Fix-Inducing Changes a Moving Target? A Longitudinal Case Study of Just-In-Time Defect Prediction. TSE 44 (5):412\u2013428","journal-title":"TSE"},{"issue":"9","key":"10192_CR59","first-page":"637","volume":"33","author":"T Menzies","year":"2007","unstructured":"Menzies T, Dekhtyar A, Distefano J, Greenwald J (2007) Problems with Precision: A Response to \u201ccomments on data mining static code attributes to learn defect predictors\u201d. TSE 33(9):637\u2013640","journal-title":"TSE"},{"key":"10192_CR60","unstructured":"Meyer D, Dimitriadou E, Hornik K, Weingessel A, Leisch F (2019) e1071: Misc Functions of the Department of Statistics, Probability Theory Group (Formerly: E1071), TU Wien. https:\/\/CRAN.R-project.org\/package=e1071, R package version 1.7-2"},{"issue":"6","key":"10192_CR61","first-page":"1","volume":"40","author":"KM Mullen","year":"2011","unstructured":"Mullen K M, Ardia D, Gil D L, Windover D, Cline J (2011) DEoptim: An R Package for Global Optimization by Differential Evolution. JSS 40 (6):1\u201326","journal-title":"JSS"},{"key":"10192_CR62","doi-asserted-by":"crossref","unstructured":"Pasuksmit J, Thongtanunam P, Karunasekera S (2021) Towards Just-Enough Documentation for Agile Effort Estimation: What Information Should Be Documented?. In: Proceedings of the ICSME, pp 114\u2013125","DOI":"10.26226\/morressier.613b5418842293c031b5b5d8"},{"key":"10192_CR63","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: Machine Learning in Python. J Mach Learn Res 12:2825\u20132830","journal-title":"J Mach Learn Res"},{"key":"10192_CR64","unstructured":"Pinheiro J, Bates D, DebRoy S, Sarkar D, R Core Team (2019) nlme: Linear and nonlinear mixed effects models. https:\/\/CRAN.R-project.org\/package=nlme, R package version 3.1-141"},{"key":"10192_CR65","unstructured":"Popli R, Chauahn N (2015) Managing uncertainty of story-points in agile software. In: Proceedings of the INDIACom, pp 1357\u20131361"},{"key":"10192_CR66","doi-asserted-by":"crossref","unstructured":"Porru S, Murgia A, Demeyer S, Marchesi M, Tonelli R (2016) Estimating Story Points from Issue Reports. In: Proceedings of the PROMISE, pp 2:1\u20132:10","DOI":"10.1145\/2972958.2972959"},{"issue":"1","key":"10192_CR67","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1109\/MS.2018.2875649","volume":"36","author":"R Prikladnicki","year":"2019","unstructured":"Prikladnicki R, Lassenius C, Carver J C (2019) Trends in Agile: From Operational to Strategic Agility. IEEE Softw 36(1):95\u201397","journal-title":"IEEE Softw"},{"key":"10192_CR68","unstructured":"R Core Team (2013) R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. http:\/\/www.R-project.org\/"},{"issue":"3","key":"10192_CR69","first-page":"1101","volume":"13","author":"MA Ramessur","year":"2021","unstructured":"Ramessur M A, Nagowah S D (2021) A predictive model to estimate effort in a sprint using machine learning techniques. IJIT 13(3):1101\u20131110","journal-title":"IJIT"},{"key":"10192_CR70","unstructured":"Rehurek R, Sojka P, et al. (2011) Gensim\u2014statistical semantics in python. Retrieved from genism.org"},{"key":"10192_CR71","unstructured":"Rennie J, Shih L, Teevan J, Karger D (2003) Tackling the Poor Assumptions of Naive Bayes Text Classifiers. In: Proceedings of the ICML, pp 616\u2013623"},{"key":"10192_CR72","doi-asserted-by":"crossref","unstructured":"Ribeiro M T, Singh S, Guestrin C (2016) Why Should I Trust You?: Explaining the Predictions of Any Classifier. In: Proceedings of the SIGKDD, pp 1135\u20131144","DOI":"10.1145\/2939672.2939778"},{"key":"10192_CR73","doi-asserted-by":"crossref","unstructured":"Rigby P C, Storey M A (2011) Understanding Broadcast Based Peer Review on Open Source Software Projects. In: Proceedings of the ICSE, pp 541\u2013550","DOI":"10.1145\/1985793.1985867"},{"issue":"2","key":"10192_CR74","first-page":"973","volume":"24","author":"S Ruangwan","year":"2018","unstructured":"Ruangwan S, Thongtanunam P, Ihara A, Matsumoto K (2018) The impact of human factors on the participation decision of reviewers in modern code review. EMSE 24(2):973\u20131016","journal-title":"EMSE"},{"key":"10192_CR75","unstructured":"Rubin K S (2012) Essential Scrum: A Practical Guide to the Most Popular Agile Process"},{"issue":"3","key":"10192_CR76","doi-asserted-by":"publisher","first-page":"12:1","DOI":"10.1145\/3234940","volume":"27","author":"F Sarro","year":"2018","unstructured":"Sarro F, Petrozziello A (2018) Linear Programming as a Baseline for Software Effort Estimation. TOSEM 27(3):12:1\u201312:28","journal-title":"TOSEM"},{"key":"10192_CR77","doi-asserted-by":"crossref","unstructured":"Sarro F, Petrozziello A, Harman M (2016) Multi-objective Software Effort Estimation. In: Proceedings of the ICSE, pp 619\u2013630","DOI":"10.1145\/2884781.2884830"},{"issue":"2","key":"10192_CR78","doi-asserted-by":"crossref","first-page":"597","DOI":"10.22237\/jmasm\/1257035100","volume":"8","author":"SS Sawilowsky","year":"2009","unstructured":"Sawilowsky S S (2009) New Effect Size Rules of Thumb. JMASM 8(2):597\u2013599","journal-title":"JMASM"},{"key":"10192_CR79","unstructured":"Schwaber K, Sutherland J (2020) The Scrum Guide, The Definitive guide to Scrum: The Rules of the Game"},{"key":"10192_CR80","doi-asserted-by":"crossref","unstructured":"Scott E, Pfahl D (2018) Using Developers\u2019 Features to Estimate Story Points. In: Proceedings of the ICSSP, pp 106\u2013110","DOI":"10.1145\/3202710.3203160"},{"key":"10192_CR81","doi-asserted-by":"crossref","unstructured":"Sedano T, Ralph P, P\u00e9raire C (2019) The Product Backlog. In: Proceedings of the ICSE, pp 200\u2013211","DOI":"10.1109\/ICSE.2019.00036"},{"key":"10192_CR82","unstructured":"Senter R, E.A.Smith (1967) Automated Readability Index. Tech. rep."},{"key":"10192_CR83","doi-asserted-by":"crossref","unstructured":"Shah J, Kama N, Bakar N A A (2018) A Novel Effort Estimation Model For Software Requirement Changes During Software Development Phase. IJSEA, 9,(6)","DOI":"10.5121\/ijsea.2018.9602"},{"key":"10192_CR84","doi-asserted-by":"crossref","unstructured":"Svensson R B, Gorschek T, Bengtsson P-O, Widerberg J (2019) BAM-Backlog Assessment Method. In: Proceedings of the XP, pp 53\u201368, pp 53\u201368","DOI":"10.1007\/978-3-030-19034-7_4"},{"issue":"6","key":"10192_CR85","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1177\/2167696815587648","volume":"3","author":"M Syed","year":"2015","unstructured":"Syed M, Nelson S C (2015) Guidelines for Establishing Reliability When Coding Narrative Data. Emerg Adulthood 3(6):375\u2013387","journal-title":"Emerg Adulthood"},{"key":"10192_CR86","doi-asserted-by":"crossref","unstructured":"Tantithamthavorn C, Hassan A E (2018) An Experience Report on Defect Modelling in Practice: Pitfalls and Challenges. In: Proc. of the ICSE-SEIP, pp 286\u2013295","DOI":"10.1145\/3183519.3183547"},{"issue":"11","key":"10192_CR87","first-page":"1200","volume":"46","author":"C Tantithamthavorn","year":"2018","unstructured":"Tantithamthavorn C, Hassan A E, Matsumoto K (2018) The impact of class rebalancing techniques on the performance and interpretation of defect prediction models. TSE 46(11):1200\u20131219","journal-title":"TSE"},{"issue":"1","key":"10192_CR88","first-page":"1","volume":"43","author":"C Tantithamthavorn","year":"2017","unstructured":"Tantithamthavorn C, McIntosh S, Hassan A E, Matsumoto K (2017) An Empirical Comparison of Model Validation Techniques for Defect Prediction Models. TSE 43(1):1\u201318","journal-title":"TSE"},{"issue":"7","key":"10192_CR89","first-page":"683","volume":"45","author":"C Tantithamthavorn","year":"2019","unstructured":"Tantithamthavorn C, McIntosh S, Hassan A E, Matsumoto K (2019) The Impact of Automated Parameter Optimization on Defect Prediction Models. TSE 45(7):683\u2013711","journal-title":"TSE"},{"key":"10192_CR90","doi-asserted-by":"crossref","unstructured":"Tawosi V, Al-Subaihin A, Sarro F (2022) Investigating the Effectiveness of Clustering for Story Point Estimation. In: Proceedings of the SANER), To Appear","DOI":"10.1109\/SANER53432.2022.00101"},{"key":"10192_CR91","doi-asserted-by":"crossref","unstructured":"Tawosi V, Sarro F, Petrozziello A, Harman M (2021) Multi-Objective Software Effort Estimation: A Replication Study. TSE, To Appear","DOI":"10.1109\/TSE.2021.3083360"},{"key":"10192_CR92","unstructured":"Therneau T, Atkinson B, Ripley B, Ripley M B (2015) Package \u2018rpart\u2019. cran.ma.ic.ac.uk\/web\/packages\/rpart\/rpart.pdf"},{"issue":"11","key":"10192_CR93","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v098.i11","volume":"98","author":"C Thiele","year":"2021","unstructured":"Thiele C, Hirschfeld G (2021) cutpointr: Improved Estimation and Validation of Optimal Cutpoints in R. J Stat Softw 98(11):1\u201327","journal-title":"J Stat Softw"},{"issue":"2","key":"10192_CR94","first-page":"768","volume":"22","author":"P Thongtanunam","year":"2017","unstructured":"Thongtanunam P, McIntosh S, Hassan A E, Iida H (2017) Review Participation in Modern Code Review. EMSE 22(2):768\u2013817","journal-title":"EMSE"},{"key":"10192_CR95","unstructured":"Timofeev R (2004) Classification and regression trees (CART) theory and applications. Vol 54, Humboldt University, Berlin,"},{"key":"10192_CR96","doi-asserted-by":"crossref","unstructured":"Tiwari N M, Upadhyaya G, Rajan H (2016) Candoia: A Platform and Ecosystem for Mining Software Repositories Tools. In: ICSE-C, pp 759\u2013761","DOI":"10.1145\/2889160.2892662"},{"issue":"1","key":"10192_CR97","first-page":"19","volume":"21","author":"M Tomczak","year":"2014","unstructured":"Tomczak M, Tomczak EWA (2014) The need to report effect size estimates revisited. An overview of some recommended measures of effect size. Trends Sport Sci 21(1):19\u201325","journal-title":"Trends Sport Sci"},{"key":"10192_CR98","doi-asserted-by":"publisher","DOI":"10.1201\/b10328","volume-title":"Data Mining with R, learning with case studies","author":"L Torgo","year":"2010","unstructured":"Torgo L (2010) Data Mining with R, learning with case studies. Chapman and Hall\/CRC, London. http:\/\/www.liaad.up.pt\/~ltorgo\/DataMiningWithR"},{"key":"10192_CR99","doi-asserted-by":"crossref","unstructured":"Usman M, Britto R (2016) Effort Estimation in Co-located and Globally Distributed Agile Software Development: A Comparative Study. In: Proceedings of the IWSM-MENSURA, pp 219\u2013224","DOI":"10.1109\/IWSM-Mensura.2016.042"},{"key":"10192_CR100","first-page":"21","volume":"99","author":"M Usman","year":"2018","unstructured":"Usman M, Britto R, Damm L-O, B\u00f6rstler J (2018) Effort estimation in large-scale software development: An industrial case study. IST 99:21\u201340","journal-title":"IST"},{"key":"10192_CR101","first-page":"286","volume":"146","author":"M Usman","year":"2018","unstructured":"Usman M, Petersen K, B\u00f6rstler J, Neto P S (2018) Developing and using checklists to improve software effort estimation: A multi-case study. JSS 146:286\u2013309","journal-title":"JSS"},{"key":"10192_CR102","doi-asserted-by":"crossref","unstructured":"Vargas E L, Hejderup J, Kechagia M, Bruntink M, Gousios G (2018) Enabling Real-Time Feedback in Software Engineering. In: ICSE-NIER, pp 21\u201324","DOI":"10.1145\/3183399.3183416"},{"issue":"4","key":"10192_CR103","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1002\/gepi.20211","volume":"31","author":"DR Velez","year":"2007","unstructured":"Velez D R, White B C, Motsinger A A, Bush W S, Ritchie M D, Williams S M, Moore J H (2007) A balanced accuracy function for epistasis modeling in imbalanced datasets using multifactor dimensionality reduction. Genet Epidemiol 31(4):306\u2013315","journal-title":"Genet Epidemiol"},{"key":"10192_CR104","unstructured":"von Jouanne-Diedrich H (2017) OneR: One Rule Machine Learning Classification Algorithm with Enhancements. https:\/\/CRAN.R-project.org\/package=OneR, R package version 2.2"},{"key":"10192_CR105","doi-asserted-by":"crossref","unstructured":"Wilcoxon F (1992) Individual Comparisons by Ranking Methods. In: Breakthroughs in statistics, pp 196\u2013202","DOI":"10.1007\/978-1-4612-4380-9_16"},{"key":"10192_CR106","unstructured":"Xia T, Shu R, Shen X, Menzies T (2020) Sequential Model Optimization for Software Effort Estimation. TSE. To Appear"},{"key":"10192_CR107","doi-asserted-by":"crossref","unstructured":"Zanetti M S, Scholtes I, Tessone C J, Schweitzer F (2013) Categorizing Bugs with Social Networks: A Case Study on Four Open Source Software Communities. In: Proceedings of the ICSE, pp 1032\u20131041","DOI":"10.1109\/ICSE.2013.6606653"},{"issue":"5","key":"10192_CR108","first-page":"618","volume":"36","author":"T Zimmermann","year":"2010","unstructured":"Zimmermann T, Premraj R, Bettenburg N, Just S, Schroter A, Weiss C (2010) What Makes a Good Bug Report?. TSE 36(5):618\u2013643","journal-title":"TSE"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10192-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-022-10192-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10192-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,25]],"date-time":"2023-11-25T13:14:21Z","timestamp":1700918061000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-022-10192-9"}},"subtitle":["An empirical study and a prediction approach"],"short-title":[],"issued":{"date-parts":[[2022,8,10]]},"references-count":108,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,11]]}},"alternative-id":["10192"],"URL":"https:\/\/doi.org\/10.1007\/s10664-022-10192-9","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"type":"print","value":"1382-3256"},{"type":"electronic","value":"1573-7616"}],"subject":[],"published":{"date-parts":[[2022,8,10]]},"assertion":[{"value":"13 June 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 August 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant conflicts of interests, competing interests, financial interests, or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflicts of interests\/Competing interests"}}],"article-number":"156"}}