{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:43:45Z","timestamp":1760240625287,"version":"build-2065373602"},"reference-count":75,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T00:00:00Z","timestamp":1565308800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>The paper is basically dedicated to the problem of effort estimation for the Product Backlog items of IT projects led accordingly to the Scrum framework. The effort estimation issue is important, because low quality estimation decreases the efficiency of project implementation. The paper proposes an estimation method for the Product Backlog items of Scrum-based IT projects (which can be adapted also to other projects), which has two original elements with respect to the state of art in Scrum estimation: the usage of fuzzy numbers and strict rules for consensus forming, combined with a space for human interaction. The assumptions of the method should be complied with and were formulated on the basis of literature and authors experience. Two case studies were used for an initial method validation. The case studies confirmed a high potential of the method to increase estimation quality in Scrum-based projects, as well as in other project types. The case studies were conducted using research methods fulfilling the symmetry principle. The paper is thus an example of symmetry in management research.<\/jats:p>","DOI":"10.3390\/sym11081032","type":"journal-article","created":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T11:11:31Z","timestamp":1565349091000},"page":"1032","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Application of Fuzzy Sets to the Expert Estimation of Scrum-Based Projects"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5858-629X","authenticated-orcid":false,"given":"Pawe\u0142","family":"Rola","sequence":"first","affiliation":[{"name":"Faculty of Computer Science and Management, Wroc\u0142aw University of Science and Technology, ul. Ignacego \u0141ukasiewicza 5, 50371 Wroc\u0142aw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9747-0759","authenticated-orcid":false,"given":"Dorota","family":"Kuchta","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science and Management, Wroc\u0142aw University of Science and Technology, ul. Ignacego \u0141ukasiewicza 5, 50371 Wroc\u0142aw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dings\u00f8yr, T., Hanssen, G.K., Dyb\u00e5, T., Anker, G., and Nygaard, J.O. (2006, January 11\u201313). Developing software with scrum in a small cross-organizational project. Proceedings of the 13th European Conference (EuroSPI 2006), Joensuu, Finland.","DOI":"10.1007\/11908562_2"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1057\/palgrave.ejis.3000605","article-title":"Customising agile methods to software practices at Intel Shannon","volume":"15","author":"Fitzgerald","year":"2006","journal-title":"Eur. J. Inf. Syst."},{"key":"ref_3","unstructured":"Scrum Alliance (2018). State of Scrum, Scrum Alliance."},{"key":"ref_4","first-page":"53","article-title":"The impact of agile principles on market-driven software product development","volume":"22","author":"Gorschek","year":"2010","journal-title":"J. Softw. Maint. Evol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.infsof.2017.06.002","article-title":"Research patterns and trends in software effort estimation","volume":"91","author":"Sehra","year":"2017","journal-title":"Inf. Softw. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.datak.2012.06.005","article-title":"Approximation of COSMIC functional size to support early effort estimation in Agile","volume":"85","author":"Hussain","year":"2013","journal-title":"Data Knowl. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.jss.2016.12.007","article-title":"A study of value in agile software development organizations","volume":"125","author":"Alahyari","year":"2017","journal-title":"J. Syst. Softw."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/S0164-1212(02)00156-5","article-title":"A review of studies on expert estimation of software development effort","volume":"70","year":"2004","journal-title":"J. Syst. Softw."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/S0169-2070(85)80068-6","article-title":"An examination of the accuracy of judgmental extrapolation of time series","volume":"1","author":"Lawrence","year":"1985","journal-title":"Int. J. Forecast."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/0169-2070(95)00644-3","article-title":"Judgemental and statistical time series forecasting: A review of the literature","volume":"12","author":"Webby","year":"1996","journal-title":"Int. J. Forecast."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"975","DOI":"10.1016\/S2212-5671(12)00260-2","article-title":"Risk and Uncertainty","volume":"3","author":"Toma","year":"2012","journal-title":"Procedia Econ. Financ."},{"key":"ref_12","unstructured":"Dubois, D., and Yager, H.P.R. (1993). Representation theorems for fuzzy concepts. Readings in Fuzzy Sets for Intelligent Systems, Morgan Kaufmann."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/0165-0114(91)90045-R","article-title":"Measurement of membership functions and their acquisition","volume":"40","author":"Turksen","year":"1991","journal-title":"Fuzzy Sets Syst."},{"key":"ref_14","unstructured":"T\u00fcrk\u015fen, I.B. (2006). An Ontological and Epistemological Perspective of Fuzzy Set Theory, Elsevier."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2106","DOI":"10.1016\/j.jss.2008.03.058","article-title":"Using planning poker for combining expert estimates in software projects","volume":"81","author":"Haugen","year":"2008","journal-title":"J. Syst. Softw."},{"key":"ref_16","first-page":"270","article-title":"A Fuzzy based model for effort estimation in scrum projects","volume":"8","author":"Alostad","year":"2017","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4178","DOI":"10.1016\/S1474-6670(17)58336-6","article-title":"Fuzzy Logic Based Estimators and Predictors for Agile Target Tracking Applications","volume":"29","author":"Moore","year":"1996","journal-title":"IFAC Proc. Vol."},{"key":"ref_18","first-page":"37","article-title":"Towards a Fuzzy based Framework for Effort Estimation in Agile Software Development","volume":"13","author":"Raslan","year":"2015","journal-title":"Int. J. Comput. Sci. Inf. Secur."},{"key":"ref_19","first-page":"17","article-title":"A Proposed Fuzzy based Framework for Calculating Success Metrics of Agile Software Projects","volume":"137","author":"Mohammed","year":"2016","journal-title":"Int. J. Comput. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/j.ijpe.2005.01.011","article-title":"Agility evaluation using fuzzy logic","volume":"101","author":"Lin","year":"2006","journal-title":"Int. J. Prod. Econ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1016\/S0377-2217(98)00040-X","article-title":"Interactive group decision making procedure under incomplete information","volume":"116","author":"Kim","year":"1999","journal-title":"Eur. J. Oper. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1080\/01969720302866","article-title":"A new method for handling multicriteria fuzzy decision-making problems using FN-IOWA operators","volume":"34","author":"Chen","year":"2003","journal-title":"Cybern. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1016\/j.matcom.2007.11.015","article-title":"Evaluation of software development projects using a fuzzy multi-criteria decision approach","volume":"77","author":"Ruan","year":"2008","journal-title":"Math. Comput. Simul."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.jcss.2013.07.007","article-title":"A possibility degree method for interval-valued intuitionistic fuzzy multi-attribute group decision making","volume":"80","author":"Wan","year":"2014","journal-title":"J. Comput. Syst. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1016\/j.ijforecast.2015.11.014","article-title":"An investigation of dependence in expert judgement studies with multiple experts","volume":"33","author":"Wilson","year":"2017","journal-title":"Int. J. Forecast."},{"key":"ref_26","first-page":"26","article-title":"Optimization of the process of scientific and technical expertise projects in nanobiomedical technologies","volume":"1","author":"Tikhomirova","year":"2012","journal-title":"Nanotechnics"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Rosen, J. (2008). The Concept of Symmetry. Symmetry Rules. The Frontiers Collection, Springer.","DOI":"10.1007\/978-3-540-75973-7"},{"key":"ref_28","unstructured":"Schwaber, K., and Sutherland, J. (2019, June 01). The Scrum Guide The Definitive Guide to Scrum: The Rules of the Game. Available online: http:\/\/www.scrum.org."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1007\/978-0-306-47630-3_7","article-title":"Expert Opinions in Forecasting: The Role of the Delphi Technique","volume":"30","author":"Rowe","year":"2001","journal-title":"Princ. Forecast."},{"key":"ref_30","unstructured":"Grenning, J. (2019, May 10). Planning Poker or How to Avoid Analysis Paralysis while Release Planning. Available online: https:\/\/renaissancesoftware.net\/files\/articles\/PlanningPoker-v1.1.pdf."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tamrakar, R., and J\u00f8rgensen, M. (2012, January 14\u201315). Does the use of Fibonacci numbers in planning poker affect effort estimates?. Proceedings of the 16th International Conference on Evaluation & Assessment in Software Engineering (EASE 2012), Ciudad Real, Spain.","DOI":"10.1049\/ic.2012.0030"},{"key":"ref_32","unstructured":"Cohn, M. (2005). Agile Estimating and Planning, Prentice Hall PTR."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1016\/j.infsof.2012.10.002","article-title":"Successful extreme programming: Fidelity to the methodology or good teamworking?","volume":"55","author":"Wood","year":"2013","journal-title":"Inf. Softw. Technol."},{"key":"ref_34","unstructured":"Shore, J., and Warden, S. (2007). The Art of Agile Development Pragmatic Guide to Agile Software Development, O\u2019Reilly Media. [1st ed.]."},{"key":"ref_35","unstructured":"Cockburn, A. (2004). Crystal Clear a Human-Powered Methodology for Small Teams, Addison-Wesley Professional. [1st ed.]."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1287\/mnsc.9.3.458","article-title":"An Experimental Application of the DELPHI Method to the Use of Experts","volume":"9","author":"Dalkey","year":"1963","journal-title":"Manag. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TSE.1984.5010193","article-title":"Software Engineering Economics","volume":"10","author":"Boehm","year":"1984","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1016\/j.cie.2016.05.038","article-title":"A new integrated intuitionistic fuzzy group decision making approach for product development partner selection","volume":"102","year":"2016","journal-title":"Comput. Ind. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.jpubeco.2016.11.016","article-title":"Voting as a lottery","volume":"146","author":"Attanasi","year":"2017","journal-title":"J. Public Econ."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"706","DOI":"10.1016\/j.asoc.2017.07.025","article-title":"Ranking of fuzzy numbers by using value and angle in the epsilon-deviation degree method","volume":"60","author":"Chutia","year":"2017","journal-title":"Appl. Soft Comput. J."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/0165-4896(85)90043-5","article-title":"The Condorcet criterion and committee selection","volume":"10","author":"Gehrlein","year":"1985","journal-title":"Math. Soc. Sci."},{"key":"ref_42","unstructured":"Arrow, K. (1951). Social Choice and Individual Values, John Wiley & Sons."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/S0019-9958(65)90241-X","article-title":"Fuzzy sets","volume":"8","author":"Zadeh","year":"1965","journal-title":"Inf. Control"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/S0019-9958(72)90199-4","article-title":"A definition of a nonprobabilistic entropy in the setting of fuzzy sets theory","volume":"20","author":"Termini","year":"1972","journal-title":"Inf. Control"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Dubois, D., Prade, H., and Zadeh, L.A. (2000). Fundamentals of Fuzzy Sets, Springer.","DOI":"10.1007\/978-1-4615-4429-6"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1638","DOI":"10.1016\/j.apm.2013.09.012","article-title":"Comparing and ranking fuzzy numbers using ideal solutions","volume":"38","author":"Deng","year":"2014","journal-title":"Appl. Math. Model."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1016\/j.asoc.2018.03.050","article-title":"Ranking generalized fuzzy numbers based on centroid and rank index","volume":"68","author":"Chi","year":"2018","journal-title":"Appl. Soft Comput. J."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/0888-613X(87)90015-6","article-title":"Measures of similarity among fuzzy concepts: A comparative analysis","volume":"1","author":"Zwick","year":"1987","journal-title":"Int. J. Approx. Reason."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/0165-0114(78)90017-9","article-title":"A fuzzy relation space for group decision theory","volume":"1","author":"Bezdek","year":"1978","journal-title":"Fuzzy Sets Syst."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1016\/0377-2217(88)90152-X","article-title":"A \u2018soft\u2019 measure of consensus in the setting of partial (fuzzy) preferences","volume":"34","author":"Kacprzyk","year":"1988","journal-title":"Eur. J. Oper. Res."},{"key":"ref_51","unstructured":"Butler, C.T.L., and Rothstein, A. (2007). On Conflict and Consensus: A Handbook on Formal Consensus Decisionmaking, Food Not Bombs."},{"key":"ref_52","unstructured":"Cabrerizo, F.J., Mart\u00ednez, M.A., Herrera, M., and Herrera-Viedma, E. (2015, January 21\u201324). Consensus in a Fuzzy Environment: A Bibliometric Study. Proceedings of the 3rd International Conference on Information Technology and Quantitative Management ITQM 2015, Rio De Janeiro, Brazil."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/0165-0114(86)90014-X","article-title":"Group decision making with a fuzzy linguistic majority","volume":"18","author":"Kacprzyk","year":"1986","journal-title":"Fuzzy Sets Syst."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.knosys.2013.12.013","article-title":"Consensus model for multiple criteria group decision making under intuitionistic fuzzy environment","volume":"57","author":"Zhang","year":"2014","journal-title":"Knowl.-Based Syst."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Szmidt, E., and Kacprzyk, J. (2005, January 25\u201327). A new concept of a similarity measure for intuitionistic fuzzy sets and its use in group decision making. Proceedings of the 2rd International Conference on Modeling Decisions for Artificial Intelligence, Tsukuba, Japan.","DOI":"10.1007\/11526018_27"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"2498","DOI":"10.1016\/j.apm.2011.09.006","article-title":"A multi-attribute group decision-making method based on weighted geometric aggregation operators of interval-valued trapezoidal fuzzy numbers","volume":"36","author":"Liu","year":"2012","journal-title":"Appl. Math. Model."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1109\/TSMCA.2002.802821","article-title":"A consensus model for multiperson decision making with different preference structures","volume":"32","author":"Herrera","year":"2002","journal-title":"Syst. Man Cybern. Part A Syst. Hum. IEEE Trans."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.knosys.2013.07.002","article-title":"Consensus measures constructed from aggregation functions and fuzzy implications","volume":"55","author":"Beliakov","year":"2014","journal-title":"Knowl.-Based Syst."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1016\/j.ejor.2006.08.032","article-title":"Some induced ordered weighted averaging operators and their use for solving group decision-making problems based on fuzzy preference relations","volume":"182","author":"Chiclana","year":"2007","journal-title":"Eur. J. Oper. Res."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1545","DOI":"10.1016\/j.cie.2008.09.041","article-title":"The induced continuous ordered weighted geometric operators and their application in group decision making","volume":"56","author":"Wu","year":"2009","journal-title":"Comput. Ind. Eng."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.cie.2010.03.005","article-title":"Some properties of the induced continuous ordered weighted geometric operators in group decision making","volume":"59","author":"Wu","year":"2010","journal-title":"Comput. Ind. Eng."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.mcm.2011.01.029","article-title":"An ILOWG operator based group decision making method and its application to evaluate the supplier criteria","volume":"54","author":"Wu","year":"2011","journal-title":"Math. Comput. Model."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"7059","DOI":"10.1016\/j.eswa.2010.12.007","article-title":"Some issues on properties of the extended IOWA operators in fuzzy group decision making","volume":"38","author":"Wu","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/0165-0114(95)00185-9","article-title":"Aggregation of fuzzy opinions under group decision making","volume":"79","author":"Hsu","year":"1996","journal-title":"Fuzzy Sets Syst."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1108\/00197850210414026","article-title":"The use of case studies in management training and development. Part 1","volume":"34","author":"Rees","year":"2002","journal-title":"Ind. Commer. Train."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"613","DOI":"10.2307\/258920","article-title":"Better Stories, Not Better Constructs, To Generate Better Theory: A Rejoinder to Eisenhardt","volume":"16","author":"Dyer","year":"1991","journal-title":"Acad. Manag. Rev."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"2086","DOI":"10.1016\/j.jss.2012.04.005","article-title":"On using planning poker for estimating user stories","volume":"85","author":"Hovelja","year":"2012","journal-title":"J. Syst. Softw."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Peters, F., and Menzies, T. (2012, January 2\u20139). Privacy and utility for defect prediction: Experiments with MORPH. Proceedings of the 2012 34th International Conference on Software Engineering (ICSE), Zurich, Switzerland.","DOI":"10.1109\/ICSE.2012.6227194"},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Gerring, J. (2007). Case Study Research: Principles and Practices, Cambridge University Press.","DOI":"10.1017\/CBO9780511803123"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/MSPEC.2005.1502528","article-title":"Why software fails [software failure]","volume":"42","author":"Charette","year":"2005","journal-title":"IEEE Spectr."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1145\/1297797.1297801","article-title":"The impact of size and volatility on IT project performance","volume":"50","author":"Sauer","year":"2007","journal-title":"Commun. ACM"},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1109\/MS.2008.107","article-title":"A replicated survey of IT software project failures","volume":"25","author":"Koru","year":"2008","journal-title":"IEEE Softw."},{"key":"ref_73","unstructured":"Standish Group (2019, April 10). The Standish Group Report. Available online: https:\/\/www.projectsmart.co.uk\/white-papers\/chaos-report.pdf."},{"key":"ref_74","unstructured":"Reddy, P., Sudha, K.R., Sree, P.R., and Ramesh, S. (2010). Software effort estimation using radial basis and generalized regression neural networks. arXiv."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1016\/j.procs.2014.05.348","article-title":"A new concept of project robust schedule\u2014Use of buffers","volume":"31","author":"Kuchta","year":"2014","journal-title":"Procedia Comput. Sci."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/8\/1032\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:09:59Z","timestamp":1760188199000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/8\/1032"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,9]]},"references-count":75,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["sym11081032"],"URL":"https:\/\/doi.org\/10.3390\/sym11081032","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2019,8,9]]}}}