{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T00:19:57Z","timestamp":1773706797621,"version":"3.50.1"},"reference-count":58,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,6,11]],"date-time":"2023-06-11T00:00:00Z","timestamp":1686441600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Metrics are key elements that can give us valuable information about the effectiveness of agile software development processes, particularly considering the Scrum environment. This study aims to learn about the metrics adopted to assess agile development processes and explore the impact of how the role performed by each member in Scrum contributed to increasing\/reducing the perception of the importance of these metrics. The impact of years of experience in Scrum on this perception was also explored. To this end, a quantitative study was conducted with 191 Scrum professionals in companies based in Portugal. The results show that the Scrum role is not a determining factor, while individuals with more years of experience have a higher perception of the importance of metrics related to team performance. The same conclusion is observed for the business value metric of the product backlog and the percentage of test automation in the testing phase. The findings allow for extending the knowledge about Scrum project management processes and their teams, in addition to offering important insights into the implementation of metrics for software engineering companies that adopt Scrum.<\/jats:p>","DOI":"10.3390\/info14060327","type":"journal-article","created":{"date-parts":[[2023,6,12]],"date-time":"2023-06-12T01:59:07Z","timestamp":1686535147000},"page":"327","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Perceived Importance of Metrics for Agile Scrum Environments"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6758-4843","authenticated-orcid":false,"given":"Fernando","family":"Almeida","sequence":"first","affiliation":[{"name":"Faculty of Engineering, University of Porto & INESC TEC, 4200-465 Porto, Portugal"}]},{"given":"Pedro","family":"Carneiro","sequence":"additional","affiliation":[{"name":"School of Science and Technology, Polytechnic Higher Institute of Gaya, 4400-103 Vila Nova de Gaia, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e1986","DOI":"10.1002\/smr.1986","article-title":"Lean and agile software process improvement in traditional and agile environments","volume":"31","author":"Poth","year":"2019","journal-title":"J. Soft. Evol. Proc."},{"key":"ref_2","unstructured":"KPMG (2023, January 26). Agile Transformation. Available online: https:\/\/assets.kpmg\/content\/dam\/kpmg\/be\/pdf\/2019\/11\/agile-transformation.pdf."},{"key":"ref_3","unstructured":"Digital.ai (2023, January 26). 16th State of Agile Report. Available online: https:\/\/digital.ai\/resource-center\/analyst-reports\/state-of-agile-report\/."},{"key":"ref_4","unstructured":"Beck, K., Beedle, M., van Bennekum, A., Cockburn, A., Cunningham, W., Fowler, M., Grenning, J., Highsmith, J., Hunt, A., and Jeffries, R. (2023, January 26). Manifesto for Agile Software Development. Available online: https:\/\/agilemanifesto.org."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1213","DOI":"10.1016\/j.jss.2012.02.033","article-title":"A decade of agile methodologies: Towards explaining agile software development","volume":"85","author":"Dingsoyr","year":"2012","journal-title":"J. Syst. Soft."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1108\/IJMPB-12-2020-0366","article-title":"Balancing between stability and change in Agile teams","volume":"14","author":"Lindskog","year":"2021","journal-title":"Int. J. Manag. Proj. Bus."},{"key":"ref_7","first-page":"25","article-title":"Understanding the characteristics, benefits and challenges of agile IT project management: A literature based perspective","volume":"10","author":"Matey","year":"2019","journal-title":"Int. J. Soft. Eng. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1111\/isj.12282","article-title":"How agile software development methods reduce work exhaustion: Insights on role perceptions and organizational skills","volume":"30","author":"Venkatesh","year":"2020","journal-title":"Inf. Syst. J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"38","DOI":"10.4018\/JDM.2016070103","article-title":"An Empirical Investigation of the Perceived Benefits of Agile Methodologies Using an Innovation-Theoretical model","volume":"27","author":"Bonner","year":"2016","journal-title":"J. Database Manag."},{"key":"ref_10","first-page":"9","article-title":"Impact of Agile Methodology on Software Development","volume":"8","author":"Altameem","year":"2015","journal-title":"Comp. Inf. Sci."},{"key":"ref_11","unstructured":"Sutherland, J. (2014). The Art of Doing Twice the Work in Half the Time, Crown Business."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1016\/j.procs.2021.01.227","article-title":"Agile versus Waterfall Project Management: Decision Model for Selecting the Appropriate Approach to a Project","volume":"181","author":"Thesing","year":"2021","journal-title":"Proc. Comp. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"032045","DOI":"10.1088\/1757-899X\/394\/3\/032045","article-title":"Research Process on Software Development Model","volume":"394","author":"Yu","year":"2018","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"ref_14","unstructured":"Rubin, K. (2012). Essential Scrum: A Practical Guide to the Most Popular Agile Process, Addison-Wesley."},{"key":"ref_15","first-page":"278","article-title":"A systematic literature review: How agile is agile project management?","volume":"22","author":"Behrens","year":"2021","journal-title":"Issues Inf. Syst."},{"key":"ref_16","first-page":"1","article-title":"An Examination and Evaluation of Agile Methodologies for Systems Development","volume":"2","author":"Madadopouya","year":"2015","journal-title":"Aust. J. Comp. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"012025","DOI":"10.1088\/1757-899X\/1169\/1\/012025","article-title":"Agile, waterfall and iterative approach in information technology projects","volume":"1169","author":"Fagarasan","year":"2021","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"ref_18","first-page":"992","article-title":"Software Development Technique for the Betterment of End User Satisfaction using Agile Methodology","volume":"9","author":"Lalband","year":"2020","journal-title":"TEM J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1108\/JMTM-03-2019-0087","article-title":"Decision-making approaches in process innovations: An explorative case study","volume":"32","author":"Bruch","year":"2021","journal-title":"J. Manuf. Technol. Manag."},{"key":"ref_20","unstructured":"IBM (2023, January 31). Use Key Performance Indicators to Measure and Guide Progress. Available online: https:\/\/www.ibm.com\/garage\/method\/practices\/learn\/kpis-measure-guide-progress\/."},{"key":"ref_21","unstructured":"Eriksson, J. (2023, January 31). KPIs: An Essential Framework. Available online: https:\/\/www.thinkwithgoogle.com\/intl\/en-145\/future-of-marketing\/creativity\/kpis-essential-framework\/."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Tekin, N., Yilmaz, M., and Clarke, P. (2021). A novel approach for visualization, monitoring, and control techniques for Scrum metric planning using the analytic hierarchy process. J. Softw. Evol. Proc., e2420.","DOI":"10.1002\/smr.2420"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1504\/IJASM.2021.118061","article-title":"Performance metrics in scrum software engineering companies","volume":"14","author":"Almeida","year":"2021","journal-title":"Int. J. Agile Syst. Manag."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kurnia, R., Ferdiana, R., and Wibirama, S. (2018, January 21\u201322). Software Metrics Classification for Agile Scrum Process: A Literature Review. Proceedings of the International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), Yogyakarta, Indonesia.","DOI":"10.1109\/ISRITI.2018.8864244"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"111187","DOI":"10.1016\/j.jss.2021.111187","article-title":"Quality measurement in agile and rapid software development: A systematic mapping","volume":"186","author":"Vollmer","year":"2022","journal-title":"J. Syst. Softw."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"63","DOI":"10.5937\/sjm1101063V","article-title":"Role and importance of key performance indicators measurement","volume":"6","author":"Velimirovic","year":"2011","journal-title":"Serb. J. Manag."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Staron, M., Meding, W., Niesel, K., and Abran, A. (2016, January 5\u20137). A Key Performance Indicator Quality Model and Its Industrial Evaluation. Proceedings of the 2016 Joint Conference of the International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement (IWSM-MENSURA), Berlin, Germany.","DOI":"10.1109\/IWSM-Mensura.2016.033"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.infsof.2015.02.005","article-title":"Using metrics in Agile and Lean Software Development\u2014A systematic literature review of industrial studies","volume":"62","author":"Kupiainen","year":"2015","journal-title":"Inf. Soft. Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11334-016-0271-0","article-title":"Product backlog rating: A case study on measuring test quality in scrum","volume":"12","author":"Kayes","year":"2016","journal-title":"Innov. Syst. Soft. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e1933","DOI":"10.1002\/smr.1933","article-title":"More effective sprint retrospective with statistical analysis","volume":"30","author":"Erdogan","year":"2018","journal-title":"J. Softw. Evol. Proc."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ayunda, P.L., and Budiardio, E.K. (2020, January 15\u201316). Evaluation of Scrum Practice Maturity in Software Development of Mobile Communication Application. Proceedings of the 2020 3rd International Conference on Computer and Informatics Engineering (IC2IE), Yogyakarta, Indonesia.","DOI":"10.1109\/IC2IE50715.2020.9274625"},{"key":"ref_32","first-page":"561","article-title":"Measuring Maturity Level of Scrum Practices in Software development Using Scrum Maturity Model","volume":"12","author":"Panjaitan","year":"2022","journal-title":"J. Syst. Manag. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1662","DOI":"10.1016\/j.jss.2010.03.077","article-title":"Using Scrum to guide the execution of software process improvement in small organizations","volume":"83","author":"Pino","year":"2010","journal-title":"J. Syst. Soft."},{"key":"ref_34","first-page":"109459","article-title":"Why Scrum works in new product development: The role of social capital in managing complexity","volume":"179","author":"Baxter","year":"2021","journal-title":"Prod. Plann. Contr."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"107079","DOI":"10.1016\/j.infsof.2022.107079","article-title":"Mastering scrum with a focus on team maturity and key components of scrum","volume":"153","author":"Kadenic","year":"2023","journal-title":"Inf. Soft. Technol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4","DOI":"10.12691\/ajams-9-1-2","article-title":"Factor Analysis as a Tool for Survey Analysis","volume":"9","author":"Shrestha","year":"2021","journal-title":"Amer. J. Appl. Math. Stat."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1023\/A:1009849100780","article-title":"Software Metrics Data Analysis\u2014Exploring the Relative Performance of Some Commonly Used Modeling Techniques","volume":"4","author":"Gray","year":"1999","journal-title":"Emp. Soft. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1080\/14783360600588174","article-title":"Software metrics for enhanced business excellence: An investigation of research issues from a macro perspective","volume":"17","author":"Sureshchandar","year":"2006","journal-title":"Total Qual. Manag. Bus. Exc."},{"key":"ref_39","first-page":"220","article-title":"A review of quality attributes based software metrics","volume":"4","author":"Gehiot","year":"2013","journal-title":"Int. J. Adv. Res. Comp. Sci."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"44647","DOI":"10.1109\/ACCESS.2021.3054730","article-title":"Software Product Quality Metrics: A Systematic Mapping Study","volume":"9","author":"Colakoglu","year":"2021","journal-title":"IEEE Access"},{"key":"ref_41","first-page":"283","article-title":"A Metrics Framework for Product Development in Software Startups","volume":"27","author":"Shanbhag","year":"2019","journal-title":"J. Ent. Cult."},{"key":"ref_42","unstructured":"Bansai, S. (2023, April 18). Velocity\u2014An Agile Metrics. Available online: https:\/\/www.izenbridge.com\/blog\/velocity-in-agile-scrum."},{"key":"ref_43","unstructured":"Doshi, P. (2023, April 21). Agile Metrics: Velocity. Available online: https:\/\/www.scrum.org\/resources\/blog\/agile-metrics-velocity."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Downey, S., and Sutherland, J. (2013, January 7\u201310). Scrum Metrics for Hyperproductive Teams: How They Fly like Fighter Aircraft. Proceedings of the 46th Hawaii International Conference on System Sciences, Wailea, HI, USA.","DOI":"10.1109\/HICSS.2013.471"},{"key":"ref_45","unstructured":"Salimi, S. (2023, April 21). Capacity. Available online: https:\/\/www.agile-academy.com\/en\/agile-dictionary\/capacity\/."},{"key":"ref_46","unstructured":"Agile Pinoy (2023, April 21). Measuring Team Velocity. Available online: https:\/\/agilepinoy.wordpress.com\/2018\/01\/11\/measuring-team-velocity\/."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1177\/1063293X20958541","article-title":"Agile-Concurrent hybrid: A framework for concurrent product development using Scrum","volume":"28","author":"Zuzek","year":"2020","journal-title":"Conc. Eng."},{"key":"ref_48","first-page":"70","article-title":"Real Time Agile Metrics for Measuring Team Performance","volume":"22","author":"Budacu","year":"2018","journal-title":"Inf. Econ."},{"key":"ref_49","first-page":"620836","article-title":"Software Test Automation in Practice: Empirical Observations","volume":"2010","author":"Kasurinen","year":"2010","journal-title":"Adv. Soft. Eng."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.procs.2016.03.003","article-title":"The Impacts of Test Automation on Software\u2019s Cost, Quality and Time to Market","volume":"79","author":"Kumar","year":"2016","journal-title":"Proc. Comp. Sci."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"042030","DOI":"10.1088\/1742-6596\/1378\/4\/042030","article-title":"A Critical Analysis of Software Testing Tools","volume":"1378","author":"Okezie","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1147\/sj.411.0126","article-title":"The Software Testing Automation Framework","volume":"31","author":"Rankin","year":"2002","journal-title":"IBM Syst. J."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"111259","DOI":"10.1016\/j.jss.2022.111259","article-title":"Test automation maturity improves product quality\u2014Quantitative study of open source projects using continuous integration","volume":"188","author":"Wang","year":"2022","journal-title":"J. Syst. Soft."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1145\/3576027","article-title":"Three-part Harmony for Program Managers Who Just Don\u2019t Get It, Yet","volume":"20","author":"Aldrich","year":"2023","journal-title":"ACM Queue"},{"key":"ref_55","unstructured":"Dulin, M. (2023, April 21). Navigating Success with Scrum Values and Pillars. Available online: https:\/\/www.agileambition.com\/scrum-values-and-pillars\/."},{"key":"ref_56","unstructured":"Kanbanize (2023, April 21). Agile Workflow: Your Go-to Guide to an Adaptive Process. Available online: https:\/\/kanbanize.com\/agile\/project-management\/workflow."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Torres, P.L., and Cornide-Reyes, H. (2022, January 17\u201321). Team performance assessment and improvement in an agile methodology framework. Proceedings of the VLIII Latin American Computer Conference (CLEI), Armenia, Colombia.","DOI":"10.1109\/CLEI56649.2022.9959959"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"e1639","DOI":"10.1002\/stvr.1639","article-title":"Impediments for software test automation: A systematic literature review","volume":"27","author":"Wiklund","year":"2017","journal-title":"J. Soft. Test. Ver. Rel."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/6\/327\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:52:37Z","timestamp":1760125957000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/6\/327"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,11]]},"references-count":58,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["info14060327"],"URL":"https:\/\/doi.org\/10.3390\/info14060327","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,11]]}}}