{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T21:04:19Z","timestamp":1778706259331,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":45,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,17]]},"DOI":"10.1145\/3727967.3756847","type":"proceedings-article","created":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T11:53:17Z","timestamp":1766490797000},"page":"10-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Assessing Software Product Quality in DevOps: An ISO 25010:2023 Perspective"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9807-6235","authenticated-orcid":false,"given":"Saima","family":"Rafi","sequence":"first","affiliation":[{"name":"Edinburgh Napier University, Edinburgh, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6880-4991","authenticated-orcid":false,"given":"Muhammad Azeem","family":"Akbar","sequence":"additional","affiliation":[{"name":"LUT University Finland, Lappeenranta, Finland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8479-1481","authenticated-orcid":false,"given":"Arif Ali","family":"Khan","sequence":"additional","affiliation":[{"name":"University of Oulu, Oulu, Finland"}]}],"member":"320","published-online":{"date-parts":[[2025,12,23]]},"reference":[{"key":"e_1_3_3_1_2_2","doi-asserted-by":"crossref","unstructured":"Fernando Almeida Jorge Sim\u00f5es and S\u00e9rgio Lopes. 2022. Exploring the benefits of combining devops and agile. Future Internet 14 2 (2022) 63.","DOI":"10.3390\/fi14020063"},{"key":"e_1_3_3_1_3_2","doi-asserted-by":"crossref","unstructured":"Ahmad Alnafessah Alim\u00a0Ul Gias Runan Wang Lulai Zhu Giuliano Casale and Antonio Filieri. 2021. Quality-aware devops research: Where do we stand? IEEE access 9 (2021) 44476\u201344489.","DOI":"10.1109\/ACCESS.2021.3064867"},{"key":"e_1_3_3_1_4_2","doi-asserted-by":"crossref","unstructured":"Ricardo Amaro R\u00faben Pereira and Miguel Mira\u00a0da Silva. 2024. DevOps metrics and KPIs: a multivocal literature review. Comput. Surveys 56 9 (2024) 1\u201341.","DOI":"10.1145\/3652508"},{"key":"e_1_3_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3383219.3383280"},{"key":"e_1_3_3_1_6_2","doi-asserted-by":"crossref","unstructured":"Antonia Bertolino Guglielmo\u00a0De Angelis Antonio Guerriero Breno Miranda Roberto Pietrantuono and Stefano Russo. 2023. DevOpRET: Continuous reliability testing in DevOps. Journal of Software: Evolution and Process 35 3 (2023) e2298.","DOI":"10.1002\/smr.2298"},{"key":"e_1_3_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.5220\/0007837000270039"},{"key":"e_1_3_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-33547-2_5"},{"key":"e_1_3_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPCSN62568.2024.00112"},{"key":"e_1_3_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.5555\/AAI29324041"},{"key":"e_1_3_3_1_11_2","volume-title":"ISO\/IEC 25010: 2023: Systems and Software Engineering \u2014Systems and Software Quality Requirements and Evaluation (SQuaRE)\u2014Product Quality Model","author":"Standardization International\u00a0Organization for","year":"2023","unstructured":"International\u00a0Organization for Standardization. 2023. ISO\/IEC 25010: 2023: Systems and Software Engineering \u2014Systems and Software Quality Requirements and Evaluation (SQuaRE)\u2014Product Quality Model."},{"key":"e_1_3_3_1_12_2","unstructured":"Gene Gotimer and Thomas Stiehm. 2016. Devops advantages for testing: Increasing quality through continuous delivery. CrossTalk Magazine (2016) 13\u201318."},{"key":"e_1_3_3_1_13_2","volume-title":"The Art of DevOps Engineering","author":"Gupta Subrat","year":"2024","unstructured":"Subrat Gupta. 2024. The Art of DevOps Engineering. Subrat Gupta."},{"key":"e_1_3_3_1_14_2","unstructured":"Jonas Heilmann. 2020. Application Security Review Criteria for DevSecOps Processes."},{"key":"e_1_3_3_1_15_2","volume-title":"Enhancing DevOps with Autonomous Monitors: A Proactive Approach to Failure Detection","author":"Hrusto Adha","year":"2024","unstructured":"Adha Hrusto. 2024. Enhancing DevOps with Autonomous Monitors: A Proactive Approach to Failure Detection. Lund University."},{"key":"e_1_3_3_1_16_2","volume-title":"Hands-On Security in DevOps: Ensure continuous security, deployment, and delivery with DevSecOps","author":"Hsu Tony Hsiang-Chih","year":"2018","unstructured":"Tony Hsiang-Chih Hsu. 2018. Hands-On Security in DevOps: Ensure continuous security, deployment, and delivery with DevSecOps. Packt Publishing Ltd."},{"key":"e_1_3_3_1_17_2","unstructured":"Ishita Jaju. 2023. Maximizing DevOps Scalability in Complex Software Systems: Maximizing DevOps Scalability in Complex Software Systems."},{"key":"e_1_3_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3508397.3564840"},{"key":"e_1_3_3_1_19_2","doi-asserted-by":"crossref","unstructured":"Srinikhita Kothapalli Aditya Manikyala Hari\u00a0Priya Kommineni SSMLG Gudimetla\u00a0Naga Venkata Pavan\u00a0Kumar Gade Abhishekar\u00a0Reddy Allam Narayana Reddy\u00a0Bommu Sridharlakshmi Narasimha\u00a0Rao Boinapalli AR Onteddu and RR Kundavaram. 2019. Code Refactoring Strategies for DevOps: Improving Software Maintainability and Scalability. ABC Research Alert 7 3 (2019) 193\u2013204.","DOI":"10.18034\/ra.v7i3.663"},{"key":"e_1_3_3_1_20_2","volume-title":"Learning DevOps: A comprehensive guide to accelerating DevOps culture adoption with Terraform, Azure DevOps, Kubernetes, and Jenkins","author":"Krief Mikael","year":"2022","unstructured":"Mikael Krief. 2022. Learning DevOps: A comprehensive guide to accelerating DevOps culture adoption with Terraform, Azure DevOps, Kubernetes, and Jenkins. Packt Publishing Ltd."},{"key":"e_1_3_3_1_21_2","volume-title":"Pipeline as code: continuous delivery with Jenkins, Kubernetes, and terraform","author":"Labouardy Mohamed","year":"2021","unstructured":"Mohamed Labouardy. 2021. Pipeline as code: continuous delivery with Jenkins, Kubernetes, and terraform. Simon and Schuster."},{"key":"e_1_3_3_1_22_2","doi-asserted-by":"crossref","unstructured":"Josef Langerman and Wai\u00a0Sze Leung. 2024. The effect of outsourcing and insourcing on Agile and DevOps. Journal of Information Technology Teaching Cases 14 2 (2024) 192\u2013199.","DOI":"10.1177\/20438869231176841"},{"key":"e_1_3_3_1_23_2","unstructured":"Alexandra LAPOINTE-BOISVERT Sylvie TRUDEL and Jean-Marc DESHARNAIS. 2024. Measurement In DevOps Standard: Proposed Improvements. (2024)."},{"key":"e_1_3_3_1_24_2","doi-asserted-by":"crossref","unstructured":"Ankur Mahida. 2024. Integrating Observability with DevOps Practices in Financial Services Technologies: A Study on Enhancing Software Development and Operational Resilience. International Journal of Advanced Computer Science & Applications 15 7 (2024).","DOI":"10.14569\/IJACSA.2024.0150701"},{"key":"e_1_3_3_1_25_2","unstructured":"Simo M\u00e4kinen. 2023. Increasing Release Frequency by Accelerating Software Development Cycles in Software Engineering. (2023)."},{"key":"e_1_3_3_1_26_2","doi-asserted-by":"crossref","unstructured":"Alok Mishra and Ziadoon Otaiwi. 2020. DevOps and software quality: A systematic mapping. Computer Science Review 38 (2020) 100308.","DOI":"10.1016\/j.cosrev.2020.100308"},{"key":"e_1_3_3_1_27_2","unstructured":"Ibrahim\u00a0Ali Mohammed. 2018. A methodical mapping on the relationship between DevOps and software quality. International Journal of Creative Research Thoughts (IJCRT) www. ijcrt. org ISSN (2018) 2320\u20132882."},{"key":"e_1_3_3_1_28_2","first-page":"1","volume-title":"CAiSE (Doctoral Consortium)","author":"Morais Gabriel","year":"2023","unstructured":"Gabriel Morais. 2023. Enabling Systematic Microservices Reuse Through DevOps.. In CAiSE (Doctoral Consortium). 1\u201310."},{"key":"e_1_3_3_1_29_2","doi-asserted-by":"crossref","unstructured":"Bilal Naqvi Damian Kedziora Lanqi Zhang and Shola Oyedeji. 2025. Quality of Low-Code\/No-Code Development Platforms Through the Lens of ISO 25010: 2023. Computer 58 3 (2025) 30\u201340.","DOI":"10.1109\/MC.2024.3493192"},{"key":"e_1_3_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICARC61713.2024.10499735"},{"key":"e_1_3_3_1_31_2","doi-asserted-by":"crossref","unstructured":"Jes\u00fas Oviedo Mois\u00e9s Rodriguez Andrea Trenta Dino Cannas Domenico Natale and Mario Piattini. 2024. ISO\/IEC quality standards for AI engineering. Computer Science Review 54 (2024) 100681.","DOI":"10.1016\/j.cosrev.2024.100681"},{"key":"e_1_3_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICTER.2017.8257807"},{"key":"e_1_3_3_1_33_2","doi-asserted-by":"crossref","unstructured":"Dan Port Bill Taber and Parisa Emkani. 2024. Investigating effectiveness and compliance to DevOps policies and practices for managing productivity and quality variability. Journal of Systems and Software 213 (2024) 112030.","DOI":"10.1016\/j.jss.2024.112030"},{"key":"e_1_3_3_1_34_2","volume-title":"Data Engineering for Modern Applications","author":"Praveen RVS","year":"2024","unstructured":"RVS Praveen. 2024. Data Engineering for Modern Applications. Addition Publishing House."},{"key":"e_1_3_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3661167.3661239"},{"key":"e_1_3_3_1_36_2","doi-asserted-by":"crossref","unstructured":"Saima Rafi Wu Yu Muhammad\u00a0Azeem Akbar Sajjad Mahmood Ahmed Alsanad and Abdu Gumaei. 2021. Readiness model for DevOps implementation in software organizations. Journal of Software: Evolution and Process 33 4 (2021) e2323.","DOI":"10.1002\/smr.2323"},{"key":"e_1_3_3_1_37_2","doi-asserted-by":"crossref","unstructured":"Roshan\u00a0N Rajapakse Mansooreh Zahedi M\u00a0Ali Babar and Haifeng Shen. 2022. Challenges and solutions when adopting DevSecOps: A systematic review. Information and software technology 141 (2022) 106700.","DOI":"10.1016\/j.infsof.2021.106700"},{"key":"e_1_3_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/IWSM.Mensura.2014.33"},{"key":"e_1_3_3_1_39_2","unstructured":"Jukka Riihim\u00e4ki. 2019. Automatic testing and delivery in web development. (2019)."},{"key":"e_1_3_3_1_40_2","first-page":"1","volume-title":"2024 Third International Conference on Smart Technologies and Systems for Next Generation Computing (ICSTSN)","author":"Saini Lalit\u00a0Mohan","year":"2024","unstructured":"Lalit\u00a0Mohan Saini et\u00a0al. 2024. The Impact of Devops on Software Quality. In 2024 Third International Conference on Smart Technologies and Systems for Next Generation Computing (ICSTSN). IEEE, 1\u20136."},{"key":"e_1_3_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3210459.3210465"},{"key":"e_1_3_3_1_42_2","unstructured":"Sumanth Tatineni. 2023. Applying DevOps Practices for Quality and Reliability Improvement in Cloud-Based Systems. Technix international journal for engineering research (TIJER) 10 11 (2023) 374\u2013380."},{"key":"e_1_3_3_1_43_2","unstructured":"Berk T\u00fcretken. 2024. Enhancing Security with Cloud-based API Management: Best Practices and Implementation."},{"key":"e_1_3_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/2898375.2898383"},{"key":"e_1_3_3_1_45_2","volume-title":"DevOps: continuous delivery, integration, and deployment with DevOps: dive into the core DevOps strategies","author":"Vadapalli Sricharan","year":"2018","unstructured":"Sricharan Vadapalli. 2018. DevOps: continuous delivery, integration, and deployment with DevOps: dive into the core DevOps strategies. Packt Publishing Ltd."},{"key":"e_1_3_3_1_46_2","volume-title":"Practical DevOps: Implement DevOps in your organization by effectively building, deploying, testing, and monitoring code","author":"Verona Joakim","year":"2018","unstructured":"Joakim Verona. 2018. Practical DevOps: Implement DevOps in your organization by effectively building, deploying, testing, and monitoring code. Packt Publishing Ltd."}],"event":{"name":"EASE Companion '25: Evaluation and Assessment in Software Engineering","location":"Istanbul Turkiye","acronym":"EASE Companion '25"},"container-title":["Proceedings of the 2025 29th International Conference on Evaluation and Assessment in Software Engineering Companion"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3727967.3756847","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T12:08:16Z","timestamp":1766491696000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3727967.3756847"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,17]]},"references-count":45,"alternative-id":["10.1145\/3727967.3756847","10.1145\/3727967"],"URL":"https:\/\/doi.org\/10.1145\/3727967.3756847","relation":{},"subject":[],"published":{"date-parts":[[2025,6,17]]},"assertion":[{"value":"2025-12-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}