{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T10:14:07Z","timestamp":1753870447194,"version":"3.41.2"},"reference-count":46,"publisher":"Wiley","issue":"8","license":[{"start":{"date-parts":[[2024,2,26]],"date-time":"2024-02-26T00:00:00Z","timestamp":1708905600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["0079_ATEMPO_6_E","0064_GRESINT_1_E"],"award-info":[{"award-number":["0079_ATEMPO_6_E","0064_GRESINT_1_E"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100016812","name":"Instituto Nacional Electoral","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100016812","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010801","name":"Xunta de Galicia","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100010801","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J Software Evolu Process"],"published-print":{"date-parts":[[2024,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>DevOps has emerged as a practical approach to the interaction between development and operations. This approach has been extended to the interaction with business functions, generating the term BizDevOps. Although many proposals and tools support BizDevOps from a technical viewpoint, there has been no significant improvement in management aspects, such as evaluating the practices and processes involved in the area. This paper presents two case studies on the assessment of BizDevOps practices using MMBDO (Maturity Model for BizDevOps), a maturity model for BizDevOps based on international ICT standards. The case studies were conducted in two organizations with different profiles: a large multinational ICT company with a unit specialized in providing DevOps to the rest of the company and a small software development company that implements DevOps practices as part of its development system. The evidence we obtained in the case studies supports the adequacy of MMBDO for assessing the maturity of BizDevOps in real companies. Also, the combination of the two case studies supports the adequacy of the model for being used in companies with different sizes and levels of maturity. MMBDO is an adequate proposal for assessing the maturity of BizDevOps in software organizations and a suitable tool for process improvement.<\/jats:p>","DOI":"10.1002\/smr.2646","type":"journal-article","created":{"date-parts":[[2024,2,27]],"date-time":"2024-02-27T00:44:45Z","timestamp":1708994685000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Assessing BizDevOps maturity using international standards: Case studies and lessons learned"],"prefix":"10.1002","volume":"36","author":[{"given":"Eduardo","family":"Sanjurjo","sequence":"first","affiliation":[{"name":"Centro de Investigaci\u00f3n CITIC Universidade da Coru\u00f1a A Coru\u00f1a Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6176-4475","authenticated-orcid":false,"given":"Oscar","family":"Pedreira","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n CITIC Universidade da Coru\u00f1a A Coru\u00f1a Spain"}]},{"given":"F\u00e9lix","family":"Garc\u00eda","sequence":"additional","affiliation":[{"name":"Information Technologies and Systems Institute (ISTI) Universidad de Castilla\u2010La Mancha Ciudad Real Spain"}]},{"given":"Mario","family":"Piattini","sequence":"additional","affiliation":[{"name":"Information Technologies and Systems Institute (ISTI) Universidad de Castilla\u2010La Mancha Ciudad Real Spain"}]}],"member":"311","published-online":{"date-parts":[[2024,2,26]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359981"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2735399.2735416"},{"key":"e_1_2_10_4_1","doi-asserted-by":"crossref","unstructured":"WettingerJ BreitenbucherU LeymannF.Standards\u2010based DevOps automation and integration using TOSCA. InProcs. of 7th Int. Conf. on Utility and Cloud Computing (UCC'14).2014;59\u201368.","DOI":"10.1109\/UCC.2014.14"},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2015.06.063"},{"key":"e_1_2_10_6_1","doi-asserted-by":"crossref","unstructured":"WiedemannA WiescheM GewaldH KrcmarH.Implementing the Planning Process within DevOps Teams to Achieve Continuous Innovation.2019.","DOI":"10.24251\/HICSS.2019.841"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58817-5_50"},{"key":"e_1_2_10_8_1","doi-asserted-by":"crossref","unstructured":"GruhnV Sch\u00e4ferC.BizDevOps: Because DevOps is Not the End of the Story. InProceedings of SoMeT 2015: Intelligent Software Methodologies Tools and Techniques.2015:CCIS:388\u2010398.https:\/\/doi.org\/10.1007\/978-3-319-22689-7_30","DOI":"10.1007\/978-3-319-22689-7_30"},{"key":"e_1_2_10_9_1","doi-asserted-by":"crossref","unstructured":"ErichF AmritC DanevaM.A mapping study on cooperation between information system development and operations. InInt. Conf. on Product\u2010Focused Software Process Improvement.2014;LNCS(8892):277\u2013280.","DOI":"10.1007\/978-3-319-13835-0_21"},{"key":"e_1_2_10_10_1","unstructured":"LwakatareLE KuvajaP OivoM.An Exploratory Study of DevOps Extending the Dimensions of DevOps with Practices. InProcs. of 11th Int. Conf. on Software Engineering Advances (ICSEA).2016;August:91\u201399."},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/J.INFSOF.2023.107150"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.12821\/ijispm110304"},{"key":"e_1_2_10_13_1","unstructured":"ISO.ISO \u2010 ISO\/IEC 27001:2017 Information security management \u2014 Security techniques \u2010 Information security management systems \u2014 Requirements.2017."},{"key":"e_1_2_10_14_1","unstructured":"ISO\/IEC.ISO\/IEC 20000\u20101:2018 Information Technology \u2010 Service Management Part 1: Service management system requirements.2018."},{"key":"e_1_2_10_15_1","unstructured":"AXELOS Limited.ITIL\u00ae Foundation: ITIL 4 edition. Accessed: Jan. 18 2022. [Online]. Available:https:\/\/www.oreilly.com\/library\/view\/itil-foundation-itil\/9780113316083\/"},{"key":"e_1_2_10_16_1","unstructured":"ISO\/IEC.ISO\/IEC 12207:2017 Systems and software engineering . Software life cycle processes. Software Process: Improvement and Practice.2017."},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/MITP.2021.3067944"},{"key":"e_1_2_10_18_1","unstructured":"ISO.ISO \u2010 ISO\/IEC\/IEEE 29119\u20102:2021 \u2010 Software and systems engineering \u2014 Software testing \u2014 Part 2: Test processes. Accessed Jan. 18 2022.https:\/\/www.iso.org\/standard\/79428.html"},{"key":"e_1_2_10_19_1","unstructured":"ISO\/IEC.ISO\/IEC 33001:2015 Information technology . Process assessment . Concepts and terminology.2015."},{"key":"e_1_2_10_20_1","unstructured":"ISO.ISO \u2010 ISO\/IEC 33002:2015 \u2010 Information technology \u2014 Process assessment \u2014 Requirements for performing process assessment. Accessed Apr. 06 2022.https:\/\/www.iso.org\/standard\/54176.html"},{"key":"e_1_2_10_21_1","unstructured":"ISO.ISO \u2010 ISO\/IEC 33003:2015 \u2010 Information technology \u2014 Process assessment \u2014 Requirements for process measurement frameworks. Accessed Apr. 06 2022.https:\/\/www.iso.org\/standard\/54177.html"},{"key":"e_1_2_10_22_1","unstructured":"ISO.ISO \u2010 ISO\/IEC 33004:2015 \u2010 Information technology \u2014 Process assessment \u2014 Requirements for process reference process assessment and maturity models. Accessed Apr. 06 2022.https:\/\/www.iso.org\/standard\/54178.html"},{"key":"e_1_2_10_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58793-2_16"},{"volume-title":"CMMI for development: guidelines for process integration and product improvement","year":"2011","author":"Chrissis SS","key":"e_1_2_10_24_1"},{"key":"e_1_2_10_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2007.361"},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/J.INFSOF.2021.106700"},{"key":"e_1_2_10_27_1","unstructured":"J\u00e4pelLM.BizDevOps: A Systematic Literature Review Seminar paper.2019."},{"key":"e_1_2_10_28_1","doi-asserted-by":"crossref","unstructured":"ForbrigP.Continuous software engineering with special emphasis on continuous business\u2010process modeling and human\u2010centered design. InProceedings of the 8th International Conference on Subject\u2010oriented Business Process Management (S\u2010BPM'16).2016:1\u20134.https:\/\/doi.org\/10.1145\/2882879.2882895","DOI":"10.1145\/2882879.2882895"},{"key":"e_1_2_10_29_1","unstructured":"SchraderI Dr\u00f6gehornO.Transforming Business Moments into Business Models|Request PDF. InProceedings of the 17th International Conference on e\u2010Learning e\u2010Business Enterprise Information Systems and e\u2010Government (EEE).2018:87. Accessed: Nov. 04 2023. [Online]. Available:https:\/\/www.proquest.com\/openview\/6fe49437ebf5a0e3b1fdfa46400928ec\/1?pq-origsite=gscholar&cbl=1976356"},{"issue":"2","key":"e_1_2_10_30_1","first-page":"2278","article-title":"DevOps shifting software engineering strategy value based perspective","volume":"17","author":"Mohamed SI","year":"2015","journal-title":"IOSR J Comput Eng Ver IV"},{"key":"e_1_2_10_31_1","doi-asserted-by":"crossref","unstructured":"SahidA MalehY BelaissaouiM.An agile framework for ITS management in organizations. A case study based on DevOps. InProcs. of Int. Conf. on Computing and Wireless Communication Sys.2017:1\u20138.","DOI":"10.1145\/3167486.3167556"},{"key":"e_1_2_10_32_1","unstructured":"FeijterR VlietR JagroepE OverbeekS BrinkkemperS.Towards the adoption of DevOps in software product organizations: A maturity model approach.2017."},{"key":"e_1_2_10_33_1","unstructured":"IEEE.IEEE 2675\u20102021 \u2010 IEEE Standard for DevOps:Building Reliable and Secure Systems Including Application Build Package and Deployment. Accessed: Jan. 18 2022. [Online]. Available:https:\/\/standards.ieee.org\/standard\/2675-2021.html"},{"key":"e_1_2_10_34_1","unstructured":"ISO\/IEC.ISO\/IEC\/IEEE 15288:2015 Systems and software engineering\u2014System life cycle processes.2015."},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/SMR.2323"},{"key":"e_1_2_10_36_1","doi-asserted-by":"crossref","unstructured":"NeubrandT HaendlerT.Development of a gqm\u2010based technique for assessing devops maturity.IC3K 2020 \u2010 Proc. 12th Int. Jt Conf Knowl Discov Knowl Eng Knowl Manag. 2020;3:117\u2010129.https:\/\/doi.org\/10.5220\/0010177801170129","DOI":"10.5220\/0010177801170129"},{"key":"e_1_2_10_37_1","unstructured":"ChasiotiK.BizDevOps: A process model for the Alignment of DevOps with Business Goals.2019."},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2020.3023298"},{"key":"e_1_2_10_39_1","doi-asserted-by":"publisher","DOI":"10.1002\/SMR.2342"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-72654-6_45"},{"key":"e_1_2_10_41_1","doi-asserted-by":"crossref","unstructured":"GimenezPJA SantosG.DevOps maturity diagnosis \u2010 A case study in two public organizations. PervasiveHealth Pervasive Comput Technol Healthc.2020.https:\/\/doi.org\/10.1145\/3411564.3411608","DOI":"10.1145\/3411564.3411608"},{"key":"e_1_2_10_42_1","unstructured":"KitchenhamB.Procedures for Performing Systematic Reviews.2004."},{"key":"e_1_2_10_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29863-9_17"},{"key":"e_1_2_10_44_1","unstructured":"UNE 66178:2004 Sistemas de gesti\u00f3n de la calidad. Gu\u00eda para la\u2026Accessed Jan. 18 2022.https:\/\/www.une.org\/encuentra-tu-norma\/busca-tu-norma\/norma\/?c=N0032405"},{"key":"e_1_2_10_45_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781118181034"},{"key":"e_1_2_10_46_1","doi-asserted-by":"crossref","unstructured":"BreretonP KitchenhamB BudgenD LiZ.Using a Protocol Template for Case Study Planning. InProcs. of Int. Conf. on Evaluation and Assessment in Software Engineering (EASE'08).2008:41\u201348.","DOI":"10.14236\/ewic\/EASE2008.5"},{"volume-title":"Collecting case study evidence","year":"2013","author":"Yin RK","key":"e_1_2_10_47_1"}],"container-title":["Journal of Software: Evolution and Process"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/smr.2646","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,12]],"date-time":"2024-11-12T23:00:18Z","timestamp":1731452418000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/smr.2646"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,26]]},"references-count":46,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2024,8]]}},"alternative-id":["10.1002\/smr.2646"],"URL":"https:\/\/doi.org\/10.1002\/smr.2646","archive":["Portico"],"relation":{},"ISSN":["2047-7473","2047-7481"],"issn-type":[{"type":"print","value":"2047-7473"},{"type":"electronic","value":"2047-7481"}],"subject":[],"published":{"date-parts":[[2024,2,26]]},"assertion":[{"value":"2023-05-26","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-12-18","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2646"}}