{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,7]],"date-time":"2026-11-07T19:27:13Z","timestamp":1794079633675,"version":"4.8.0"},"reference-count":59,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2021,3,1]],"date-time":"2021-03-01T00:00:00Z","timestamp":1614556800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,3,1]],"date-time":"2021-03-01T00:00:00Z","timestamp":1614556800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Australian Government Research Training Program"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["SN COMPUT. SCI."],"published-print":{"date-parts":[[2021,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>DevOps originated in the context of the agile development aims to enable the continuous deployment of software applications in small releases. Most recently, organizations are taking a significant interest in adopting DevOps for automatically deploying IoT applications to multi-cloud. The interest is there; however, the challenge is how to achieve this. A new DevOps reference architecture (DRA) framework has been iteratively developed to address this challenge. This paper presents the updated DRA framework and its empirical evaluation results. The empirical evaluation is composed of two phases: (1) industry case study evaluation conducted in an IT organization, and (2) industry field survey with a cohort of experts in software engineering. The evaluation aims to determine the applicability and novelty of the DRA framework. The evaluation results indicate that the DRA is fit for its intended purpose and is expected to help both researchers and practitioners. The DRA uses can architect complex design models for the purpose of supporting the automated development stage of software applications. Software engineers can implement the DRA models for deploying complex IoT application to the multi-cloud environment in the current organization development parameters.<\/jats:p>","DOI":"10.1007\/s42979-021-00519-6","type":"journal-article","created":{"date-parts":[[2021,3,1]],"date-time":"2021-03-01T21:02:57Z","timestamp":1614632577000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Evaluating the DevOps Reference Architecture for Multi-cloud IoT-Applications"],"prefix":"10.1007","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3732-7085","authenticated-orcid":false,"given":"Georges","family":"Bou Ghantous","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asif Qumer","family":"Gill","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,3,1]]},"reference":[{"issue":"6","key":"519_CR1","doi-asserted-by":"publisher","first-page":"681","DOI":"10.17706\/\/jsw.10.6.681-694","volume":"10","author":"YI Alzoubi","year":"2015","unstructured":"Alzoubi YI, Gill AQ, Al-Ani A. Distributed agile development communication: an agile architecture driven framework. JSW. 2015;10(6):681\u201394.","journal-title":"JSW"},{"key":"519_CR2","doi-asserted-by":"publisher","unstructured":"Bai X, Pei D, Li M, Li S. The DevOps lab platform for managing diversified projects in educating agile software engineering. In: 2018 IEEE frontiers in education conference (FIE), San Jose, CA, USA; 2018, pp. 1\u20135. https:\/\/doi.org\/10.1109\/FIE.2018.8658817.","DOI":"10.1109\/FIE.2018.8658817"},{"key":"519_CR3","unstructured":"Bou Ghantous G, Gill A. DevOps: Concepts, practices, tools, benefits and challenges. PACIS2017. Pacific Asia Conference on Information Systems 2017, Sep 11.\u00a0AISeL https:\/\/aisel.aisnet.org\/pacis2017\/."},{"key":"519_CR4","doi-asserted-by":"crossref","unstructured":"Chang CK. Agile, Continuous Integration, and DevOps. In: 2019 IEEE 43rd annual computer software and applications conference (COMPSAC), vol. 1. IEEE; 2019. pp. 211.","DOI":"10.1109\/COMPSAC.2019.00038"},{"key":"519_CR5","doi-asserted-by":"publisher","unstructured":"Rajkumar M, Pole AK, Adige VS, Mahanta P. DevOps culture and its impact on cloud delivery and software development. In: 2016 international conference on advances in computing, communication, & automation (ICACCA) (Spring), Dehradun; 2016. pp. 1\u20136. https:\/\/doi.org\/10.1109\/ICACCA.2016.7578902","DOI":"10.1109\/ICACCA.2016.7578902"},{"key":"519_CR6","doi-asserted-by":"publisher","unstructured":"Moore J, Kortuem G, Smith A, Chowdhury N, Cavero J, Gooch D. DevOps for the Urban IoT. Urb-IoT\u201916, May 24\u201325, 2016, Tokyo, Japan. 2016. https:\/\/doi.org\/10.1145\/2962735.2962747","DOI":"10.1145\/2962735.2962747"},{"key":"519_CR7","doi-asserted-by":"crossref","unstructured":"Anwar MJ, Gill AQ. A review of the seven modelling approaches for digital ecosystem architecture. In: 2019 IEEE 21st conference on business informatics (CBI), vol. 1. IEEE; 2019. pp. 94\u2013103.","DOI":"10.1109\/CBI.2019.00018"},{"key":"519_CR8","doi-asserted-by":"publisher","unstructured":"Bou Ghantous G, Gill AQ. DevOps reference architecture for multi-cloud IoT applications. In: 2018 IEEE 20th conference on business informatics (CBI), Vienna, 2018, pp. 158\u2013167. https:\/\/doi.org\/10.1109\/CBI.2018.00026.","DOI":"10.1109\/CBI.2018.00026"},{"issue":"4","key":"519_CR9","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1109\/TCC.2016.2535325","volume":"6","author":"J Wettinger","year":"2018","unstructured":"Wettinger J, Andrikopoulos V, Leymann F, Strauch S. Middleware-oriented deployment automation for cloud applications. IEEE Trans Cloud Comput. 2018;6(4):1054\u201366. https:\/\/doi.org\/10.1109\/TCC.2016.2535325.","journal-title":"IEEE Trans Cloud Comput"},{"key":"519_CR10","doi-asserted-by":"publisher","first-page":"1040","DOI":"10.1016\/j.future.2016.11.011","volume":"78","author":"M Tao","year":"2018","unstructured":"Tao M, Zuo J, Liu Z, Castiglione A, Palmieri F. Multi-layer cloud architectural model and ontology-based security service framework for IoT-based smart homes. Future Gener Comput Syst. 2018;78:1040\u201351.","journal-title":"Future Gener Comput Syst"},{"key":"519_CR11","doi-asserted-by":"publisher","unstructured":"Dreibholz T, Mazumdar S, Zahid F, Taherkordi A, Gran EG. Mobile edge as part of the multi-cloud ecosystem: a performance study. In: 2019 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), Pavia, Italy; 2019. pp. 59\u201366. https:\/\/doi.org\/10.1109\/EMPDP.2019.8671599.","DOI":"10.1109\/EMPDP.2019.8671599"},{"issue":"3","key":"519_CR12","doi-asserted-by":"publisher","first-page":"45","DOI":"10.2753\/MIS0742-1222240302","volume":"24","author":"K Peffers","year":"2007","unstructured":"Peffers K, Tuunanen T, Rothenberger M, Chatterjee S. A design science research methodology for information systems research. J Manag Inf Syst. 2007;24(3):45\u201377.","journal-title":"J Manag Inf Syst"},{"key":"519_CR13","unstructured":"Prat N, Comyn-Wattiau I, Akoka J. Artifact evaluation in information systems design-science research\u2014a holistic view. In: PACIS; 2014. p. 23."},{"key":"519_CR14","unstructured":"Carvalho J\u00c1. Validation criteria for the outcomes of design research. In: Pre-ECIS workshop on IT artefact design and work practice intervention; 2012."},{"key":"519_CR15","doi-asserted-by":"crossref","unstructured":"McCarthy MA, Herger LM, Khan SM, Belgodere BM (2015) Composable DevOps: automated ontology-based DevOps maturity analysis. In: In 2015 IEEE international conference on services computing, IEEE, pp. 600-607).","DOI":"10.1109\/SCC.2015.87"},{"key":"519_CR16","doi-asserted-by":"crossref","unstructured":"Arta\u010d M, Borov\u0161ak T, Di Nitto E, Guerriero M, Tamburri DA. Model-driven continuous deployment for quality DevOps. In: Proceedings of the 2nd international workshop on quality-aware DevOps. New York: ACM; 2016. pp. 40\u201341.","DOI":"10.1145\/2945408.2945417"},{"key":"519_CR17","doi-asserted-by":"publisher","unstructured":"Samarawickrama, Saliya Sajith, and Indika Perera. Continuous Scrum: A Framework to Enhance Scrum with DevOps. 2017 Seventeenth International Conference on Advances in ICT for Emerging Regions (ICTer), 2017. https:\/\/doi.org\/10.1109\/icter.2017.8257808.\u00a0","DOI":"10.1109\/icter.2017.8257808"},{"key":"519_CR18","doi-asserted-by":"crossref","unstructured":"Karapantelakis A, Liang H, Wang K, Vandikas K, Inam R, Fersman E, Mulas-Viela I, Seyvet N, Giannokostas V. DevOps for IoT applications using cellular networks and cloud. In: 2016 IEEE 4th international conference on future internet of things and cloud (FiCloud). IEEE; 2016. pp. 340\u2013347.","DOI":"10.1109\/FiCloud.2016.55"},{"key":"519_CR19","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1016\/j.future.2015.07.017","volume":"56","author":"J Wettinger","year":"2016","unstructured":"Wettinger J, Breitenb\u00fccher U, Kopp O, Leymann F. Streamlining DevOps automation for cloud applications using TOSCA as standardized metamodel. Future Gener Comput Syst. 2016;56:317\u201332.","journal-title":"Future Gener Comput Syst"},{"key":"519_CR20","doi-asserted-by":"crossref","unstructured":"Soni M. End to end automation on cloud with build pipeline: the case for DevOps in insurance industry, continuous integration, continuous testing, and continuous delivery. In: IEEE international conference on cloud computing in emerging markets 2015. Piscataway: IEEE; 2015. pp. 85\u201389.","DOI":"10.1109\/CCEM.2015.29"},{"key":"519_CR21","doi-asserted-by":"publisher","unstructured":"Syed MH, Fernandez EB. Cloud ecosystems support for internet of things and DevOps using patterns. In: 2016 IEEE first international conference on internet-of-things design and implementation (IoTDI). Berlin; 2016. pp. 301\u2013304. https:\/\/doi.org\/10.1109\/IoTDI.2015.31.","DOI":"10.1109\/IoTDI.2015.31"},{"key":"519_CR22","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1016\/j.future.2016.05.041","volume":"78","author":"K Douzis","year":"2018","unstructured":"Douzis K, Sotiriadis S, Petrakis EG, Amza C. Modular and generic IoT management on the cloud. Future Gener Comput Syst. 2018;78:369\u201378.","journal-title":"Future Gener Comput Syst"},{"issue":"2","key":"519_CR23","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1145\/3125621","volume":"18","author":"N Ferry","year":"2018","unstructured":"Ferry N, Chauvel F, Song H, Rossini A, Lushpenko M, Solberg A. CloudMF: model-driven management of multi-cloud applications. ACM Trans Internet Technol. 2018;18(2):16.","journal-title":"ACM Trans Internet Technol"},{"key":"519_CR24","doi-asserted-by":"crossref","unstructured":"Yonezawa T, Ito T, Nakazawa J, Tokuda H. Soxfire: a universal sensor network system for sharing social big sensor data in smart cities. In: Proceedings of the 2nd international workshop on smart. New York: ACM; 2016. p. 2.","DOI":"10.1145\/3009912.3009922"},{"key":"519_CR25","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.comcom.2016.03.012","volume":"89","author":"E Cavalcante","year":"2016","unstructured":"Cavalcante E, Pereira J, Alves MP, Maia P, Moura R, Batista T, Delicato FC, Pires PF. On the interplay of Internet of Things and cloud computing: a systematic mapping study. Comput Commun. 2016;89:17\u201333.","journal-title":"Comput Commun"},{"key":"519_CR26","doi-asserted-by":"crossref","unstructured":"Khakimov A, Muthanna A, Kirichek R, Koucheryavy A, Muthanna MSA. Investigation of methods for remote control IoT-devices based on cloud platforms and different interaction protocols. In: IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering 2017. Piscataway: IEEE; 2017. pp. 160\u2013163.","DOI":"10.1109\/EIConRus.2017.7910518"},{"issue":"3","key":"519_CR27","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1109\/MWC.2017.1600421","volume":"24","author":"I Yaqoob","year":"2017","unstructured":"Yaqoob I, Ahmed E, Hashem IAT, Ahmed AIA, Gani A, Imran M, Guizani M. Internet of Things architecture: recent advances, taxonomy, requirements, and open challenges. IEEE Wirel Commun. 2017;24(3):10\u20136.","journal-title":"IEEE Wirel Commun"},{"key":"519_CR28","doi-asserted-by":"publisher","first-page":"784","DOI":"10.1016\/j.jss.2017.06.037","volume":"137","author":"L Guti\u00e9rrez-Madro\u00f1al","year":"2018","unstructured":"Guti\u00e9rrez-Madro\u00f1al L, Medina-Bulo I, Dom\u00ednguez-Jim\u00e9nez JJ. IoT\u2013TEG: test event generator system. J Syst Softw. 2018;137:784\u2013803.","journal-title":"J Syst Softw"},{"key":"519_CR29","doi-asserted-by":"publisher","first-page":"684","DOI":"10.1016\/j.future.2015.09.021","volume":"56","author":"A Botta","year":"2016","unstructured":"Botta A, De Donato W, Persico V, Pescap\u00e9 A. Integration of cloud computing and internet of things: a survey. Future Gener Comput Syst. 2016;56:684\u2013700.","journal-title":"Future Gener Comput Syst"},{"key":"519_CR30","doi-asserted-by":"crossref","unstructured":"Leite J, Batista T, Oquendo F. Architecting IoT applications with SysADL. In: IEEE international conference on software architecture workshops 2017. Piscataway: IEEE; 2017. pp. 92\u201399.","DOI":"10.1109\/ICSAW.2017.57"},{"issue":"6","key":"519_CR31","doi-asserted-by":"publisher","first-page":"1146","DOI":"10.1109\/JIOT.2016.2564428","volume":"3","author":"P Kolios","year":"2016","unstructured":"Kolios P, Panayiotou C, Ellinas G, Polycarpou M. Data-driven event triggering for IoT applications. IEEE Internet Things J. 2016;3(6):1146\u201358.","journal-title":"IEEE Internet Things J"},{"key":"519_CR32","doi-asserted-by":"crossref","unstructured":"Yasaki K, Ito H, Nimura K. Dynamic reconfigurable wireless connection between smartphone and gateway. In: IEEE 39th annual computer software and applications conference 2015, vol. 3. Piscataway: IEEE; 2015. pp. 228\u2013233.","DOI":"10.1109\/COMPSAC.2015.234"},{"key":"519_CR33","doi-asserted-by":"publisher","first-page":"6974","DOI":"10.1109\/ACCESS.2016.2615181","volume":"4","author":"ZB Babovic","year":"2016","unstructured":"Babovic ZB, Protic J, Milutinovic V. Web performance evaluation for the internet of things applications. IEEE Access. 2016;4:6974\u201392.","journal-title":"IEEE Access"},{"key":"519_CR34","doi-asserted-by":"publisher","first-page":"1134","DOI":"10.1016\/j.procs.2017.05.436","volume":"109","author":"A Alkhalil","year":"2017","unstructured":"Alkhalil A, Ramadan RA. IoT data provenance implementation challenges. Procedia Comput Sci. 2017;109:1134\u20139.","journal-title":"Procedia Comput Sci"},{"key":"519_CR35","doi-asserted-by":"crossref","unstructured":"Sen S. Context-aware energy-efficient communication for IoT sensor nodes. In: 53nd ACM\/EDAC\/IEEE design automation conference 2016. Piscataway, IEEE; 2016. pp. 1\u20136.","DOI":"10.1145\/2897937.2905005"},{"issue":"8","key":"519_CR36","doi-asserted-by":"publisher","first-page":"3809","DOI":"10.1016\/j.eswa.2013.12.017","volume":"41","author":"A Jula","year":"2014","unstructured":"Jula A, Sundararajan E, Othman Z. Cloud computing service composition: a systematic literature review. Expert Syst Appl. 2014;41(8):3809\u201324.","journal-title":"Expert Syst Appl"},{"issue":"2","key":"519_CR37","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1109\/TETC.2016.2520883","volume":"4","author":"D Sun","year":"2016","unstructured":"Sun D, Fu M, Zhu L, Li G, Lu Q. Non-intrusive anomaly detection with streaming performance metrics and logs for DevOps in public clouds: a case study in AWS. IEEE Trans Emerg Top Comput. 2016;4(2):278\u201389. https:\/\/doi.org\/10.1109\/TETC.2016.2520883.","journal-title":"IEEE Trans Emerg Top Comput"},{"key":"519_CR38","volume-title":"Handbook of cloud computing: basic to advance research on the concepts and design of cloud computing","author":"A Nayyar","year":"2019","unstructured":"Nayyar A. Handbook of cloud computing: basic to advance research on the concepts and design of cloud computing. Delhi: BPB Publications; 2019."},{"issue":"2","key":"519_CR39","doi-asserted-by":"publisher","first-page":"399","DOI":"10.12694\/scpe.v20i2.1537","volume":"20","author":"P Singh","year":"2019","unstructured":"Singh P, Gupta P, Jyoti K, Nayyar A. Research on auto-scaling of web applications in cloud: survey, trends and future directions. Scalable Comput Pract Exp. 2019;20(2):399\u2013432.","journal-title":"Scalable Comput Pract Exp"},{"key":"519_CR40","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1016\/j.future.2016.06.019","volume":"70","author":"W Li","year":"2017","unstructured":"Li W, Santos I, Delicato FC, Pires PF, Pirmez L, Wei W, Song H, Zomaya A, Khan S. System modeling and performance evaluation of a three-tier cloud of things. Future Gener Comput Syst. 2017;70:104\u201325.","journal-title":"Future Gener Comput Syst"},{"key":"519_CR41","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1016\/j.procs.2015.09.231","volume":"68","author":"J Domaschka","year":"2015","unstructured":"Domaschka J, Griesinger F, Baur D, Rossini A. Beyond mere application structure thoughts on the future of cloud orchestration tools. Procedia Comput Sci. 2015;68:151\u201362.","journal-title":"Procedia Comput Sci"},{"issue":"2","key":"519_CR42","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1145\/3106158","volume":"18","author":"F Willnecker","year":"2018","unstructured":"Willnecker F, Krcmar H. Multi-objective optimization of deployment topologies for distributed applications. ACM Trans Internet Technol. 2018;18(2):21.","journal-title":"ACM Trans Internet Technol"},{"key":"519_CR43","doi-asserted-by":"crossref","unstructured":"Kritikos K, Plexousakis D. Multi-cloud application design through cloud service composition. In: IEEE 8th International Conference on Cloud Computing 2015. Piscataway: IEEE; 2015. pp. 686\u2013693.","DOI":"10.1109\/CLOUD.2015.96"},{"key":"519_CR44","doi-asserted-by":"crossref","unstructured":"Yasrab R, Gu N. Multi-cloud PaaS Architecture (MCPA): a solution to cloud lock-in. In: 3rd international conference on information science and control engineering 2016. Piscataway: IEEE; 2016. pp. 473\u2013477.","DOI":"10.1109\/ICISCE.2016.108"},{"issue":"1\u20134","key":"519_CR45","doi-asserted-by":"publisher","first-page":"895","DOI":"10.1007\/s00170-015-8177-9","volume":"86","author":"C Yang","year":"2016","unstructured":"Yang C, Shen W, Lin T, Wang X. A hybrid framework for integrating multiple manufacturing clouds. Int J Adv Manuf Technol. 2016;86(1\u20134):895\u2013911.","journal-title":"Int J Adv Manuf Technol"},{"key":"519_CR46","doi-asserted-by":"crossref","unstructured":"Slawik M, Blanchet C, Demchenko Y, Turkmen F, Ilyushkin A, de Laat C, Loomis C. CYCLONE: the multi-cloud middleware stack for application deployment and management. In: IEEE international conference on cloud computing technology and science 2017. Piscataway: IEEE; 2017. pp. 347\u2013352.","DOI":"10.1109\/CloudCom.2017.56"},{"key":"519_CR47","first-page":"6","volume-title":"Cloud migration patterns: a multi-cloud service architecture perspective, Service-Oriented Computing-ICSOC 2014 Workshops","author":"P Jamshidi","year":"2015","unstructured":"Jamshidi P, Pahl C, Chinenyeze S, Liu X. Cloud migration patterns: a multi-cloud service architecture perspective, Service-Oriented Computing-ICSOC 2014 Workshops. Cham: Springer; 2015. p. 6\u201319."},{"key":"519_CR48","doi-asserted-by":"crossref","unstructured":"Shekhar S, Gokhale A. Enabling IoT applications via dynamic cloud-edge resource management. In: IEEE\/ACM second international conference on internet-of-things design and implementation 2017. Piscataway: IEEE; 2017. pp. 331\u2013332.","DOI":"10.1145\/3054977.3057307"},{"key":"519_CR49","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1016\/j.procs.2016.08.285","volume":"97","author":"B Di Martino","year":"2016","unstructured":"Di Martino B, Esposito A. Semantic techniques for multi-cloud applications portability and interoperability. Procedia Comput Sci. 2016;97:104\u201313.","journal-title":"Procedia Comput Sci"},{"issue":"1","key":"519_CR50","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1109\/TNSM.2018.2889009","volume":"16","author":"C Diekmann","year":"2019","unstructured":"Diekmann C, Naab J, Korsten A, Carle G. Agile network access control in the container age. IEEE Trans Netw Serv Manag. 2019;16(1):41\u201355. https:\/\/doi.org\/10.1109\/TNSM.2018.2889009.","journal-title":"IEEE Trans Netw Serv Manag"},{"issue":"12","key":"519_CR51","doi-asserted-by":"publisher","first-page":"2759","DOI":"10.1109\/TPDS.2019.2926979","volume":"30","author":"Z Hong","year":"2019","unstructured":"Hong Z, Chen W, Huang H, Guo S, Zheng Z. Multi-Hop cooperative computation offloading for industrial IoT\u2013Edge\u2013Cloud computing environments. IEEE Trans Parallel Distrib Syst. 2019;30(12):2759\u201374.","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"519_CR52","doi-asserted-by":"publisher","unstructured":"Berger S, H\u00e4ckel B, H\u00e4fner L. Organizing Self-Organizing Systems: A Terminology, Taxonomy, and Reference Model for Entities in Cyber-Physical Production Systems.\u00a0Inf Syst Front. 2019. https:\/\/doi.org\/10.1007\/s10796-019-09952-8.","DOI":"10.1007\/s10796-019-09952-8"},{"issue":"2","key":"519_CR53","doi-asserted-by":"publisher","first-page":"337","DOI":"10.25300\/MISQ\/2013\/37.2.01","volume":"37","author":"S Gregor","year":"2013","unstructured":"Gregor S, Hevner AR. Positioning and presenting design science research for maximum impact. MIS Q. 2013;37(2):337\u201355.","journal-title":"MIS Q"},{"issue":"7","key":"519_CR54","doi-asserted-by":"publisher","first-page":"128","DOI":"10.26803\/ijlter.18.7.9","volume":"18","author":"G Bou Ghantous","year":"2019","unstructured":"Bou Ghantous G, Gill AQ. An agile-DevOps reference architecture for teaching enterprise agile. Int J Learn Teach Educ Res. 2019;18(7):128\u201344.","journal-title":"Int J Learn Teach Educ Res"},{"issue":"2","key":"519_CR55","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1007\/s10664-008-9102-8","volume":"14","author":"P Runeson","year":"2009","unstructured":"Runeson P, H\u00f6st M. Guidelines for conducting and reporting case study research in software engineering. Empir Softw Eng. 2009;14(2):131.","journal-title":"Empir Softw Eng"},{"key":"519_CR56","doi-asserted-by":"crossref","unstructured":"Jedlitschka A, Pfahl D. Reporting guidelines for controlled experiments in software engineering. In: 2005 international symposium on empirical software engineering. IEEE; 2005. pp. 10.","DOI":"10.1109\/ISESE.2005.1541818"},{"key":"519_CR57","unstructured":"Hyndman RJ. Quantitative Business Research Methods. Department of Econometrics and Business Statistics Monash University (Clayton campus). Vic 3800. DBA6000; 2008."},{"key":"519_CR58","doi-asserted-by":"publisher","unstructured":"Kao CH. Continuous evaluation for application development on cloud computing environments. In: 2017 international conference on applied system innovation (ICASI), Sapporo, 2017, pp. 1457\u20131460. https:\/\/doi.org\/10.1109\/ICASI.2017.7988191.","DOI":"10.1109\/ICASI.2017.7988191"},{"key":"519_CR59","doi-asserted-by":"crossref","unstructured":"Venable J, Pries-Heje J, Baskerville R. A comprehensive framework for evaluation in design science research. In: International conference on design science research in information systems. Berlin: Springer; 2012. pp. 423\u2013438.","DOI":"10.1007\/978-3-642-29863-9_31"}],"container-title":["SN Computer Science"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-021-00519-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s42979-021-00519-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-021-00519-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T13:36:43Z","timestamp":1671457003000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s42979-021-00519-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,1]]},"references-count":59,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,4]]}},"alternative-id":["519"],"URL":"https:\/\/doi.org\/10.1007\/s42979-021-00519-6","relation":{},"ISSN":["2662-995X","2661-8907"],"issn-type":[{"value":"2662-995X","type":"print"},{"value":"2661-8907","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,1]]},"assertion":[{"value":"4 November 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 February 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with Ethical Standards"}},{"value":"Conceptualization, virtualization, methodology, formal analysis, investigation, and validation were prepared and conducted by Dr Georges Bou Ghantous. Dr Georges Bou Ghantous developed the software for the proof of concept. Dr Georges Bou Ghantous acquired resources and funding. The original draft of the manuscript was prepared and written by Dr Georges Bou Ghantous. All authors managed the project. A. Prof Asif Qumer Gill completed the manuscript writing (review and editing). A. Prof Asif Qumer Gill supervised the research project.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"123"}}