{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T23:15:05Z","timestamp":1771024505542,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2024,5,5]],"date-time":"2024-05-05T00:00:00Z","timestamp":1714867200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,5]],"date-time":"2024-05-05T00:00:00Z","timestamp":1714867200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005044","name":"Keele University","doi-asserted-by":"publisher","award":["CSRDF22-23_1AA"],"award-info":[{"award-number":["CSRDF22-23_1AA"]}],"id":[{"id":"10.13039\/501100005044","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Computing"],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>One of the most popular models that provide computer resources today is cloud computing. Today\u2019s dynamic and successful platforms are created to take advantage of various resources available from service providers. Ensuring the performance and availability of such resources and services is a crucial problem. Any software system may be subject to faults that might propagate to cause failures. Such faults with the potential of contributing to failures are critical because they impair performance and result in a delayed reaction, which is regarded as a dependability problem. To ensure that critical faults can be discovered as soon as possible, the impact of such faults on the system must be tested. The performance and dependability of cloud-native systems are examined in this empirical study using fault injection, one of the chaos engineering techniques. The study explores the impacts and results of injecting various delay times into two cloud-native applications with diverse user numbers. The performance of the applications with various numbers of users is measured in relation to these delays, which accordingly reflects measuring the dependability of those systems. Firstly, the systems\u2019 architecture were identified, and serverless with two Lambda functions and containerised microservices applications were chosen, which depend on utilising and incorporating cloud-native services. Secondly, faults are injected in order to quantify performance attributes such as throughput and latency. The results of several controlled experiments carried out in real-world cloud environments provide exploratory empirical data, which promoted comparisons and statistical analysis that we utilised to identify the behaviour of the application while experiencing stress. Typical results from this investigation include an overall reduction in performance that is embodied in an increase in latency with injecting delays. However, a remarkable result is noticed at a particular delay in which defects and availability problems appear out of nowhere. These findings assist in highlighting the value of using chaos engineering in general and fault injection in particular to assess the dependability of cloud-native applications and to find unpredicted failures that could arise quickly from defects that aren\u2019t supposed to spread and result in dependability issues.<\/jats:p>","DOI":"10.1007\/s00607-024-01292-z","type":"journal-article","created":{"date-parts":[[2024,5,5]],"date-time":"2024-05-05T07:02:09Z","timestamp":1714892529000},"page":"2389-2425","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Exploring the impact of chaos engineering with various user loads on cloud native applications: an exploratory empirical study"],"prefix":"10.1007","volume":"106","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1144-3053","authenticated-orcid":false,"given":"Amro","family":"Al-Said Ahmad","sequence":"first","affiliation":[]},{"given":"Lamis F.","family":"Al-Qora\u2019n","sequence":"additional","affiliation":[]},{"given":"Ahmad","family":"Zayed","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,5,5]]},"reference":[{"issue":"7","key":"1292_CR1","doi-asserted-by":"publisher","first-page":"768","DOI":"10.3390\/electronics8070768","volume":"8","author":"LM Dang","year":"2019","unstructured":"Dang LM, Piran MJ, Han D, Min K, Moon H (2019) A survey on internet of things and cloud computing for healthcare. Electronics 8(7):768. https:\/\/doi.org\/10.3390\/electronics8070768","journal-title":"Electronics"},{"key":"1292_CR2","doi-asserted-by":"publisher","unstructured":"Alabbadi MM (2011) Cloud computing for education and learning: education and learning as a service (elaas). In: 2011 14th international conference on interactive collaborative learning, pp 589\u2013594. IEEE https:\/\/doi.org\/10.1109\/ICL.2011.6059655","DOI":"10.1109\/ICL.2011.6059655"},{"key":"1292_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/18479790221093992","volume":"14","author":"L Golightly","year":"2022","unstructured":"Golightly L, Chang V, Xu QA, Gao X, Liu BS (2022) Adoption of cloud computing as innovation in the organization. Int J Eng Bus Manage 14:1\u201317. https:\/\/doi.org\/10.1177\/18479790221093992","journal-title":"Int J Eng Bus Manage"},{"issue":"7","key":"1292_CR4","doi-asserted-by":"publisher","first-page":"1581","DOI":"10.1002\/spe.3076","volume":"52","author":"C Camacho","year":"2022","unstructured":"Camacho C, Ca\u00f1izares PC, Llana L, N\u00fa\u00f1ez A (2022) Chaos as a software product line-a platform for improving open hybrid-cloud systems resiliency. Softw Pract Exp 52(7):1581\u20131614. https:\/\/doi.org\/10.1002\/spe.3076","journal-title":"Softw Pract Exp"},{"key":"1292_CR5","doi-asserted-by":"publisher","unstructured":"Gokhroo MK, Govil MC, Pilli ES (2017) Detecting and mitigating faults in cloud computing environment. In: 2017 3rd international conference on computational intelligence and communication technology (CICT), pp 1\u20139. IEEE https:\/\/doi.org\/10.1109\/CIACT.2017.7977362","DOI":"10.1109\/CIACT.2017.7977362"},{"issue":"10","key":"1292_CR6","doi-asserted-by":"publisher","first-page":"1159","DOI":"10.1016\/j.jksuci.2018.09.021","volume":"33","author":"P Kumari","year":"2021","unstructured":"Kumari P, Kaur P (2021) A survey of fault tolerance in cloud computing. J King Saud Univ-Comput Inf Sci 33(10):1159\u20131176. https:\/\/doi.org\/10.1016\/j.jksuci.2018.09.021","journal-title":"J King Saud Univ-Comput Inf Sci"},{"issue":"1","key":"1292_CR7","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1109\/TDSC.2004.2","volume":"1","author":"A Avizienis","year":"2004","unstructured":"Avizienis A, Laprie J-C, Randell B, Landwehr C (2004) Basic concepts and taxonomy of dependable and secure computing. IEEE Trans Dependable Secure Comput 1(1):11\u201333. https:\/\/doi.org\/10.1109\/TDSC.2004.2","journal-title":"IEEE Trans Dependable Secure Comput"},{"key":"1292_CR8","doi-asserted-by":"publisher","unstructured":"Feinbube L, Pirl L, Polze A (2017) Software fault injection: a practical perspective. In: M\u00e1rquez FPG, Papaelias M (eds) Dependability engineering. IntechOpen, Rijeka. Chap. https:\/\/doi.org\/10.5772\/intechopen.70427","DOI":"10.5772\/intechopen.70427"},{"key":"1292_CR9","doi-asserted-by":"publisher","unstructured":"Chowdhury A, Tripathi P (2014) Enhancing cloud computing reliability using efficient scheduling by providing reliability as a service. In: 2014 international conference on parallel, distributed and grid computing, pp 99\u2013104. IEEE https:\/\/doi.org\/10.1109\/PDGC.2014.7030723","DOI":"10.1109\/PDGC.2014.7030723"},{"key":"1292_CR10","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/s11227-013-0898-7","volume":"66","author":"D Sun","year":"2013","unstructured":"Sun D, Chang G, Miao C, Wang X (2013) Analyzing, modeling and evaluating dynamic adaptive fault tolerance strategies in cloud computing environments. J Supercomput 66:193\u2013228. https:\/\/doi.org\/10.1007\/s11227-013-0898-7","journal-title":"J Supercomput"},{"key":"1292_CR11","unstructured":"Laprie J-C (2008) From dependability to resilience. In: 38th IEEE\/IFIP international conference on dependable systems and networks, pp 8\u20139"},{"key":"1292_CR12","doi-asserted-by":"publisher","DOI":"10.1145\/2841425","author":"R Natella","year":"2016","unstructured":"Natella R, Cotroneo D, Madeira HS (2016) Assessing dependability with software fault injection: a survey. ACM Comput Surv. https:\/\/doi.org\/10.1145\/2841425","journal-title":"ACM Comput Surv"},{"key":"1292_CR13","doi-asserted-by":"publisher","unstructured":"Piscitelli R, Bhasin S, Regazzoni F (2017) In: Sklavos N, Chaves R, Di\u00a0Natale G, Regazzoni F (eds) Fault attacks, injection techniques and tools for simulation, pp 27\u201347. Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-319-44318-8_2","DOI":"10.1007\/978-3-319-44318-8_2"},{"issue":"3","key":"1292_CR14","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1109\/MS.2016.60","volume":"33","author":"A Basiri","year":"2016","unstructured":"Basiri A, Behnam N, Rooij R, Hochstein L, Kosewski L, Reynolds J, Rosenthal C (2016) Chaos engineering. IEEE Softw 33(3):35\u201341. https:\/\/doi.org\/10.1109\/MS.2016.60","journal-title":"IEEE Softw"},{"key":"1292_CR15","doi-asserted-by":"publisher","unstructured":"Herscheid L, Richter D, Polze A (2015) Experimental assessment of cloud software dependability using fault injection. In: Camarinha-Matos LM, Baldissera TA, Di\u00a0Orio G, Marques F (eds) Technological innovation for cloud-based engineering systems, pp 121\u2013128. Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-319-16766-4_13","DOI":"10.1007\/978-3-319-16766-4_13"},{"key":"1292_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jss.2017.01.001","volume":"126","author":"N Kratzke","year":"2017","unstructured":"Kratzke N, Quint P-C (2017) Understanding cloud-native applications after 10 years of cloud computing\u2014a systematic mapping study. J Syst Softw 126:1\u201316. https:\/\/doi.org\/10.1016\/j.jss.2017.01.001","journal-title":"J Syst Softw"},{"key":"1292_CR17","doi-asserted-by":"publisher","unstructured":"Kounev S, Reinecke P, Brosig F, Bradley JT, Joshi K, Babka V, Stefanek A, Gilmore S (2012) In: Wolter K, Avritzer A, Vieira M, Moorsel A (eds) Providing dependability and resilience in the cloud: challenges and opportunities, pp 65\u201381. Springer, Berlin, Heidelberg. https:\/\/doi.org\/10.1007\/978-3-642-29032-9_4","DOI":"10.1007\/978-3-642-29032-9_4"},{"key":"1292_CR18","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/9502953","author":"S Lin","year":"2018","unstructured":"Lin S, Wang Y, Jia L (2018) System reliability assessment based on failure propagation processes. Complexity. https:\/\/doi.org\/10.1155\/2018\/9502953","journal-title":"Complexity"},{"issue":"4","key":"1292_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3236332","volume":"3","author":"N Herbst","year":"2018","unstructured":"Herbst N, Bauer A, Kounev S, Oikonomou G, Eyk EV, Kousiouris G, Evangelinou A, Krebs R, Brecht T, Abad CL et al (2018) Quantifying cloud performance and dependability: taxonomy, metric design, and emerging challenges. ACM Trans Model Perform Eval Comput Syst 3(4):1\u201336. https:\/\/doi.org\/10.1145\/3236332","journal-title":"ACM Trans Model Perform Eval Comput Syst"},{"issue":"4","key":"1292_CR20","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1145\/1721654.1721672","volume":"53","author":"M Armbrust","year":"2010","unstructured":"Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A, Lee G, Patterson D, Rabkin A, Stoica I et al (2010) A view of cloud computing. Commun ACM 53(4):50\u201358. https:\/\/doi.org\/10.1145\/1721654.1721672","journal-title":"Commun ACM"},{"issue":"4","key":"1292_CR21","doi-asserted-by":"publisher","first-page":"2695","DOI":"10.1109\/TDSC.2021.3069715","volume":"19","author":"L Zhang","year":"2021","unstructured":"Zhang L, Morin B, Baudry B, Monperrus M (2021) Maximizing error injection realism for chaos engineering with system calls. IEEE Trans Dependable Secure Comput 19(4):2695\u20132708. https:\/\/doi.org\/10.1109\/TDSC.2021.3069715","journal-title":"IEEE Trans Dependable Secure Comput"},{"key":"1292_CR22","doi-asserted-by":"publisher","unstructured":"Jaival M, Mkrtchyan K, Kaplan A (2022) Serverless cloud functions-opportunity in chaos. In: 2022 International conference on computational science and computational intelligence (CSCI), pp. 1330\u20131335. IEEE https:\/\/doi.org\/10.1109\/CSCI58124.2022.00239","DOI":"10.1109\/CSCI58124.2022.00239"},{"key":"1292_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110708","volume":"170","author":"J Scheuner","year":"2020","unstructured":"Scheuner J, Leitner P (2020) Function-as-a-service performance evaluation: a multivocal literature review. J Syst Softw 170:110708. https:\/\/doi.org\/10.1016\/j.jss.2020.110708","journal-title":"J Syst Softw"},{"key":"1292_CR24","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2022.111294","volume":"189","author":"S Eismann","year":"2022","unstructured":"Eismann S, Costa DE, Liao L, Bezemer C-P, Shang W, Hoorn A, Kounev S (2022) A case study on the stability of performance tests for serverless applications. J Syst Softw 189:111294. https:\/\/doi.org\/10.1016\/j.jss.2022.111294","journal-title":"J Syst Softw"},{"key":"1292_CR25","unstructured":"Scheuner J (2022) Performance evaluation of serverless applications and infrastructures. PhD thesis, Chalmers Tekniska Hogskola (Sweden)"},{"issue":"2","key":"1292_CR26","doi-asserted-by":"publisher","first-page":"1065","DOI":"10.1109\/TCC.2020.2973146","volume":"10","author":"F Cerveira","year":"2020","unstructured":"Cerveira F, Barbosa R, Madeira H, Araujo F (2020) The effects of soft errors and mitigation strategies for virtualization servers. IEEE Trans Cloud Comput 10(2):1065\u20131081. https:\/\/doi.org\/10.1109\/TCC.2020.2973146","journal-title":"IEEE Trans Cloud Comput"},{"issue":"1","key":"1292_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13677-021-00277-z","volume":"11","author":"A Al-Said Ahmad","year":"2022","unstructured":"Al-Said Ahmad A, Andras P (2022) Scalability resilience framework using application-level fault injection for cloud-based software services. J Cloud Comput 11(1):1\u201313. https:\/\/doi.org\/10.1186\/s13677-021-00277-z","journal-title":"J Cloud Comput"},{"key":"1292_CR28","doi-asserted-by":"publisher","unstructured":"Poltronieri F, Tortonesi M, Stefanelli C (2022) A chaos engineering approach for improving the resiliency of it services configurations. In: 2022 IEEE\/IFIP network operations and management symposium, pp 1\u20136. IEEE https:\/\/doi.org\/10.1109\/NOMS54207.2022.9789887","DOI":"10.1109\/NOMS54207.2022.9789887"},{"key":"1292_CR29","doi-asserted-by":"publisher","unstructured":"Naqvi MA, Malik S, Astekin M, Moonen L (2022) On evaluating self-adaptive and self-healing systems using chaos engineering. In: 2022 IEEE international conference on autonomic computing and self-organizing systems (ACSOS), pp 1\u201310. IEEE https:\/\/doi.org\/10.1109\/ACSOS55765.2022.00018","DOI":"10.1109\/ACSOS55765.2022.00018"},{"key":"1292_CR30","unstructured":"Zhu J (2021) Serverless chaos-measuring the performance and resilience of cloud function platforms"},{"key":"1292_CR31","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.jnca.2015.11.014","volume":"60","author":"M Nabi","year":"2016","unstructured":"Nabi M, Toeroe M, Khendek F (2016) Availability in the cloud: state of the art. J Netw Comput Appl 60:54\u201367. https:\/\/doi.org\/10.1016\/j.jnca.2015.11.014","journal-title":"J Netw Comput Appl"},{"key":"1292_CR32","doi-asserted-by":"publisher","DOI":"10.14569\/IJACSA.2016.070464","author":"S Aldossary","year":"2016","unstructured":"Aldossary S, Allen W (2016) Data security, privacy, availability and integrity in cloud computing: issues and current solutions. Int J Adv Comput Sci Appl. https:\/\/doi.org\/10.14569\/IJACSA.2016.070464","journal-title":"Int J Adv Comput Sci Appl"},{"key":"1292_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.dss.2016.09.001","volume":"93","author":"S Ding","year":"2017","unstructured":"Ding S, Wang Z, Wu D, Olson DL (2017) Utilizing customer satisfaction in ranking prediction for personalized cloud service selection. Decis Support Syst 93:1\u201310. https:\/\/doi.org\/10.1016\/j.dss.2016.09.001","journal-title":"Decis Support Syst"},{"issue":"2","key":"1292_CR34","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1109\/TSC.2018.2816644","volume":"14","author":"MA Mukwevho","year":"2018","unstructured":"Mukwevho MA, Celik T (2018) Toward a smart cloud: a review of fault-tolerance methods in cloud systems. IEEE Trans Serv Comput 14(2):589\u2013605. https:\/\/doi.org\/10.1109\/TSC.2018.2816644","journal-title":"IEEE Trans Serv Comput"},{"key":"1292_CR35","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111061","volume":"182","author":"M Waseem","year":"2021","unstructured":"Waseem M, Liang P, Shahin M, Di Salle A, M\u00e1rquez G (2021) Design, monitoring, and testing of microservices systems: the practitioners\u2019 perspective. J Syst Softw 182:111061. https:\/\/doi.org\/10.1016\/j.jss.2021.111061","journal-title":"J Syst Softw"},{"key":"1292_CR36","doi-asserted-by":"publisher","unstructured":"Eismann S, Bezemer C-P, Shang W, Okanovi\u0107 D, Hoorn A (2020) Microservices: a performance tester\u2019s dream or nightmare? In: Proceedings of the ACM\/SPEC international conference on performance engineering, pp 138\u2013149 . https:\/\/doi.org\/10.1145\/3358960.3379124","DOI":"10.1145\/3358960.3379124"},{"key":"1292_CR37","doi-asserted-by":"publisher","DOI":"10.36227\/techrxiv.24237196.v1","author":"V Raj","year":"2023","unstructured":"Raj V (2023) A framework for migration of microservices based applications to serverless platform with efficient cold start latency. Authorea Preprints. https:\/\/doi.org\/10.36227\/techrxiv.24237196.v1","journal-title":"Authorea Preprints"}],"container-title":["Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00607-024-01292-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00607-024-01292-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00607-024-01292-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,24]],"date-time":"2024-06-24T07:08:23Z","timestamp":1719212903000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00607-024-01292-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,5]]},"references-count":37,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["1292"],"URL":"https:\/\/doi.org\/10.1007\/s00607-024-01292-z","relation":{},"ISSN":["0010-485X","1436-5057"],"issn-type":[{"value":"0010-485X","type":"print"},{"value":"1436-5057","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,5]]},"assertion":[{"value":"12 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 April 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 May 2024","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"In this article, the ORCid was missing for the author Amro Al\u2011Said Ahmad . This has been corrected.","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"We declare no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All Authors approved the Manuscript.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}