{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T11:26:30Z","timestamp":1780053990389,"version":"3.54.0"},"reference-count":73,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,2,27]],"date-time":"2020-02-27T00:00:00Z","timestamp":1582761600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Evaluating the performance of self-adaptive systems is challenging due to their interactions with often highly dynamic environments. In the specific case of self-healing systems, the performance evaluations of self-healing approaches and their parameter tuning rely on the considered characteristics of failure occurrences and the resulting interactions with the self-healing actions. In this paper, we first study the state-of-the-art for evaluating the performances of self-healing systems by means of a systematic literature review. We provide a classification of different input types for such systems and analyse the limitations of each input type. A main finding is that the employed inputs are often not sophisticated regarding the considered characteristics for failure occurrences. To further study the impact of the identified limitations, we present experiments demonstrating that wrong assumptions regarding the characteristics of the failure occurrences can result in large performance prediction errors, disadvantageous design-time decisions concerning the selection of alternative self-healing approaches, and disadvantageous deployment-time decisions concerning parameter tuning. Furthermore, the experiments indicate that employing multiple alternative input characteristics can help with reducing the risk of premature disadvantageous design-time decisions.<\/jats:p>","DOI":"10.3390\/computers9010016","type":"journal-article","created":{"date-parts":[[2020,2,28]],"date-time":"2020-02-28T09:30:36Z","timestamp":1582882236000},"page":"16","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Evaluation of Self-Healing Systems: An Analysis of the State-of-the-Art and Required Improvements"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0697-9195","authenticated-orcid":false,"given":"Sona","family":"Ghahremani","sequence":"first","affiliation":[{"name":"Hasso Plattner Institute, University of Potsdam, Prof.-Dr.-Helmert-Str. 2-3, D-14482 Potsdam, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4723-730X","authenticated-orcid":false,"given":"Holger","family":"Giese","sequence":"additional","affiliation":[{"name":"Hasso Plattner Institute, University of Potsdam, Prof.-Dr.-Helmert-Str. 2-3, D-14482 Potsdam, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"de Lemos, R., Garlan, D., Ghezzi, C., and Giese, H. (2017). Challenges in Composing and Decomposing Assurances for Self-Adaptive Systems. SEfSAS III: Assurances, Springer.","DOI":"10.1007\/978-3-319-74183-3"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Farahani, A., Nazemi, E., Cabri, G., and Rafizadeh, A. (2016, January 9\u201312). An evaluation method for Self-Adaptive systems. Proceedings of the SMC \u201916 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary.","DOI":"10.1109\/SMC.2016.7844665"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Raibulet, C., Fontana, F.A., Capilla, R., and Carrillo, C. (2017). Chapter 13\u2014An Overview on Quality Evaluation of Self-Adaptive Systems, Morgan Kaufmann.","DOI":"10.1016\/B978-0-12-802855-1.00013-7"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/s00607-010-0107-y","article-title":"A survey on self-healing systems: Approaches and systems","volume":"91","author":"Psaier","year":"2011","journal-title":"Computing"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"de Sousa, A.O., Bezerra, C.I.M., Andrade, R.M.C., and Filho, J.M.S.M. (2019). Quality Evaluation of Self-Adaptive Systems: Challenges and Opportunities. Proceedings of the XXXIII Brazilian Symposium on Software Engineering, Salvador, Brazil, 2019, ACM.","DOI":"10.1145\/3350768.3352455"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Weyns, D., Iftikhar, M.U., Malek, S., and Andersson, J. (2012, January 4\u20135). Claims and Supporting Evidence for Self-adaptive Systems: A Literature Study. Proceedings of the SEAMS \u201912 2012 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), Zurich, Switzerland.","DOI":"10.1109\/SEAMS.2012.6224395"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Neti, S., and Muller, H.A. (2007, January 20\u201326). Quality Criteria and an Analysis Framework for Self-Healing Systems. Proceedings of the 2007 International Workshop on Software Engineering for Adaptive and Self-Managing Systems, Minneapolis, MN, USA.","DOI":"10.1109\/SEAMS.2007.15"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Pearson, S., Campos, J., Just, R., Fraser, G., Abreu, R., Ernst, M.D., Pang, D., and Keller, B. (2017, January 20\u201328). Evaluating and Improving Fault Localization. Proceedings of the ICSE \u201917 2017 IEEE\/ACM 39th International Conference on Software Engineering (ICSE), Buenos Aires, Argentina.","DOI":"10.1109\/ICSE.2017.62"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ghahremani, S., and Giese, H. (2019, January 16\u201320). Performance Evaluation for Self-Healing Systems: Current Practice & Open Issues. Proceedings of the 2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W), Ume\u00e5, Sweden.","DOI":"10.1109\/FAS-W.2019.00039"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kaddoum, E., Raibulet, C., Georg\u00e9, J.P., Picard, G., and Gleizes, M.P. (2010, January 1\u20138). Criteria for the Evaluation of Self-* Systems. Proceedings of the SEAMS \u201910 2010 ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems, Cape Town, South Africa.","DOI":"10.1145\/1808984.1808988"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Gallet, M., Yigitbasi, N., Javadi, B., Kondo, D., Iosup, A., and Epema, D. (2010). A Model for Space-Correlated Failures in Large-Scale Distributed Systems. Euro-Par 2010\u2014Parallel Processing: 16th International Euro-Par Conference, Ischia, Italy, 31 August\u20133 September 2010, Springer. Proceedings, Part I.","DOI":"10.1007\/978-3-642-15277-1_10"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Vogel, T. (2018, January 28\u201329). mRUBiS: An Exemplar for Model-Based Architectural Self-Healing and Self-Optimization. Proceedings of the SEAMS \u201918 International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Gothenburg, Sweden.","DOI":"10.1145\/3194133.3194161"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Patikirikorala, T., Colman, A., Han, J., and Wang, L. (2012, January 4\u20135). A Systematic Survey on the Design of Self-adaptive Software Systems Using Control Engineering Approaches. Proceedings of the SEAMS \u201912 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Z\u00fcrich, Switzerland.","DOI":"10.1109\/SEAMS.2012.6224389"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1109\/TDSC.2004.2","article-title":"Basic Concepts and Taxonomy of Dependable and Secure Computing","volume":"1","author":"Avizienis","year":"2004","journal-title":"IEEE Trans. Dependable Secur. Comput."},{"key":"ref_15","unstructured":"Egyed, A. (November, January 31). Architecture differencing for self management. Proceedings of the 1st ACM SIGSOFT Workshop on Self-Managed Systems, Newport Beach, CA, USA."},{"key":"ref_16","unstructured":"Koopman, P. (2013, January 15\u201317). Elements of the Self-Healing System Problem Space. Proceedings of the WADS 2003, Waterloo, ON, Canada."},{"key":"ref_17","unstructured":"Heinis, T., Pautasso, C., and Alonso, G. (2005, January 13\u201316). Design and Evaluation of an Autonomic Workflow Engine. Proceedings of the Second International Conference on Autonomic Computing (ICAC\u201905), Seattle, WA, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1016\/j.peva.2009.12.001","article-title":"Evaluating the adaptivity of computing systems","volume":"67","author":"Reinecke","year":"2010","journal-title":"Perform. Eval."},{"key":"ref_19","first-page":"50","article-title":"Robustness-Driven Resilience Evaluation of Self-Adaptive Software Systems","volume":"14","author":"Laranjeiro","year":"2017","journal-title":"IEEE Trans. Dependable Secur. Comput."},{"key":"ref_20","unstructured":"Kitchenham, B.A., and Charters, S. (2007). Guidelines for Performing Systematic Literature Reviews in Software Engineering, Keele University. Technical Report EBSE-2007-01."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Riganelli, O., Micucci, D., and Mariani, L. (2017, January 22\u201323). Policy Enforcement with Proactive Libraries. Proceedings of the SEAMS \u201917 2017 IEEE\/ACM 12th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), Buenos Aires, Argentina.","DOI":"10.1109\/SEAMS.2017.9"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Schmitt, J., Roth, M., Kiefhaber, R., Kluge, F., and Ungerer, T. (2011, January 17\u201319). Realizing Self-x Properties by an Automated Planner. Proceedings of the ICAC \u201911 8th ACM international conference on Autonomic Computing, New York, NY, USA.","DOI":"10.1145\/1998582.1998620"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ehlers, J., van Hoorn, A., Waller, J., and Hasselbring, W. (2011, January 17\u201319). Self-adaptive Software System Monitoring for Performance Anomaly Localization. Proceedings of the ICAC \u201911 8th ACM international conference on Autonomic Computing, New York, NY, USA.","DOI":"10.1145\/1998582.1998628"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Salehie, M., and Tahvildari, L. (2006, January 21\u201322). A Coordination Mechanism for Self-healing and Self-optimizing Disciplines. Proceedings of the SEAMS \u201906 2006 International Workshop on Self-Adaptation and Self-Managing Systems, Shanghai, China.","DOI":"10.1145\/1137677.1137701"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Camara, J., and de Lemos, R. (2012, January 4\u20135). Evaluation of resilience in self-adaptive systems using probabilistic model-checking. Proceedings of the SEAMS \u201912 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Z\u00fcrich, Switzerland.","DOI":"10.1109\/SEAMS.2012.6224391"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Haupt, T. (2012, January 4\u20135). Towards Mediation-based Self-healing of Data-driven Business Processes. Proceedings of the SEAMS \u201912 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Z\u00fcrich, Switzerland.","DOI":"10.1109\/SEAMS.2012.6224400"},{"key":"ref_27","unstructured":"Brown, A.B., and Redlin, C. (2005, January 13\u201316). Measuring the Effectiveness of Self-Healing Autonomic Systems. Proceedings of the Second International Conference on Autonomic Computing (ICAC\u201905), Seattle, WA, USA."},{"key":"ref_28","unstructured":"Griffith, R., and Kaiser, G. (2016, January 2\u20136). A Runtime Adaptation Framework for Native C and Bytecode Applications. Proceedings of the ICAC \u201906 IEEE International Conference on Autonomic Computing, Dublin, Ireland."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Carzaniga, A., Gorla, A., and Pezz\u2019e, M. (2018, January 28\u201329). Self-healing by Means of Automatic Workarounds. Proceedings of the SEAMS \u201908 2008 International Workshop on Software Engineering for Adaptive and Self-Managing Systems, Gothenburg, Sweden.","DOI":"10.1145\/1370018.1370023"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Griffith, R., Kaiser, G., and L\u2019opez, J.A. (2009, January 15). Multi-perspective Evaluation of Self-healing Systems Using Simple Probabilistic Models. Proceedings of the ICAC \u201909 6th International Conference on Autonomic Computing, Barcelona, Spain.","DOI":"10.1145\/1555228.1555245"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Casanova, P., Garlan, D., Schmerl, B., and Abreu, R. (2013, January 20\u201321). Diagnosing Architectural Run-time Failures. Proceedings of the SEAMS \u201913 2013 8th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, San Francisco, CA, USA.","DOI":"10.1109\/SEAMS.2013.6595497"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Angelopoulos, K., Souza, V.E.S., and Mylopoulos, J. (2014, January 3\u20134). Dealing with Multiple Failures in Zanshin: A Control-theoretic Approach. Proceedings of the SEAMS 2014 9th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Hyderabad, India.","DOI":"10.1145\/2593929.2593936"},{"key":"ref_33","first-page":"4:1","article-title":"SHOWA: A Self-Healing Framework for Web-Based Applications","volume":"10","author":"Magalhaes","year":"2015","journal-title":"Trans. Auton. Adapt. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Piel, E., Gonzalez-Sanchez, A., Gross, H., and Van Gemund, A.J. (2011, January 3\u20137). Spectrum-Based Health Monitoring for Self-Adaptive Systems. Proceedings of the SASO \u201911 5th IEEE International Conference on Self-Adaptive and Self-Organizing Systems, Ann Arbor, MI, USA.","DOI":"10.1109\/SASO.2011.21"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Di Marco, A., Inverardi, P., and Spalazzese, R. (2013, January 20\u201321). Synthesizing Self-adaptive Connectors Meeting Functional and Performance Concerns. Proceedings of the SEAMS \u201913 2013 8th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, San Francisco, CA, USA.","DOI":"10.1109\/SEAMS.2013.6595500"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Albassam, E., Porter, J., Gomaa, H., and Menasce\u2019, D.A. (2017, January 17\u201321). DARE: A Distributed Adaptation and Failure Recovery Framework for Software Systems. Proceedings of the ICAC \u201917 2017 IEEE International Conference on Autonomic Computing (ICAC), Columbus, OH, USA.","DOI":"10.1109\/ICAC.2017.12"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kantert, J., Spiegelberg, H., Tomforde, S., H\u00e4hner, J., and M\u00fcller-Schloer, C. (2015, January 7\u201310). Distributed Rendering in an Open Self-Organised Trusted Desktop Grid. Proceedings of the ICAC \u201915 2015 IEEE International Conference on Autonomic Computing, Grenoble, France.","DOI":"10.1109\/ICAC.2015.66"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Kwak, K.J., Baryshnikov, Y.M., and Coffman, E.G. (2008, January 20\u201324). Self-Organizing Sleep-Wake Sensor Systems. Proceedings of the SASO \u201908 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems, Venezia, Italy.","DOI":"10.1109\/SASO.2008.15"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ishikawa, H., Courbot, A., and Nakajima, T. (2008, January 20\u201324). A Framework for Self-Healing Device Drivers. Proceedings of the SASO \u201908 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems, Venezia, Italy.","DOI":"10.1109\/SASO.2008.43"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Baresi, L., Guinea, S., and Saeedi, P. (2013, January 9\u201313). Self-managing Overlays for Infrastructure-less Networks. Proceedings of the SASO \u201913 2013 IEEE 7th International Conference on Self-Adaptive and Self-Organizing Systems, Philadelphia, PA, USA.","DOI":"10.1109\/SASO.2013.25"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Stojnic, N., and Schuldt, H. (2012, January 4\u20135). OSIRIS-SR: A Safety Ring for self-healing distributed composite service execution. Proceedings of the SEAMS \u201912 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Z\u00fcrich, Switzerland.","DOI":"10.1109\/SEAMS.2012.6224387"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Pournaras, E., Ballandies, M., Acharya, D., Thapa, M., and Brandt, B. (2018, January 28\u201329). Prototyping Self-Managed Interdependent Networks\u2014Self-Healing Synergies against Cascading Failures. Proceedings of the SEAMS \u201918 International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Gothenburg, Sweden.","DOI":"10.1145\/3194133.3194148"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ghahremani, S., Giese, H., and Vogel, T. (2017, January 17\u201321). Efficient Utility-Driven Self-Healing Employing Adaptation Rules for Large Dynamic Architectures. Proceedings of the 2017 IEEE International Conference on Autonomic Computing (ICAC), Columbus, OH, USA.","DOI":"10.1109\/ICAC.2017.35"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Chan, K.S.M., and Bishop, J. (2009, January 31). The design of a self-healing composition cycle for Web services. Proceedings of the SEAMS \u201909 2009 ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems, Atlanta, GA, USA.","DOI":"10.1109\/SEAMS.2009.5069070"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Duan, S., and Babu, S. (2008, January 2\u20136). Guided Problem Diagnosis through Active Learning. Proceedings of the ICAC \u201908 2008 International Conference on Autonomic Computing, Chicago, IL, USA.","DOI":"10.1109\/ICAC.2008.28"},{"key":"ref_46","unstructured":"Bohra, A., Neamtiu, I., Gallard, P., Sultan, F., and Iftode, L. (2004, January 17\u201318). Remote repair of operating system state using Backdoors. Proceedings of the ICAC \u201904 International Conference on Autonomic Computing, New York, NY, USA."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Klopper, B., Honiden, S., Meyer, J., and Tichy, M. (October, January 27). Planning with Utility and State Trajectory Constraints in Self-Healing Automotive Systems. Proceedings of the SASO \u201910 2010 Fourth IEEE International Conference on Self-Adaptive and Self-Organizing Systems, Budapest, Hungary.","DOI":"10.1109\/SASO.2010.16"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Renz, W., Preisler, T., and Sudeikat, J. (2012, January 10\u201314). Mesoscopic Stochastic Models for Validating Self-Organizing Multi-Agent Systems. Proceedings of the SASO \u201912 2012 IEEE Sixth International Conference on Self-Adaptive and Self-Organizing Systems Workshops, Lyon, France.","DOI":"10.1109\/SASOW.2012.29"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Audrito, G., Casadei, R., Damiani, F., and Viroli, M. (2017, January 18\u201322). Compositional Blocks for Optimal Self-Healing Gradients. Proceedings of the SASO \u201917 2017 IEEE 11th International Conference on Self-Adaptive and Self-Organizing Systems (SASO), Tucson, AZ, USA.","DOI":"10.1109\/SASO.2017.18"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ippoliti, D., and Zhou, X. (2012, January 16\u201320). A Self-tuning Self-optimizing Approach for Automated Network Anomaly Detection Systems. Proceedings of the ICAC \u201912 9th International Conference on Autonomic Computing, San Jose, CA, USA.","DOI":"10.1145\/2371536.2371551"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Haesevoets, R., Weyns, D., Holvoet, T., and Joosen, W. (2009, January 31). A formal model for self-adaptive and self-healing organizations. Proceedings of the SEAMS \u201909 2009 ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems, Atlanta, GA, USA.","DOI":"10.1109\/SEAMS.2009.5069080"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Anaya, I.D.P., Simko, V., Bourcier, J., Plouzeau, N., and J\u2019ez\u2019equel, J.M. (2014, January 3\u20134). A Prediction-driven Adaptation Approach for Self-adaptive Sensor Networks. Proceedings of the SEAMS 2014 9th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Hyderabad, India.","DOI":"10.1145\/2593929.2593941"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"J\u00e1nicke, M., Tomforde, S., and Sick, B. (2016, January 17\u201322). Towards Self-Improving Activity Recognition Systems Based on Probabilistic, Generative Models. Proceedings of the ICAC \u201916 2016 IEEE International Conference on Autonomic Computing (ICAC), Wurzburg, Germany.","DOI":"10.1109\/ICAC.2016.22"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Ghahremani, S., Adriano, C.M., and Giese, H. (2018, January 3\u20137). Training Prediction Models for Rule-Based Self-Adaptive Systems. Proceedings of the ICAC \u201918 15th IEEE International Conference on Autonomic Computing, At Trento, Italy.","DOI":"10.1109\/ICAC.2018.00031"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"C\u2019amara, J., Garlan, D., Schmerl, B., and Pandey, A. (2015, January 13\u201317). Optimal Planning for Architecture-based Self-adaptation via Model Checking of Stochastic Games. Proceedings of the SAC \u201915 30th Annual ACM Symposium on Applied Computing, Salamanca, Spain.","DOI":"10.1145\/2695664.2695680"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Kephart, J.O., and Walsh, W.E. (2004, January 7\u20139). An Artificial Intelligence Perspective on Autonomic Computing Policies. Proceedings of the IEEE POLICY\u201904 Fifth IEEE International Workshop on Policies for Distributed Systems and Networks, Yorktown Heights, NY, USA.","DOI":"10.1109\/POLICY.2004.1309145"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Ghahremani, S., Giese, H., and Vogel, T. (2016, January 12\u201316). Towards Linking Adaptation Rules to the Utility Function for Dynamic Architectures. Proceedings of the IEEE SASO \u201916 2016 IEEE 10th International Conference on Self-Adaptive and Self-Organizing Systems (SASO), Augsburg, Germany.","DOI":"10.1109\/SASO.2016.21"},{"key":"ref_58","first-page":"12:1","article-title":"Improving Scalability and Reward of Utility-Driven Self-Healing for Large Dynamic Architectures","volume":"14","author":"Ghahremani","year":"2020","journal-title":"ACM Trans. Auton. Adapt. Syst."},{"key":"ref_59","unstructured":"Seborg, D.E., Mellichamp, D.A., Edgar, T.F., and Doyle, F.J. (2011). Process Dynamics and Control, John Wiley & Sons. [3rd ed.]."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"2817","DOI":"10.1109\/TAC.2012.2195811","article-title":"Receding Horizon Temporal Logic Planning","volume":"57","author":"Wongpiromsarn","year":"2012","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.trc.2015.08.002","article-title":"Intermodal freight transport planning\u2014A receding horizon control approach","volume":"60","author":"Li","year":"2015","journal-title":"Transp. Res. Part C Emerg. Technol."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"658","DOI":"10.1109\/TC.1982.1676063","article-title":"Derivation and Calibration of a Transient Error Reliability Model","volume":"C-31","author":"Castillo","year":"1982","journal-title":"IEEE Trans. Comput."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/12.192214","article-title":"Dependability measurement and modeling of a multicomputer system","volume":"42","author":"Tang","year":"1993","journal-title":"IEEE Trans. Comput."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1109\/TC.1982.1676070","article-title":"A Statistical Failure\/Load Relationship: Results of a Multicomputer Study","volume":"C-31","author":"Iyer","year":"1982","journal-title":"IEEE Trans. Comput."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1145\/511399.511362","article-title":"Improving Cluster Availability Using Workstation Validation","volume":"30","author":"Heath","year":"2002","journal-title":"SIGMETRICS Perform. Eval. Rev."},{"key":"ref_66","unstructured":"Feitelson, D.G., Rudolph, L., and Schwiegelshohn, U. (2005). Performance Implications of Failures in Large-Scale Cluster Scheduling. Job Scheduling Strategies for Parallel Processing: 10th International Workshop, JSSPP 2004, Springer. Revised Selected Papers."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Iosup, A., Dumitrescu, C., Epema, D., Li, H., and Wolters, L. (2006, January 28\u201329). How Are Real Grids Used? The Analysis of Four Grid Traces and Its Implications. Proceedings of the GRID \u201906 7th IEEE\/ACM International Conference on Grid Computing, Barcelona, Spain.","DOI":"10.1109\/ICGRID.2006.311024"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Iosup, A., Jan, M., Sonmez, O., and Epema, D. (2007, January 19\u201321). On the Dynamic Resources Availability in Grids. Proceedings of the 8th IEEE\/ACM International Conference on Grid Computing, Austin, TX, USA.","DOI":"10.1109\/GRID.2007.4354112"},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Kondo, D., Javadi, B., Iosup, A., and Epema, D. (2010, January 17\u201320). The Failure Trace Archive: Enabling Comparative Analysis of Failures in Diverse Distributed Systems. Proceedings of the CCGRID \u201910 2010 10th IEEE\/ACM International Conference on Cluster, Cloud and Grid Computing, Melbourne, Australia.","DOI":"10.1109\/CCGRID.2010.71"},{"key":"ref_70","first-page":"6","article-title":"An Introduction to the bootstrap with applications in R","volume":"13","author":"Davison","year":"2002","journal-title":"Stat. Comput. Stat. Graph. Newsl."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Efron, B., and Tibshirani, R.J. (1993). An Introduction to the Bootstrap, Chapman & Hall.","DOI":"10.1007\/978-1-4899-4541-9"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Perino, N. (2013, January 18\u201326). A Framework for Self-healing Software Systems. Proceedings of the ICSE \u201913 2013 35th International Conference on Software Engineering (ICSE), San Francisco, CA, USA.","DOI":"10.1109\/ICSE.2013.6606726"},{"key":"ref_73","unstructured":"Sestoft, P. (2020, February 26). Microbenchmarks in Java and C#; Lecture Notes. Available online: https:\/\/www.itu.dk\/people\/sestoft\/papers\/benchmarking.pdf."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/9\/1\/16\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:02:16Z","timestamp":1760173336000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/9\/1\/16"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,27]]},"references-count":73,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["computers9010016"],"URL":"https:\/\/doi.org\/10.3390\/computers9010016","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,27]]}}}