{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T20:11:37Z","timestamp":1784232697373,"version":"3.55.0"},"reference-count":59,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T00:00:00Z","timestamp":1725926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>An increased interest in the resilience of complex socio-ecological and socio-technical systems has led to a variety of metrics being proposed. An overview of these metrics and their underlying concepts would support identifying useful metrics for applications in science and engineering. This study undertakes a scoping review of resilience metrics for systems straddling the societal, ecological, and technical domains to determine how resilience has been measured, the conceptual differences between the proposed approaches, and how they align with the domains of their case studies. We find that a wide variety of resilience metrics have been proposed in the literature. Conceptually, ten different quantification approaches were identified. Four different disturbance types were observed, including sudden, continuous, multiple, and abruptly ending disturbances. Surprisingly, there is no strong pattern regarding socio-ecological systems being studied using the \u201cecological resilience\u201d concept and socio-technical systems being studied using the \u201cengineering resilience\u201d concept. As a result, we recommend that researchers use multiple resilience metrics in the same study, ideally following different conceptual approaches, and compare the resulting insights. Furthermore, the used metrics should be mathematically defined, the included variables explained and their units provided, and the chosen functional form justified.<\/jats:p>","DOI":"10.3390\/systems12090357","type":"journal-article","created":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T04:35:24Z","timestamp":1725942924000},"page":"357","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Resilience Metrics for Socio-Ecological and Socio-Technical Systems: A Scoping Review"],"prefix":"10.3390","volume":"12","author":[{"given":"Patrick","family":"Steinmann","sequence":"first","affiliation":[{"name":"Faculty of Technology, Policy, and Management, Delft University of Technology, Jaffalaan 5, 2628 BX Delft, The Netherlands"},{"name":"Biometris, Wageningen University & Research, 6700 HB Wageningen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8804-0298","authenticated-orcid":false,"given":"Hilde","family":"Tobi","sequence":"additional","affiliation":[{"name":"Biometris, Wageningen University & Research, 6700 HB Wageningen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"George A. K.","family":"van Voorn","sequence":"additional","affiliation":[{"name":"Biometris, Wageningen University & Research, 6700 HB Wageningen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Berkes, F., Folke, C., and Colding, J. (2000). Linking Social and Ecological Systems: Management Practices and Social Mechanisms for Building Resilience, Cambridge University Press.","DOI":"10.1017\/CBO9780511541957"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1109\/TSMCA.2009.2025452","article-title":"System and actor perspectives on sociotechnical systems","volume":"39","author":"Herder","year":"2009","journal-title":"IEEE Trans. Syst. Man Cybern.-Part A Syst. Hum."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1038\/nature12047","article-title":"Globally networked risks and how to respond","volume":"497","author":"Helbing","year":"2013","journal-title":"Nature"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.envsoft.2015.04.003","article-title":"Regime shifts in coupled socio-environmental systems: Review of modelling challenges and approaches","volume":"75","author":"Filatova","year":"2016","journal-title":"Environ. Model. Softw."},{"key":"ref_5","first-page":"18156","article-title":"Perspectives on confronting issues of scale in systems modeling","volume":"4","author":"Iwanaga","year":"2022","journal-title":"Socio-Environ. Syst. Model."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1353\/pbm.1990.0004","article-title":"What Constitutes Ecosystem Health?","volume":"33","author":"Rapport","year":"1989","journal-title":"Perspect. Biol. Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/0921-8009(95)00059-3","article-title":"Economic growth, carrying capacity, and the environment","volume":"15","author":"Arrow","year":"1995","journal-title":"Ecol. Econ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"art5","DOI":"10.5751\/ES-00650-090205","article-title":"Resilience, Adaptability and Transformability in Social-ecological Systems","volume":"9","author":"Walker","year":"2004","journal-title":"Ecol. Soc."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1146\/annurev.ecolsys.35.021103.105711","article-title":"Regime Shifts, Resilience, and Biodiversity in Ecosystem Management","volume":"35","author":"Folke","year":"2004","journal-title":"Annu. Rev. Ecol. Evol. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"677","DOI":"10.2307\/2404808","article-title":"The Fragility of Ecosystems: A Review","volume":"32","author":"Nilsson","year":"1995","journal-title":"J. Appl. Ecol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"art23","DOI":"10.5751\/ES-02029-120123","article-title":"Focusing the Meaning(s) of Resilience: Resilience as a Descriptive Concept and a Boundary Object","volume":"12","author":"Brand","year":"2007","journal-title":"Ecol. Soc."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1146\/annurev-environ-051211-123836","article-title":"Toward Principles for Enhancing the Resilience of Ecosystem Services","volume":"37","author":"Biggs","year":"2012","journal-title":"Annu. Rev. Environ. Resour."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1086\/681439","article-title":"Promoting Resilience","volume":"90","author":"Desjardins","year":"2015","journal-title":"Q. Rev. Biol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1038\/269471a0","article-title":"Thresholds and breakpoints in ecosystems with a multiplicity of stable states","volume":"269","author":"May","year":"1977","journal-title":"Nature"},{"key":"ref_15","first-page":"32","article-title":"Engineering resilience versus ecological resilience","volume":"31","author":"Holling","year":"1996","journal-title":"Eng. Ecol. Constraints"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"art48","DOI":"10.5751\/ES-05231-170448","article-title":"A Theory on Urban Resilience to Floods\u2013A Basis for Alternative Planning Practices","volume":"17","author":"Liao","year":"2012","journal-title":"Ecol. Soc."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"100718","DOI":"10.1016\/j.ecocom.2018.06.008","article-title":"Exploring resilience with agent-based models: State of the art, knowledge gaps and recommendations for coping with multidimensionality","volume":"40","author":"Egli","year":"2019","journal-title":"Ecol. Complex."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.ecocom.2008.10.005","article-title":"Quantifying sustainability: Resilience, efficiency and the return of information theory","volume":"6","author":"Ulanowicz","year":"2009","journal-title":"Ecol. Complex."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Cika, A., Cohen, E., Kruszewski, G., Seet, L., Steinmann, P., and Yin, W. (2020, January 13\u201318). Resilient Life: An Exploration of Perturbed Autopoietic Patterns in Conway\u2019s Game of Life. Proceedings of the 2020 Conference on Artificial Life, Online.","DOI":"10.1162\/isal_a_00305"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.hazards.2004.02.001","article-title":"Resilience to natural hazards: How useful is this concept?","volume":"5","author":"Klein","year":"2003","journal-title":"Glob. Environ. Chang. Part B Environ. Hazards"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1111\/1365-2664.12550","article-title":"Measuring and assessing resilience: Broadening understanding through multiple disciplinary perspectives","volume":"53","author":"Quinlan","year":"2016","journal-title":"J. Appl. Ecol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.ress.2015.08.006","article-title":"A review of definitions and measures of system resilience","volume":"145","author":"Hosseini","year":"2016","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1080\/23789689.2018.1448663","article-title":"Resilience metrics and measurement methods for transportation infrastructure: The state of the art","volume":"5","author":"Sun","year":"2020","journal-title":"Sustain. Resilient Infrastruct."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lempert, R.J., Popper, S.W., and Bankes, S.C. (2003). Shaping the Next One Hundred Years: New Methods for Quantitative, Long-Term Policy Analysis, RAND.","DOI":"10.7249\/MR1626"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"100728","DOI":"10.1016\/j.ecocom.2018.07.007","article-title":"Agent-based modelling of socio-ecological systems: Models, projects and ontologies","volume":"40","author":"Gotts","year":"2019","journal-title":"Ecol. Complex."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"9024","DOI":"10.1029\/2019WR025462","article-title":"Identifying Actionable Compromises: Navigating Multi-City Robustness Conflicts to Discover Cooperative Safe Operating Spaces for Regional Water Supply Portfolios","volume":"55","author":"Gold","year":"2019","journal-title":"Water Resour. Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1890\/100068","article-title":"An integrated conceptual framework for long-term social\u2013ecological research","volume":"9","author":"Collins","year":"2011","journal-title":"Front. Ecol. Environ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"467","DOI":"10.7326\/M18-0850","article-title":"PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation","volume":"169","author":"Tricco","year":"2018","journal-title":"Ann. Intern. Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2119","DOI":"10.11124\/JBIES-20-00167","article-title":"Updated methodological guidance for the conduct of scoping reviews","volume":"18","author":"Peters","year":"2020","journal-title":"JBI Evid. Synth."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"W-65","DOI":"10.7326\/0003-4819-151-4-200908180-00136","article-title":"The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration","volume":"151","author":"Liberati","year":"2009","journal-title":"Ann. Intern. Med."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"107926","DOI":"10.1016\/j.ress.2021.107926","article-title":"Infrastructure resilience curves: Performance measures and summary metrics","volume":"216","author":"Poulin","year":"2021","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.jclinepi.2017.06.002","article-title":"Scientific citations favor positive results: A systematic review and meta-analysis","volume":"88","author":"Duyx","year":"2017","journal-title":"J. Clin. Epidemiol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1037\/0003-066X.39.1.75","article-title":"The citation bias: Fad and fashion in the judgment and decision literature","volume":"39","author":"Beach","year":"1984","journal-title":"Am. Psychol."},{"key":"ref_34","unstructured":"Holling, C.S., and Gunderson, L.H. (2002). Resilience and Adaptive Cycles, Island Press."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1038\/35098000","article-title":"Catastrophic shifts in ecosystems","volume":"413","author":"Scheffer","year":"2001","journal-title":"Nature"},{"key":"ref_36","unstructured":"Adu-Gyamfi, K., Boss\u00e9, M.J., and Chandler, K. (2015). Situating Student Errors: Linguistic-to-Algebra Translation Errors. Int. J. Math. Teach. Learn., 16."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1332","DOI":"10.1016\/j.respol.2011.05.025","article-title":"Getting cited: Does open access help?","volume":"40","author":"Gaule","year":"2011","journal-title":"Res. Policy"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sandve, G.K., Nekrutenko, A., Taylor, J., and Hovig, E. (2013). Ten simple rules for reproducible computational research. PLoS Comput. Biol., 9.","DOI":"10.1371\/journal.pcbi.1003285"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"454","DOI":"10.2166\/nh.2009.072","article-title":"Statistical performance indices for a hydropower reservoir","volume":"40","author":"Jain","year":"2009","journal-title":"Hydrol. Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1016\/j.rppneu.2011.06.014","article-title":"How to write a scientific paper\u2014writing the methods section","volume":"17","author":"Azevedo","year":"2011","journal-title":"Rev. Port. Pneumol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1016\/j.jclinepi.2013.01.003","article-title":"Effective writing and publishing scientific papers, part IV: Methods","volume":"66","author":"Kotz","year":"2013","journal-title":"J. Clin. Epidemiol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"e27725","DOI":"10.7554\/eLife.27725","article-title":"The readability of scientific texts is decreasing over time","volume":"6","author":"Matheson","year":"2017","journal-title":"eLife"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"201","DOI":"10.2190\/J8JJ-4YD0-4R00-G5N0","article-title":"Scientific jargon, good and bad","volume":"33","author":"Hirst","year":"2003","journal-title":"J. Tech. Writ. Commun."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.ecolind.2011.07.008","article-title":"Order and disorder in ecological time-series: Introducing normalized spectral entropy","volume":"28","author":"Zaccarelli","year":"2013","journal-title":"Ecol. Indic."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Petrosillo, I., Valente, D., Mulder, C., Li, B.L., Jones, K.B., and Zurlini, G. (2021). The resilient recurrent behavior of mediterranean semi-arid complex adaptive landscapes. Land, 10.","DOI":"10.3390\/land10030296"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"315","DOI":"10.2307\/3939","article-title":"Qualitative Analysis of Insect Outbreak Systems: The Spruce Budworm and Forest","volume":"47","author":"Ludwig","year":"1978","journal-title":"J. Anim. Ecol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"18","DOI":"10.5751\/ES-03381-150218","article-title":"Ecological and Human Community Resilience in Response to Natural Disasters","volume":"15","author":"Gunderson","year":"2010","journal-title":"Ecol. Soc."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.tree.2018.01.013","article-title":"Towards a Comparable Quantification of Resilience","volume":"33","author":"Ingrisch","year":"2018","journal-title":"Trends Ecol. Evol."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"043003","DOI":"10.1088\/1748-9326\/ac5767","article-title":"Ecological resilience: What to measure and how","volume":"17","author":"Dakos","year":"2022","journal-title":"Environ. Res. Lett."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.ecolind.2005.08.013","article-title":"Indicating retrospective resilience of multi-scale patterns of real habitats in a landscape","volume":"6","author":"Zurlini","year":"2006","journal-title":"Ecol. Indic."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"573","DOI":"10.2307\/1468118","article-title":"Disturbance, patchiness, and diversity in streams","volume":"19","author":"Lake","year":"2000","journal-title":"J. N. Am. Benthol. Soc."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Maruyama, H. (2016). Taxonomy and general strategies for resilience. Urban Resilience: A Transformative Approach, Springer.","DOI":"10.1007\/978-3-319-39812-9_1"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"30","DOI":"10.5751\/ES-05063-170330","article-title":"Drivers, \u201cslow\u201d variables, \u201cfast\u201d variables, shocks, and resilience","volume":"17","author":"Walker","year":"2012","journal-title":"Ecol. Soc."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1007\/s004420050090","article-title":"Babel, or the ecological stability discussions: An inventory and analysis of terminology and a guide for avoiding confusion","volume":"109","author":"Grimm","year":"1997","journal-title":"Oecologia"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1007\/s11069-019-03667-4","article-title":"From contesting to conversing about resilience: Kickstarting measurement in complex research environments","volume":"97","author":"Ivory","year":"2019","journal-title":"Nat. Hazards"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1038\/533452a","article-title":"1,500 scientists lift the lid on reproducibility","volume":"533","author":"Baker","year":"2016","journal-title":"Nature"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.ress.2015.03.008","article-title":"On the rationale of resilience in the domain of safety: A literature review","volume":"141","author":"Henriqson","year":"2015","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1111\/gcb.12707","article-title":"Spectral entropy, ecological resilience, and adaptive capacity for understanding, evaluating, and managing ecosystem stability and change","volume":"21","author":"Zurlini","year":"2015","journal-title":"Glob. Chang. Biol."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1002\/2017EF000649","article-title":"Robustness Metrics: How Are They Calculated, When Should They Be Used and Why Do They Give Different Results?","volume":"6","author":"McPhail","year":"2018","journal-title":"Earth\u2019s Future"}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/12\/9\/357\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:52:44Z","timestamp":1760111564000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/12\/9\/357"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,10]]},"references-count":59,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["systems12090357"],"URL":"https:\/\/doi.org\/10.3390\/systems12090357","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,10]]}}}