{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T15:45:28Z","timestamp":1778168728441,"version":"3.51.4"},"reference-count":50,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2020,3,24]],"date-time":"2020-03-24T00:00:00Z","timestamp":1585008000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["PD\/BD\/135216\/2017"],"award-info":[{"award-number":["PD\/BD\/135216\/2017"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sustainability"],"abstract":"<jats:p>Urban waters represent a crucial component for the enhancement of urban resilience due to their importance in cities. Nature-based solutions (NBS) have emerged as sustainable solutions to contribute to urban resilience in order to meet the challenges of climate change. In order to promote the use of NBS for increasing urban resilience, tools that demonstrate the value of this type of solutions over the long-term are required. A performance assessment system provides an adequate basis for demonstrating this value, as well as for diagnosing the current city situation, selecting and monitoring the implementation of solutions. Regarding NBS management, some assessment approaches have been published, focusing on assessing the effectiveness of NBS in the face of climate change and supporting their design and impact assessment. Nevertheless, an integrated approach to assess the NBS contribution for urban resilience has not been published. This paper presents a comprehensive resilience assessment framework (RAF) to evaluate the NBS contribution for urban resilience, focused on solutions for stormwater management and control. Furthermore, details on stakeholders\u2019 validation, with focus on the metrics\u2019 relevance and applicability to cities, is also presented.<\/jats:p>","DOI":"10.3390\/su12062537","type":"journal-article","created":{"date-parts":[[2020,3,24]],"date-time":"2020-03-24T07:16:08Z","timestamp":1585034168000},"page":"2537","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["The Contribution of NBS to Urban Resilience in Stormwater Management and Control: A Framework with Stakeholder Validation"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0863-8503","authenticated-orcid":false,"given":"Paula","family":"Beceiro","sequence":"first","affiliation":[{"name":"Urban Water Unit, National Civil Engineering Laboratory, LNEC, Av. Brasil 101, 1700\u2013066 Lisbon, Portugal"},{"name":"CERIS, Instituto Superior T\u00e9cnico, Universidade de Lisboa, Av. Rovisco Pais, 1049\u2013001 Lisbon, Portugal"}]},{"given":"Rita Salgado","family":"Brito","sequence":"additional","affiliation":[{"name":"Urban Water Unit, National Civil Engineering Laboratory, LNEC, Av. Brasil 101, 1700\u2013066 Lisbon, Portugal"}]},{"given":"Ana","family":"Galv\u00e3o","sequence":"additional","affiliation":[{"name":"CERIS, Instituto Superior T\u00e9cnico, Universidade de Lisboa, Av. Rovisco Pais, 1049\u2013001 Lisbon, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.landurbplan.2015.11.011","article-title":"Defining urban resilience: A review","volume":"147","author":"Meerow","year":"2016","journal-title":"Landsc. Urban Plan."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1016\/j.jenvman.2018.09.083","article-title":"Co-creating urban green infrastructure connecting people and nature: A guiding framework and approach","volume":"233","author":"Jagt","year":"2019","journal-title":"J. Environ. Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1016\/j.gloenvcha.2006.04.002","article-title":"Resilience: The emergence of a perspective for social-ecological systems analyses","volume":"16","author":"Folke","year":"2006","journal-title":"Glob. Environ. Chang."},{"key":"ref_4","unstructured":"Cardoso, M.A., Almeida, M.C., Telhado, M.J., Morais, M., and Brito, R. (2018, January 14\u201316). Assessing contribution of climate change adaptation measures to build resilience in urban areas. Application to Lisbon. Proceedings of the 8th International Conference on Building Resilience\u2014ICBR Lisbon\u20192018 Risk and Resilience in Practice: Vulnerabilities, Displaced People, Local Communities and Heritages, Lisbon, Portugal."},{"key":"ref_5","first-page":"243","article-title":"Nature-based solutions: new influence for environmental management and research in Europe","volume":"24","author":"Eggermont","year":"2015","journal-title":"GAIA-Ecol. Perspect. Sci. Soc."},{"key":"ref_6","unstructured":"OECD Resilient Cities, OECD Publishing. Available online: http:\/\/www.oecd.org\/cfe\/regional-policy\/resilient-cities.htm."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1016\/j.watres.2016.10.011","article-title":"Global resilience analysis of water distribution systems","volume":"106","author":"Diao","year":"2016","journal-title":"Water Res."},{"key":"ref_8","unstructured":"Shutes, B., and Raggatt, L. (2010). Deliverable 2.2. 5 Development of Generic Best Management Practice (BMP) Principles for the Management of Stormwater as Part of an Integrated Urban Water Resource Management Strategy, Urban Pollution Research Centre. SWITCH Project Deliverable (www. switchurbanwater. eu)."},{"key":"ref_9","unstructured":"European Commission (2015). Towards an EU Research and Innovation Policy Agenda for Nature-Based Solutions and Re-Naturing Cities, European Commission. Final Report of the Horizon 2020 expert group on nature-based solutions and re-naturing cities (Full version)."},{"key":"ref_10","unstructured":"UNESCO (2016). 2018 UN World Water Development Report, Nature-Based Solutions for Water, UNESCO."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"673","DOI":"10.2166\/wst.2009.436","article-title":"The water sensitive city: Principles for practice","volume":"60","author":"Wong","year":"2009","journal-title":"Water Sci. Technol."},{"key":"ref_12","unstructured":"Ellis, J.B., Lundy, L., and Revitt, M. (2011, January 24\u201326). An integrated decision support approach to the selection of Sustainable Urban Drainage Systems (SUDS). Proceedings of the SWITCH Conference: The Future of Urban Water, Paris, France."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"99","DOI":"10.2166\/wst.2012.537","article-title":"The management of urban surface water flood risks: SUDS performance in flood reduction from extreme events","volume":"67","author":"Viavattene","year":"2013","journal-title":"Water Sci. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.watres.2015.05.030","article-title":"A global analysis approach for investigating structural resilience in urban drainage systems","volume":"81","author":"Mugume","year":"2015","journal-title":"Water Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"20190206","DOI":"10.1098\/rsta.2019.0206","article-title":"Managing urban flood resilience through the English planning system: Insights from the \u2018SuDS-face\u2019","volume":"378","author":"Potter","year":"2020","journal-title":"Phil. Trans. R. Soc. A"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1016\/j.envsci.2011.05.008","article-title":"New Policies to Deal with Climate Change and Other Drivers Impacting on Resilience to Flooding in Urban Areas: The CORFU Approach","volume":"14","author":"Butler","year":"2011","journal-title":"Environ. Sci. Policy"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.envres.2017.08.016","article-title":"Nature-based solutions to promote human resilience and wellbeing in cities during increasingly hot summers","volume":"159","author":"Panno","year":"2017","journal-title":"Environ. Res."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.envres.2017.05.023","article-title":"Regulating urban surface runoff through nature-based solutions\u2013An assessment at the micro-scale","volume":"157","author":"Henze","year":"2017","journal-title":"Environ. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1016\/j.scitotenv.2018.11.341","article-title":"An assessment framework for climate-proof nature-based solutions","volume":"656","author":"Calliari","year":"2019","journal-title":"Sci. Total Environ."},{"key":"ref_20","unstructured":"Naumann, S., Kaphengst, T., McFarland, K., and Stadler, J. (2014). Nature-Based Approaches for Climate Change Mitigation and Adaptation. The Challenges of Climate Change\u2013Partnering with Nature, German Federal Agency for Nature Conservation (BfN), Ecologic Institute."},{"key":"ref_21","first-page":"2015","article-title":"Estimation of potential runoff quality improvement as a result of applied green infrastructure measures in a Hungarian town","volume":"12","author":"Hancz","year":"2018","journal-title":"J. Int. Sci. Publ. Ecol. Saf."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1933","DOI":"10.1016\/j.jenvman.2009.01.001","article-title":"Who\u2019s in and why? A typology of stakeholder analysis methods for natural resource management","volume":"90","author":"Reed","year":"2009","journal-title":"J. Environ. Manag."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1007\/s10669-015-9554-5","article-title":"Benchmarking agency and organizational practices in resilience decision making","volume":"35","author":"Larkin","year":"2015","journal-title":"Environ. Syst. Decis."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1177\/0002764214550297","article-title":"Community disaster resilience and the rural resilience index","volume":"59","author":"Cox","year":"2015","journal-title":"Am. Behav. Sci."},{"key":"ref_25","unstructured":"Raymond, C.M., Berry, P., Breil, M., Nita, M.R., Kabisch, N., de Bel, M., Enzi, V., Frantzeskaki, N., Geneletti, D., and Cardinaletti, M. (2017). An Impact Evaluation Framework to Support Planning and Evaluation of Nature-Based Solutions Projects. Report prepared by the EKLIPSE Expert Working Group on Nature-Based Solutions to Promote Climate Resilience in Urban Areas, Centre for Ecology & Hydrology."},{"key":"ref_26","unstructured":"Cardoso, M.A., Brito, R., Pereira, C., and David, L.M. (2019, January 15\u201317). Avalia\u00e7\u00e3o da resili\u00eancia dos servi\u00e7os urbanos de \u00e1guas face \u00e0s altera\u00e7\u00f5es clim\u00e1ticas. Proceedings of the XVI Semin\u00e1rio Ibero-Americano sobre Sistemas de Abastecimento e Drenagem, SEREA19, Lisbon, Portugal ."},{"key":"ref_27","unstructured":"UNISDR (2017). Disaster Resilience Scorecard for Cities. Preliminary Level Assessment, United Nations Office for Disaster Reduction."},{"key":"ref_28","unstructured":"ARUP (2015). City Resilience Framework. 100 Resilient Cities, ARUP. The Rockefeller Foundation."},{"key":"ref_29","first-page":"171","article-title":"Managing urban stormwater for urban sustainability: Barriers and policy solutions for green infrastructure application","volume":"203","author":"Dhakal","year":"2017","journal-title":"Environ. Manag."},{"key":"ref_30","unstructured":"USEPA (2017). Evaluating Urban Resilience to Climate Change: A Multi-Sector Approach. United States Environmental Protection Agency, Office of Research and Development. EPA\/600\/R-16\/365F."},{"key":"ref_31","unstructured":"Beceiro, P., Brito, R.S., and Galv\u00e3o, A. (2018, January 10\u201312). Contribution of Nature-Based Solutions (NBS) for resilience in cities. Proceedings of the 18\u00b0 Encontro de Engenharia Sanit\u00e1ria e Ambiental (ENASB) and 18\u00b0 Simp\u00f3sio Luso-Brasileiro de Engenharia Sanit\u00e1ria e Ambiental (SILUBESA), Porto, Portugal."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2","DOI":"10.5751\/ES-08373-210239","article-title":"Nature-based solutions to climate change mitigation and adaptation in urban areas: Perspectives on indicators, knowledge gaps, barriers, and opportunities for action","volume":"21","author":"Kabisch","year":"2016","journal-title":"Ecol. Soc."},{"key":"ref_33","unstructured":"NATURE4CITIES (2019, March 01). NATURE4CITIES\u2014D2.1\u2014System of Integrated Multi-Scale and Multi-Thematic Performance Indicators for the Assessment of Urban Challenges and NBS. Available online: https:\/\/docs.wixstatic.com\/ugd\/55d29d_3b17947e40034c168796bfc9a9117109.pdf."},{"key":"ref_34","unstructured":"ISO. ISO 24510:2007 (2007). Activities Relating to Drinking Water and Wastewater Services\u2014Guidelines for the Assessment and for the Improvement of the Service to Users, International Organization for Standardization."},{"key":"ref_35","unstructured":"ISO. ISO 24511:2007 (2007). Activities Relating to Drinking Water and Wastewater Services\u2014Guidelines for the Management of Wastewater Utilities and for the Assessment of Drinking Water Services, International Organization for Standardization."},{"key":"ref_36","unstructured":"ISO. ISO 24512:2007 (2007). Service Activities Relating to Drinking Water and Wastewater\u2014Guidelines for the Management of Drinking Water Utilities and for the Assessment of Drinking Water Services, International Organization for Standardization."},{"key":"ref_37","unstructured":"ISO. ISO 55000:2014 (2014). Asset Management\u2014Overview, Principles and Terminology, International Organization for Standardization."},{"key":"ref_38","unstructured":"CEN. EN 752:2008 (2008). Drain and Sewer Systems Outside Buildings, European Committee for Standardization."},{"key":"ref_39","unstructured":"Cardoso, M.A., and Brito, R. (2019, January 23\u201327). Approach to Develop a Climate Change Resilience Assessment Framework. Proceedings of the IWA\u2019s 2019 LESAM and PI Conferences, Vancouver, BC, Canada."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2186","DOI":"10.1016\/j.buildenv.2011.04.034","article-title":"The cooling effect of green spaces as a contribution to the mitigation of urban heat: A case study in Lisbon","volume":"46","author":"Oliveira","year":"2011","journal-title":"Build. Environ."},{"key":"ref_41","unstructured":"Pafi, M., Siragusa, A., Ferri, S., and Halkia, M. (2016). Measuring the Accessibility of Urban Green Areas. A comparison of the Green ESM with Other Datasets in Four European Cities, Publications Office of the European Union. EUR 28068 EN."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1177\/1403494815615444","article-title":"Development of an urban green space indicator and the public health rationale","volume":"44","author":"Mudu","year":"2016","journal-title":"Scand. J. Public Health"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1016\/j.rser.2017.09.106","article-title":"Green roof and facades. A comprehensive review","volume":"82","author":"Besir","year":"2018","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.cities.2015.01.005","article-title":"The role of urban green infrastructure in offsetting carbon emissions in 35 major Chinese cities: A nationwide estimate","volume":"44","author":"Chen","year":"2015","journal-title":"Cities"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1111\/j.1365-2664.2011.02021.x","article-title":"Mapping an urban ecosystem service: Quantifying above-ground carbon storage at a city-wide scale","volume":"48","author":"Davies","year":"2011","journal-title":"J. Appl. Ecol."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Hossain, M.A., Shams, S., Amin, M., Reza, M.S., and Chowdhury, T.U. (2019). Perception and barriers to implementation of intensive and extensive green roofs in Dhaka, Bangladesh. Buildings, 9.","DOI":"10.3390\/buildings9040079"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.ecolmodel.2014.08.013","article-title":"Carbon dioxide sequestration model of a vertical greenery system","volume":"306","author":"Marchi","year":"2015","journal-title":"Ecol. Model."},{"key":"ref_48","unstructured":"Novak, D.J. (1994). Atmospheric carbon dioxide reduction by Chicago\u2019s urban forest. Chicago\u2019s Urban Forest Ecosystem: Results of the Chicago Urban Forest Climate Project, Department of Agriculture, Forest Service, Northeastern Forest. Gen. Tech. Rep. NE-186."},{"key":"ref_49","unstructured":"Beceiro, P. (2016). 1D\/2D Integrated Modelling and Performance Assessment to Support Floods Management. Application to Stormwater Urban Drainage System in Estuarine Areas. [Master\u2019s Thesis, Technical University of Lisbon]."},{"key":"ref_50","unstructured":"Cardoso, M.A., Brito, R.S., Pereira, R., David, L., and Almeida, M.C. (2019, November 01). Resilience Assessment Framework \u2013 RAF. Description and implementation. Deliverable 6.4, RESCCUE project. 105 pp. (under publication). Available online: http:\/\/www.resccue.eu\/resccue-project."}],"container-title":["Sustainability"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2071-1050\/12\/6\/2537\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:10:59Z","timestamp":1760173859000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2071-1050\/12\/6\/2537"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,24]]},"references-count":50,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["su12062537"],"URL":"https:\/\/doi.org\/10.3390\/su12062537","relation":{},"ISSN":["2071-1050"],"issn-type":[{"value":"2071-1050","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,24]]}}}