{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T19:47:57Z","timestamp":1776714477479,"version":"3.51.2"},"reference-count":106,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2019,5,18]],"date-time":"2019-05-18T00:00:00Z","timestamp":1558137600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Seventh Framework Programme","award":["313085"],"award-info":[{"award-number":["313085"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Climate services are becoming the backbone to translate climate knowledge, data &amp; information into climate-informed decision-making at all levels, from public administrations to business operators. It is essential to assess the technical and scientific quality of the provided climate data and information products, including their value to users, to establish the relation of trust between providers of climate data and information and various downstream users. The climate data and information products (i.e., from satellite, in-situ and reanalysis) shall be fully traceable, adequately documented and uncertainty quantified and can provide sufficient guidance for users to address their specific needs and feedbacks. This paper discusses details on how to apply the quality assurance framework to deliver timely assessments of the quality and usability of Essential Climate Variable (ECV) products. It identifies an overarching structure for the quality assessment of single product ECVs (i.e., consists of only one single variable), multi-product ECVs (i.e., more than one single parameter), thematic products (i.e., water, energy and carbon cycles), as well as the usability assessment. To support a traceable climate service, other than rigorously evaluating the technical and scientific quality of ECV products, which represent the upstream of climate services, how the uncertainty propagates into the resulting benefit (utility) for the users of the climate service needs to be detailed.<\/jats:p>","DOI":"10.3390\/rs11101186","type":"journal-article","created":{"date-parts":[[2019,5,20]],"date-time":"2019-05-20T11:05:07Z","timestamp":1558350307000},"page":"1186","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Towards a Traceable Climate Service: Assessment of Quality and Usability of Essential Climate Variables"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2166-5314","authenticated-orcid":false,"given":"Yijian","family":"Zeng","sequence":"first","affiliation":[{"name":"Faculty of Geo-information and Earth Observation (ITC), University of Twente, Hengelosestraat 99, 7514 AE Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhongbo","family":"Su","sequence":"additional","affiliation":[{"name":"Faculty of Geo-information and Earth Observation (ITC), University of Twente, Hengelosestraat 99, 7514 AE Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Iakovos","family":"Barmpadimos","sequence":"additional","affiliation":[{"name":"SCOR Global P&amp;C, Guisan-quai 26, 8002 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4655-1310","authenticated-orcid":false,"given":"Adriaan","family":"Perrels","sequence":"additional","affiliation":[{"name":"Finnish Meteorological Institute, Erik Palm\u00e9nin aukio 1, FI-00560 Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8392-6524","authenticated-orcid":false,"given":"Paul","family":"Poli","sequence":"additional","affiliation":[{"name":"Meteo-France, Centre de Meteorologie, Marine, SHOM, 13 Rue de Ch\u00e2tellier, 29200 Brest, France, <email>paul.poli@shom.fr<\/email>"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4591-7635","authenticated-orcid":false,"given":"K. Folkert","family":"Boersma","sequence":"additional","affiliation":[{"name":"The Royal Netherlands Meteorological Service, Utrechtseweg 297, 3731 GA De Bilt, The Netherlands"},{"name":"Stichting Wageningen Research, Wageningen Environmental Research, Droevendaalsesteeg 3-3 A, 6708 PB Wageningen, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anna","family":"Frey","sequence":"additional","affiliation":[{"name":"Finnish Meteorological Institute, Erik Palm\u00e9nin aukio 1, FI-00560 Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9110-7369","authenticated-orcid":false,"given":"Xiaogang","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Idaho, 875 Perimeter Drive, Moscow, ID 83844, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karianne","family":"de Bruin","sequence":"additional","affiliation":[{"name":"Stichting Wageningen Research, Wageningen Environmental Research, Droevendaalsesteeg 3-3 A, 6708 PB Wageningen, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hasse","family":"Goosen","sequence":"additional","affiliation":[{"name":"Stichting Wageningen Research, Wageningen Environmental Research, Droevendaalsesteeg 3-3 A, 6708 PB Wageningen, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8640-8810","authenticated-orcid":false,"given":"Viju O.","family":"John","sequence":"additional","affiliation":[{"name":"European Organisation for the Exploitation of Meteorological Satellites (EUMETSAT), Eumetsat Allee 1, 64295 Darmstadt, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0506-5324","authenticated-orcid":false,"given":"Rob","family":"Roebeling","sequence":"additional","affiliation":[{"name":"European Organisation for the Exploitation of Meteorological Satellites (EUMETSAT), Eumetsat Allee 1, 64295 Darmstadt, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J\u00f6rg","family":"Schulz","sequence":"additional","affiliation":[{"name":"European Organisation for the Exploitation of Meteorological Satellites (EUMETSAT), Eumetsat Allee 1, 64295 Darmstadt, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wim","family":"Timmermans","sequence":"additional","affiliation":[{"name":"Faculty of Geo-information and Earth Observation (ITC), University of Twente, Hengelosestraat 99, 7514 AE Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,5,18]]},"reference":[{"key":"ref_1","first-page":"52","article-title":"The global framework for climate services (GFCS)","volume":"2\u20133","author":"Lucio","year":"2016","journal-title":"Clim. Serv."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1038\/nclimate1745","article-title":"The global framework for climate services","volume":"2","author":"Hewitt","year":"2012","journal-title":"Nat. Clim. Chang."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.cliser.2019.01.002","article-title":"Fit for purpose? Transforming National Meteorological and Hydrological Services into National Climate Service Centers","volume":"13","author":"Mahon","year":"2019","journal-title":"Clim. Serv."},{"key":"ref_4","unstructured":"European Commission (2015). A European Research and Innovation Roadmap for Climate Services, Directorate-General for Research and Innovation (European Commission)."},{"key":"ref_5","first-page":"24","article-title":"Climate service develops user-friendly data store","volume":"151","author":"Raoult","year":"2017","journal-title":"Meteorology"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.cliser.2015.12.001","article-title":"Towards a leading role on climate services in Europe: A research and innovation roadmap","volume":"1","author":"Street","year":"2016","journal-title":"Clim. Serv."},{"key":"ref_7","unstructured":"QA4ECV (2019, May 17). Quality Assurance for Essential Climate Variables 2014. Available online: http:\/\/www.qa4ecv.eu\/."},{"key":"ref_8","unstructured":"QA4EO (2019, May 17). Quality Assurance framework for Earth Observation 2013. Available online: http:\/\/www.qa4eo.org\/docs\/QA4EO_guide.pdf."},{"key":"ref_9","unstructured":"GAIA-CLIM (2019, May 17). Gap Analysis for Integrated Atmospheric ECV Climate Monitoring 2014. Available online: http:\/\/www.gaia-clim.eu\/."},{"key":"ref_10","unstructured":"FIDUCEO (2019, May 17). Fidelity and Uncertainty in Climate Data Records from Earth Observations. Available online: http:\/\/www.fiduceo.eu\/."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1175\/BAMS-D-16-0074.1","article-title":"An overview of European efforts in generating climate data records","volume":"99","author":"Su","year":"2018","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_12","unstructured":"ECWMF (2016). C3S_511 Copernicus Climate Change Service\u2014Quality Assessment of ECV Products, ECMWF Copernicus Procurement. Available online: https:\/\/climate.copernicus.eu\/past-tenders."},{"key":"ref_13","unstructured":"ECWMF (2015). C3S_51 Copernicus Climate Change Service\u2014Evaluation and Quality Control Function for the Climate Data Store, ECMWF Copernicus Procurement. Available online: https:\/\/climate.copernicus.eu\/past-tenders."},{"key":"ref_14","unstructured":"ECMWF (2017). C3S_512 Quality Assurance for the Climate Data Store, ECMWF Copernicus Procurement. Available online: https:\/\/climate.copernicus.eu\/past-tenders."},{"key":"ref_15","unstructured":"ECMWF (2015). C3S_52 Evaluation and Quality Control Function for the Sectoral Information System, ECMWF Copernicus Procurement. Available online: https:\/\/climate.copernicus.eu\/past-tenders."},{"key":"ref_16","unstructured":"ECMWF (2018). C3S_513 Evaluation and Quality Control Framework for the Sectoral Information System, ECMWF Copernicus Procurement. Available online: https:\/\/climate.copernicus.eu\/past-tenders."},{"key":"ref_17","unstructured":"EU-MACS (2016). European Market for Climate Services, EU-MACS. Available online: http:\/\/eu-macs.eu\/eu-macs\/."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.cliser.2018.08.001","article-title":"From generating to using climate services\u2014How the EU-MACS and MARCO projects help to unlock the market potential","volume":"11","author":"Hoa","year":"2018","journal-title":"Clim. Serv."},{"key":"ref_19","unstructured":"MARCO (2019, May 17). Market Research for a Climate Services Observatory. Available online: http:\/\/marco-h2020.eu\/."},{"key":"ref_20","unstructured":"EUPORIAS (2019, May 17). European Provision of Regional Impacts Assessments on Seasonal and Decadal Timescales. Available online: http:\/\/www.euporias.eu\/."},{"key":"ref_21","unstructured":"Copernicus Climate Change Service (2015). Sectoral Impacts via Sectoral Information System, Copernicus Climate Change Service. Available online: https:\/\/climate.copernicus.eu\/sectoral-impacts."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Nightingale, J., Boersma, K., Muller, J.-P., Compernolle, S., Lambert, J.-C., Blessing, S., Giering, R., Gobron, N., De Smedt, I., and Coheur, P. (2018). Quality assurance framework development based on six new ECV data products to enhance user confidence for climate applications. Remote Sens., 10.","DOI":"10.20944\/preprints201806.0155.v1"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Nightingale, J., Mittaz, J., Douglas, S., Dee, D., Ryder, J., Taylor, M., Old, C., Dieval, C., Fouron, C., and Duveau, G. (2019). Ten priority science gaps in assessing climate data record quality. Remote Sens., 11.","DOI":"10.3390\/rs11080986"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1002\/2015EF000338","article-title":"Climate services: Lessons learned and future prospects","volume":"4","author":"Brasseur","year":"2016","journal-title":"Earth\u2019s Future"},{"key":"ref_25","unstructured":"Larosa, F., and Perrels, A. (2017). Assessment of the Existing Resourcing and Quality Assurance of Current Climate Services, EU-MACS. Available online: http:\/\/eu-macs.eu\/wp-content\/uploads\/2017\/07\/EUMACS_D12_v2x.pdf."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"ES265","DOI":"10.1175\/BAMS-D-16-0173.1","article-title":"Uncertainty: Lessons learned for climate services","volume":"97","author":"Otto","year":"2016","journal-title":"Bul. Am. Meteorol. Soc."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1002\/wcc.290","article-title":"Climate services for society: Origins, institutional arrangements, and design elements for an evaluation framework","volume":"5","author":"Vaughan","year":"2014","journal-title":"Wiley Interdiscip. Rev. Clim. Chang."},{"key":"ref_28","unstructured":"Perrels, A. (2018). A Structured Analysis of Obstacles to Uptake of Climate Services and Identification of Policies and Measures to Overcome Obstacles so as to Promote Uptake, EU-MACS. Available online: http:\/\/eu-macs.eu\/wp-content\/uploads\/2018\/12\/EUMACS_D51_final-1.pdf."},{"key":"ref_29","unstructured":"Dowell, M., Lecomte, P., Husband, R., Schulz, J., Mohr, T., Tahara, Y., Eckman, R., Lindstrom, E., Wooldridge, C., and Hilding, S. (2013). Strategy Towards an Architecture for Climate Monitoring from Space, World Meteorology Center."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yang, W., John, O.V., Zhao, X., Lu, H., and Knapp, R.K. (2016). Satellite climate data records: Development, applications, and societal benefits. Remote Sens., 8.","DOI":"10.3390\/rs8040331"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1175\/WCAS-D-17-0030.1","article-title":"Surveying climate services: What can we learn from a bird\u2019s-eye view?","volume":"10","author":"Vaughan","year":"2018","journal-title":"Weather Clim. Soc."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.cliser.2016.11.004","article-title":"Identifying research priorities to advance climate services","volume":"4","author":"Vaughan","year":"2016","journal-title":"Clim. Serv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1431","DOI":"10.1175\/BAMS-D-13-00047.1","article-title":"The concept of essential climate variables in support of climate research, applications, and policy","volume":"95","author":"Bojinski","year":"2014","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1175\/BAMS-D-13-00249.1","article-title":"International climate assessment & dataset: Climate services across borders","volume":"96","author":"Abass","year":"2015","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_35","unstructured":"Schulz, J. (2015). Deliverable D2.26 Structured Process for the Generation of Climate Data Records\u2014CORE-CLIMAX Deliverables, EUMETSAT. Available online: https:\/\/drive.google.com\/file\/d\/1QZ_hPCcJsd1R1xJlZNg3Iu265sPJserT\/view?usp=sharing."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zeng, Y., Su, Z., van der Velde, R., Wang, L., Xu, K., Wang, X., and Wen, J. (2016). Blending satellite observed, model simulated, and in-situ measured soil moisture over Tibetan plateau. Remote Sens., 8.","DOI":"10.3390\/rs8030268"},{"key":"ref_37","unstructured":"UNFCCC (2017). The Paris Agreement-2015. P.27, UNFCCC. Available online: http:\/\/unfccc.int\/paris_agreement\/items\/9485.php."},{"key":"ref_38","unstructured":"GCOS (2016). The Global Observing System for Climate: Implementation Needs, GCOS."},{"key":"ref_39","unstructured":"GCOS (2003). GCOS Climate Monitoring Principles, GCOS."},{"key":"ref_40","unstructured":"WGClimate (2016). Four-Year Implementation Plan for the Period November 2015 to November 2019 (Version 2)\u2014ECO-WGCL-EOPS-PL-16-0005, WGClimate. Available online: http:\/\/ceos.org\/document_management\/Working_Groups\/WGClimate\/Documents\/CM-13_Doc_04-03_JWGC-WorkPlan-Report.pdf."},{"key":"ref_41","unstructured":"GCOS (2010). Guideline for the Generation of Datasets and Products Meeting GCOS Requirements, GCOS-143."},{"key":"ref_42","unstructured":"GCOS (2011). Systematic Observation Requirements for Satellite-Based Data Produts for Climate, 2011 Update, Suplemental Details to the Satellite-Based Component of the \u201cImplementation Plan for the Global Observing System for Climate in Support of the UNFCCC (2010 Update)\u201d, GCOS-154."},{"key":"ref_43","unstructured":"Bojinski, S. (2011). Response by ESA to GCOS\u2014Results of the Climate Change Initiative Requirements Analysis, European Space Agency, ESRIN."},{"key":"ref_44","unstructured":"Bojinski, S., Dowell, M., Eckman, R., Gichoni, I.G., Husband, R., Lecomte, P., and Zhang, W. (2015). Satellites for Climate Services: Case Studies for Establishing an Architecture for Climate Monitoring from Space, Joint Publication of WMO and JRC. Available online: https:\/\/library.wmo.int\/pmb_ged\/wmo_1162_en.pdf."},{"key":"ref_45","unstructured":"Doblas-Reyes, F. (2017, January 7\u20139). EQC Status Overview. Proceedings of the First C3S (Copernicus Climate Change Service) General Assembly, Toulouse, France."},{"key":"ref_46","unstructured":"WGClimate (2016). ECV Inventory Questionnaire Guide, WGClimate. ECO-WGCL-EOPS-TN-16-0022."},{"key":"ref_47","unstructured":"WMO (2016). The Global Observing System for Climate: Implementation Needs GCOS 200 (GOOS-214), WMO."},{"key":"ref_48","unstructured":"Wilson, J., Dowell, M., and Belward, A. (2010). European Capacity for Monitoring and Assimilating Space Based Climate Change Observations\u2014Status and Prospects, European Commission, Joint Research Center, Institute for Environment and Sustainability. JRC Scientific and Technical Reports (EUR 24273 EN)."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"8319","DOI":"10.1175\/JCLI-D-14-00556.1","article-title":"The observed state of the energy budget in the early twenty-first century","volume":"28","author":"Beaudoing","year":"2015","journal-title":"J. Clim."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"8289","DOI":"10.1175\/JCLI-D-14-00555.1","article-title":"The observed state of the water cycle in the early twenty-first century","volume":"28","author":"Rodell","year":"2015","journal-title":"J. Clim."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1038\/nclimate2141","article-title":"Capturing provenance of global change information","volume":"4","author":"Ma","year":"2014","journal-title":"Nat. Clim. Change"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.envsoft.2014.08.002","article-title":"Ontology engineering in provenance enablement for the National Climate Assessment","volume":"61","author":"Ma","year":"2014","journal-title":"Environ. Model. Soft."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1002\/2017RG000562","article-title":"Validation practices for satellite-based Earth observation data across communities","volume":"55","author":"Loew","year":"2017","journal-title":"Rev. Geophys."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.jag.2015.06.006","article-title":"Analysis of current validation practices in Europe for space-based climate data records of essential climate variables","volume":"42","author":"Zeng","year":"2015","journal-title":"Int. J. Appl. Earth Observ. Geoinform."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"511","DOI":"10.5194\/essd-9-511-2017","article-title":"Uncertainty information in climate data records from Earth observation","volume":"9","author":"Merchant","year":"2017","journal-title":"Earth Syst. Sci. Data"},{"key":"ref_56","unstructured":"GCOS (2015). User Requirements for Observations (OSCAR\/Requirements), GCOS. GCOS Requirements-Observing Systems Capabilities Analysis and Review Tool (OSCAR)."},{"key":"ref_57","unstructured":"Schulz, J., John, V., Roebeling, R., Kaiser-Weiss, A., Swinnen, E., and Tan, D. (2015). Deliverable D2.25 European ECV CDR Capacity Assessment Report, CORE CLIMAX Deliverable. Available online: https:\/\/drive.google.com\/file\/d\/1uUf1aREAzJmtteNTLV5TI12skYqBbDhL\/view?usp=sharing."},{"key":"ref_58","unstructured":"Kaiser-Weiss, A., Obregon, A., Poli, P., Tan, D., and Gregow, H. (2014). D5.53 Procedure for Comparing Reanalyses, and Comparing Reanalyses to Assimilated Observations and CDRs, CORE CLIMAX Deliverable. Available online: https:\/\/drive.google.com\/file\/d\/1WMvA86tFQ_eetMPEHqKKJ4p8qdVT2dEr\/view?usp=sharing."},{"key":"ref_59","unstructured":"EUMETSAT (2014). CORE-CLIMAX System Maturity Matrix Instruction Manual, CORE CLIMAX Deliverable. Available online: https:\/\/drive.google.com\/file\/d\/1nvN_9A3MDxpWbuqfQxHgsgc6MdDMJKmt\/view?usp=sharing."},{"key":"ref_60","unstructured":"John, V. (2013). Which Data Are Suitable for Your Application Support Tools to Make Choices, CORE CLIMAX Deliverable. Available online: https:\/\/drive.google.com\/open?id=1OGi7iJ86-Eb8MUxftnFCWceSyFDUKBHs."},{"key":"ref_61","unstructured":"ECMWF (2016). C3S-311a Collection and Processing of In-Situ Observations, ECMWF Copernicus Procurement. Available online: https:\/\/climate.copernicus.eu\/past-tenders."},{"key":"ref_62","unstructured":"ECMWF (2016). C3S_312a Production of Essential Climate Variable Datasets Based on Earth Observations, ECMWF Copernicus Procurement. Available online: https:\/\/climate.copernicus.eu\/past-tenders."},{"key":"ref_63","unstructured":"ECMWF (2016). C3S_312b Essential Climate Variable Products Derived from Observations, ECMWF Copernicus Procurement. Available online: https:\/\/climate.copernicus.eu\/past-tenders."},{"key":"ref_64","unstructured":"Barmpadimos, I. (2019, May 17). Available online: https:\/\/drive.google.com\/open?id=1glJiaSDw3F5RPQ7zMCoOZ1n4c9nWEQRg."},{"key":"ref_65","unstructured":"Kloeppinger-Todd, R., Sharma, M., Campaigne, J., Cohen, M., and Collier, B. (2010). Innovations in rural and agriculture finance. IFPRI 2020 Vision in Food, Agriculture, and the Environment, Focus 18, World Bank. Available online: http:\/\/documents.worldbank.org\/curated\/en\/775001468336854685\/Innovations-in-rural-and-agriculture-finance."},{"key":"ref_66","unstructured":"Trenberth, K. (2016). The Climate Data Guide: Ni\u00f1o SST Indices (Ni\u00f1o 1+2, 3, 3.4, 4; ONI and TNI), National Center for Atmospheric Research."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"8179","DOI":"10.1175\/JCLI-D-16-0836.1","article-title":"Extended Reconstructed Sea Surface Temperature, Version 5 (ERSSTv5): Upgrades, Validations, and Inter-comparisons","volume":"30","author":"Huang","year":"2017","journal-title":"J. Clim."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1002\/qj.828","article-title":"The ERA-Interim reanalysis: Configuration and performance of the data assimilation system","volume":"137","author":"Dee","year":"2011","journal-title":"Quart. J. R. Meteorol. Soc."},{"key":"ref_69","unstructured":"Merchant, C., Embury, O., Roberts-Jones, J., Fiedler, E., Bulgin, C.E., Corlett, G.k., Good, S., McLaren, A., Rayner, N.A., and Donlon, C. (2016). ESA Sea Surface Temperature Climate Change Initiative (ESA SST CCI): Analysis Long Term Product Version 1.1, Centre for Environmental Data Analysis."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1175\/JAMC-D-18-0180.1","article-title":"Response of extreme precipitation to urbanization over the Netherlands","volume":"58","author":"Golroudbary","year":"2019","journal-title":"J. Appl. Meteorol. Clim."},{"key":"ref_71","unstructured":"Pfaff, B., and McNeil, A. (2019, May 17). EVIR: Extreme Values in R. R package Version 1.7-4. Available online: https:\/\/rdrr.io\/cran\/evir\/."},{"key":"ref_72","unstructured":"Team, R.C. (2017). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/S0167-7152(00)00242-X","article-title":"Sharp distribution-free bounds on the bias in estimating quantiles via order statistics","volume":"52","author":"Okolewski","year":"2001","journal-title":"Stat. Probab. Lett."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.asr.2018.04.022","article-title":"Assessing reanalysis quality with early sounders Nimbus-4 IRIS (1970) and Nimbus-6 HIRS (1975)","volume":"62","author":"Poli","year":"2018","journal-title":"Adv. Space Res."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"1541","DOI":"10.1175\/BAMS-D-11-00254.1","article-title":"The ESA climate change initiative: Satellite data records for essential climate variables","volume":"94","author":"Hollmann","year":"2013","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"1687","DOI":"10.5194\/acp-9-1687-2009","article-title":"Operational climate monitoring from space: The EUMETSAT satellite application facility on climate monitoring (CM-SAF)","volume":"9","author":"Schulz","year":"2009","journal-title":"Atmos. Chem. Phys."},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Merchant, J.C., Holl, G., Mittaz, P.J., and Woolliams, R.E. (2019). Radiance Uncertainty characterisation to facilitate climate data record creation. Remote Sens., 11.","DOI":"10.3390\/rs11050474"},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"2689","DOI":"10.1175\/BAMS-D-16-0165.1","article-title":"Toward an integrated set of surface meteorological observations for climate science and applications","volume":"98","author":"Thorne","year":"2017","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"2760","DOI":"10.1002\/joc.5458","article-title":"Towards a global land surface climate fiducial reference measurements network","volume":"38","author":"Thorne","year":"2018","journal-title":"Int. J. Clim."},{"key":"ref_80","unstructured":"JGCM (2008). Evaluation of Measurement Data Guide to the Expression of Uncertainty in Measurement, JGCM."},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Taylor, B.N., and Kuyatt, C.E. (1994). Guidelines for evaluating and expressing the uncertainty of NIST measurement results, NIST Technical Note 1297.","DOI":"10.6028\/NIST.TN.1297"},{"key":"ref_82","unstructured":"Lawrimore, J. (2014). Review of Specific Observing System Activities Related to Observing Systeme Design (GCOS), World Meteorological Organization. Available online: http:\/\/www.wmo.int\/pages\/prog\/www\/OSY\/Meetings\/OSDW1\/documents\/OSDW1-2013-Doc-5.4-GCOS.doc."},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Thorne, P.W., Madonna, F., Schulz, J., Oakley, T., Ingleby, B., Rosoldi, M., Tramutola, E., Arola, A., Buschmann, M., and Mikalsen, A.C. (2017). Making better sense of the mosaic of environmental measurement networks: A system-of-systems approach and quantitative assessment. Geosci. Instrum. Methods Data Syst. Discuss., 1\u201343.","DOI":"10.5194\/gi-2017-29"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1175\/BAMS-D-14-00072.1","article-title":"Reference upper-air observations for climate: From concept to reality","volume":"97","author":"Bodeker","year":"2015","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1175\/2008BAMS2540.1","article-title":"Reference upper-air observations for climate: Rationale, progress, and plans","volume":"90","author":"Seidel","year":"2009","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1175\/BAMS-D-12-00170.1","article-title":"U.S. Climate reference network after one decade of operations: Status and assessment","volume":"94","author":"Diamond","year":"2013","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1175\/JTECH-D-14-00172.1","article-title":"Observational Perspectives from U.S. Climate reference network (USCRN) and cooperative observer program (COOP) network: Temperature and precipitation comparison","volume":"32","author":"Leeper","year":"2015","journal-title":"J. Atmos. Oceanic Technol."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1029\/2012EO440006","article-title":"A maturity model for assessing the completeness of climate data records","volume":"93","author":"Bates","year":"2012","journal-title":"Eos Trans. Am. Geophys. Union"},{"key":"ref_89","first-page":"ES21","article-title":"Uncertainty quantification for climate observations","volume":"94","author":"Matthews","year":"2012","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1175\/2010BAMS3001.1","article-title":"The NCEP climate forecast system reanalysis","volume":"91","author":"Saha","year":"2010","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"1851","DOI":"10.1175\/BAMS-D-17-0229.1","article-title":"Observations for reanalyses","volume":"99","author":"Allan","year":"2018","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"1003","DOI":"10.1175\/BAMS-D-17-0199.1","article-title":"The EU-FP7 ERA-CLIM2 Project contribution to advancing science and production of Earth system climate reanalyses","volume":"99","author":"Buizza","year":"2017","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_93","unstructured":"Poli, P., Hersbach, H., Tan, D., Dee, D., Th\u00e9paut, J.-N., Simmons, A., Peubey, C., Laloyaux, P., Komori, T., and Berrisford, P. (2013). The Data Assimilation System and Initial Performance Evaluation of the ECMWF Pilot Reanalysis of the 20th-Century Assimilating Surface Observations Only (ERA-20C), ECMWF. ECMWF Technical Report."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"4083","DOI":"10.1175\/JCLI-D-15-0556.1","article-title":"ERA-20C: An atmospheric reanalysis of the twentieth century","volume":"29","author":"Poli","year":"2016","journal-title":"J. Clim."},{"key":"ref_95","unstructured":"Hersbach, H., Peubey, C., Simmons, A., Poli, P., Dee, D., and Berrisford, P. (2013). ERA-20CM: A Twentieth Century Atmospheric Model Ensemble, ECMWF. ECMWF Technical Report."},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Simmons, A., Poli, P., Dee, D., Berrisford, P., Hersbach, H., and Peubey, C. (2013). Estimating Low-Frequency Variability and Trends in Atmospheric Temperature Using ERA-Interim, ECMWF. ECMWF Technical Report.","DOI":"10.1002\/qj.2317"},{"key":"ref_97","unstructured":"Poli, P., Tan, D., John, V., and Schulz, J. (2013). Procedure for Feeding Back Improved Ancillary Data to Assist Climate Data Records Updates, European Union Seventh Framework Programme CORE-CLIMAX. Available online: https:\/\/drive.google.com\/file\/d\/1BpCuyNHn3faDKDjg_kN5t0fEjIKatH5j\/view?usp=sharing."},{"key":"ref_98","unstructured":"Tan, D., and Poli, P. (2013). Design of Support Infrastructure for CDR Quality Assessment in a Reanalysis Environment, European Union Seventh Framework Programme CORE-CLIMAX. Available online: https:\/\/drive.google.com\/file\/d\/1LQdrqNN9uVPG9czulannBbKQb9GHGzud\/view?usp=sharing."},{"key":"ref_99","unstructured":"Tan, D., Poli, P., and Schulz, J. (2014). Procedures for Feeding back Reanalysis Results and Plans to CDR Producers, European Union Seventh Framework Programme CORE-CLIMAX. Available online: https:\/\/drive.google.com\/file\/d\/1uN2r3Z0LpjSyWqPU7Vjln6XPcjkIhLY-\/view?usp=sharing."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"187","DOI":"10.5194\/asr-12-187-2015","article-title":"Comparison of regional and global reanalysis near-surface winds with station observations over Germany","volume":"12","author":"Kaspar","year":"2015","journal-title":"Adv. Sci. Res."},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Asrar, G.R., and Hurrell, J.W. (2013). On the reprocessing and reanalysis of observations for climate. Climate Science for Serving Society, Springer.","DOI":"10.1007\/978-94-007-6692-1"},{"key":"ref_102","unstructured":"Bosilovich, M., Thepaut, J.-N., Onogi, K., Kumar, A., Dee, D., and Brown, O. (2019, May 17). WCRP Task Team for Inter-comparison of ReAnalyses (TIRA): A White Paper Outlining the Need for Reanalysis Inter-Comparison Guidance and Task Team at an International Level. Available online: https:\/\/reanalyses.org\/sites\/default\/files\/groups\/users\/michael.bosilovich\/TIRA_WDAC_v1b.pdf."},{"key":"ref_103","first-page":"13","article-title":"The rise of demand-driven climate services","volume":"6","author":"Swart","year":"2015","journal-title":"Nat. Clim. Change"},{"key":"ref_104","doi-asserted-by":"crossref","unstructured":"Asrar, G.R., and Hurrell, J.W. (2013). Challenges of a sustained climate observing system. Climate Science for Serving Society, Springer.","DOI":"10.1007\/978-94-007-6692-1"},{"key":"ref_105","doi-asserted-by":"crossref","unstructured":"Buontempo, C., and Hewitt, C. (2017). EUPORIAS and the development of climate services. Clim. Serv.","DOI":"10.1016\/j.cliser.2017.06.011"},{"key":"ref_106","doi-asserted-by":"crossref","unstructured":"Christel, I., Hemment, D., Bojovic, D., Cucchietti, F., Calvo, L., Stefaner, M., and Buontempo, C. (2017). Introducing design in the development of effective climate services. Clim. Serv.","DOI":"10.1016\/j.cliser.2017.06.002"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/10\/1186\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:53:23Z","timestamp":1760187203000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/10\/1186"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,18]]},"references-count":106,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2019,5]]}},"alternative-id":["rs11101186"],"URL":"https:\/\/doi.org\/10.3390\/rs11101186","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5,18]]}}}