{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,8]],"date-time":"2025-11-08T22:50:22Z","timestamp":1762642222977,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2019,4,25]],"date-time":"2019-04-25T00:00:00Z","timestamp":1556150400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Decision makers need accessible robust evidence to introduce new policies to mitigate and adapt to climate change. There is an increasing amount of environmental information available to policy makers concerning observations and trends relating to the climate. However, this data is hosted across a multitude of websites often with inconsistent metadata and sparse information relating to the quality, accuracy and validity of the data. Subsequently, the task of comparing datasets to decide which is the most appropriate for a certain purpose is very complex and often infeasible. In support of the European Union\u2019s Copernicus Climate Change Service (C3S) mission to provide authoritative information about the past, present and future climate in Europe and the rest of the world, each dataset to be provided through this service must undergo an evaluation of its climate relevance and scientific quality to help with data comparisons. This paper presents the framework for Evaluation and Quality Control (EQC) of climate data products derived from satellite and in situ observations to be catalogued within the C3S Climate Data Store (CDS). The EQC framework will be implemented by C3S as part of their operational quality assurance programme. It builds on past and present international investment in Quality Assurance for Earth Observation initiatives, extensive user requirements gathering exercises, as well as a broad evaluation of over 250 data products and a more in-depth evaluation of a selection of 24 individual data products derived from satellite and in situ observations across the land, ocean and atmosphere Essential Climate Variable (ECV) domains. A prototype Content Management System (CMS) to facilitate the process of collating, evaluating and presenting the quality aspects and status of each data product to data users is also described. The development of the EQC framework has highlighted cross-domain as well as ECV specific science knowledge gaps in relation to addressing the quality of climate data sets derived from satellite and in situ observations. We discuss 10 common priority science knowledge gaps that will require further research investment to ensure all quality aspects of climate data sets can be ascertained and provide users with the range of information necessary to confidently select relevant products for their specific application.<\/jats:p>","DOI":"10.3390\/rs11080986","type":"journal-article","created":{"date-parts":[[2019,4,25]],"date-time":"2019-04-25T03:39:02Z","timestamp":1556163542000},"page":"986","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Ten Priority Science Gaps in Assessing Climate Data Record Quality"],"prefix":"10.3390","volume":"11","author":[{"given":"Joanne","family":"Nightingale","sequence":"first","affiliation":[{"name":"Earth Observation, Climate and Optical Group, National Physical Laboratory, Hampton Road, Teddington TW11 0LW, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan P.D.","family":"Mittaz","sequence":"additional","affiliation":[{"name":"Department of Meteorology, University of Reading, PO Box 243, Whiteknights, Reading RG6 6BB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sarah","family":"Douglas","sequence":"additional","affiliation":[{"name":"Earth Observation, Climate and Optical Group, National Physical Laboratory, Hampton Road, Teddington TW11 0LW, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dick","family":"Dee","sequence":"additional","affiliation":[{"name":"Copernicus Climate Change Service, ECMWF, Shinfield Park, Reading, Berkshire RG2 9AX, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Ryder","sequence":"additional","affiliation":[{"name":"Earth Observation, Climate and Optical Group, National Physical Laboratory, Hampton Road, Teddington TW11 0LW, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3473-3478","authenticated-orcid":false,"given":"Michael","family":"Taylor","sequence":"additional","affiliation":[{"name":"Department of Meteorology, University of Reading, PO Box 243, Whiteknights, Reading RG6 6BB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christopher","family":"Old","sequence":"additional","affiliation":[{"name":"Department of Meteorology, University of Reading, PO Box 243, Whiteknights, Reading RG6 6BB, UK"},{"name":"Institute for Energy Systems, School of Engineering, University of Edinburgh, Grant Institute Kings Buildings, W Mains Road, Edinburgh EH9 3JW, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Catherine","family":"Dieval","sequence":"additional","affiliation":[{"name":"Department of Meteorology, University of Reading, PO Box 243, Whiteknights, Reading RG6 6BB, UK"},{"name":"Deutsches GeoForschungsZentrum, Albert-Einstein-Strasse 42-46, 14473 Potsdam, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Celine","family":"Fouron","sequence":"additional","affiliation":[{"name":"Telespazio France, 26 Avenue Jean Fran\u00e7ois Champollion, 31100 Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guillaume","family":"Duveau","sequence":"additional","affiliation":[{"name":"Telespazio France, 26 Avenue Jean Fran\u00e7ois Champollion, 31100 Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4687-9850","authenticated-orcid":false,"given":"Christopher","family":"Merchant","sequence":"additional","affiliation":[{"name":"National Centre for Earth Observation, Reading RG6 6AL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,25]]},"reference":[{"key":"ref_1","unstructured":"UNFCCC (2019, April 21). The Paris Agreement\u20142015. Available online: http:\/\/unfccc.int\/paris_agreement\/items\/9485.php."},{"key":"ref_2","unstructured":"Raoult, B., Bergeron, C., Alos, A.L., Thepaut, J.-N., and Dee, D. (2017). Climate service develops user-friendly data store. Meteorology, ECMWF."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Nightingale, J., Boersma, K.F., Muller, J.-P., Compernolle, S., Lambert, J.-C., Blessing, S., Giering, R., Gobron, N., de Smedt, I., and Coheur, P. (2018). Quality assurance framework development based on six new ECV data products to enhance user confidence for climate applications. Remote Sens., 10.","DOI":"10.20944\/preprints201806.0155.v1"},{"key":"ref_4","unstructured":"ESA (2015). Earth Observation Science Strategy for ESA: A New Era for Scientific Advances and Societal Benefits, ESA Communications."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Loew, A., Bell, W., Brocca, L., Bulgin, C., Burdanowitz, J., Calbert, X., Donner, R., Ghent, D., Gruber, A., and Kaminski, T. (2017). Validation practices for satellite-based Earth observation data across communities. Rev. Geophys., 779\u2013817.","DOI":"10.1002\/2017RG000562"},{"key":"ref_6","first-page":"150","article-title":"Analysis of current validation practices in Europe for space-based climate data records of essential climate variables","volume":"42","author":"Zeng","year":"2015","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_7","unstructured":"CDS, C.S. (2019, April 21). C3S Climate Data Store. Available online: https:\/\/cds.climate.copernicus.eu."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bojinski, S., Verstraete, M., Peterson, T., Richter, C., Simmons, A., and Zemp, M. (2014). The concept of essential climate variables in support of climate research, applications, and policy. Am. Meteorol. Soc., 1431\u20131443.","DOI":"10.1175\/BAMS-D-13-00047.1"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.envsci.2015.03.018","article-title":"Conformity testing of satellite-derived quantitative surface variables","volume":"51","author":"Widlowski","year":"2015","journal-title":"Environ. Sci. Policy"},{"key":"ref_10","unstructured":"QA4ECV (2019, April 21). Quality Assurance for Essential Climate Variables. Available online: http:\/\/www.qa4ecv.eu\/."},{"key":"ref_11","unstructured":"GAIA-CLIM (2019, April 21). Gap Analysis for Integrated Atmospheric ECV CLImate Monitoring. Available online: http:\/\/www.gaia-clim.eu\/."},{"key":"ref_12","unstructured":"FIDUCEO (2019, April 21). FIDelity and Uncertainty in Climate data records from Earth Observations. Available online: http:\/\/www.fiduceo.eu\/."},{"key":"ref_13","unstructured":"CLIM-RUN (2019, April 21). Climate Local Information in the Mediterranean Region Responding to User Needs. Available online: http:\/\/www.climrun.eu\/."},{"key":"ref_14","unstructured":"EUPORIAS (2019, April 21). European Provision of Regional Impacts Assessments on Seasonal and Decadal Timescales. Available online: http:\/\/www.euporias.eu\/."},{"key":"ref_15","unstructured":"CLIP-C (2019, April 21). Climate Information Portal. Available online: http:\/\/www.clipc.eu\/."},{"key":"ref_16","unstructured":"GLOBTEMP (2019, April 21). GlobTemperature. Available online: http:\/\/www.globtemperature.info\/."},{"key":"ref_17","unstructured":"CORE-CLIMAX (2019, April 21). COordinating Earth Observation Data Validation for RE-Analysis for CLIMAte ServiceS. Available online: https:\/\/cordis.europa.eu\/project\/rcn\/106564\/reporting\/en\/."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"511","DOI":"10.5194\/essd-9-511-2017","article-title":"Uncertainty information in climate data records from Earth observation","volume":"9","author":"Merchant","year":"2017","journal-title":"Earth Syst. Sci. Data"},{"key":"ref_19","unstructured":"JCGM (2012). International Vocabulary of Metrology\u2013\u2013Basic and General Concepts and Associated Terms (VIM), JCGM."},{"key":"ref_20","unstructured":"JCGM-100 (2008). Evaluation of Measurement Data\u2014Guide to the Expression of Uncertainty in Measurement, JCGM."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3383","DOI":"10.1080\/014311600750020000","article-title":"Developments in the validation of satellite sensor products for the study of the land surface","volume":"21","author":"Justice","year":"2000","journal-title":"Int. J. Remote Sens."},{"key":"ref_22","unstructured":"Fernandes, R., Plummer, S., Nightingale, J., Baret, F., Camacho, F., Fang, H., Garrigues, S., Gobron, N., Lang, M., and Lacaze, R. (2014). Global Leaf Area Index Product Validation Good Practices, CEOS. Version 2.0."},{"key":"ref_23","unstructured":"Guillevic, P., G\u00f6ttsche, F., Nickeson, J., Hulley, G., Ghent, D., Yu, Y., Trigo, I., Hook, S., Sobrino, J.A., and Remedios, J. (2018). Land Surface Temperature Product Validation Best Practice Protocol, CEOS. Version 1.1."},{"key":"ref_24","unstructured":"ESA (2019, April 21). Fiducial Reference Measurements: FRM. Available online: https:\/\/earth.esa.int\/web\/sppa\/activities\/frm."},{"key":"ref_25","unstructured":"RAMI (2019, April 21). RAdiation Transfer Model Intercomparison. Available online: http:\/\/rami-benchmark.jrc.ec.europa.eu\/HTML\/."},{"key":"ref_26","unstructured":"Parkinson, C., Ward, A., and King, M. (2006). Earth Science Reference Handbook: A Guide to NASA\u2019s Earth Science Program and Earth Observing Satellite Missions."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wu, X., Sullivan, J., and Heidinger, A.K. (2010). Operational calibration of the Advanced Very High Resolution Radiometer (AVHRR) visible and near-infrared channels. Can. J. Remote Sens., 36.","DOI":"10.5589\/m10-080"},{"key":"ref_28","unstructured":"Mittaz, J., Bali, M., and Harris, A. (2013, January 16\u201320). The calibration of broad band infrared sensors: Time variable biases and other issues. Proceedings of the EUMETSAT Meteorological Satellite Conference, Vienna, Austria."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1175\/2011JTECHA1517.1","article-title":"A physical method for the calibration of the AVHRR\/3 thermal IR channels. Part II: An in-orbit comparison of the AVHRR longwave thermal IR channels on board MetOp-A with IASI","volume":"28","author":"Mittaz","year":"2011","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"996","DOI":"10.1175\/2008JTECHO636.1","article-title":"A physical method for the calibration of the AVHRR\/3 thermal IR channels 1: The prelaunch calibration data","volume":"26","author":"Mittaz","year":"2009","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"012003","DOI":"10.1088\/1742-6596\/972\/1\/012003","article-title":"Applying metrological techniques to satellite fundamental climate data records","volume":"972","author":"Woolliams","year":"2018","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Mittaz, J., Merchant, C.J., and Woolliams, E.R. (2019). Applying principles of metrology to historical earth observations from satellites. Metrologia.","DOI":"10.1088\/1681-7575\/ab1705"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1616","DOI":"10.1029\/2001GL013206","article-title":"A spatio-temporal approach for global validation and analysis of MODIS aerosol products","volume":"29","author":"Ichoku","year":"2002","journal-title":"Geophys. Res. Lett."},{"key":"ref_34","unstructured":"GHRSST (2019, April 21). Group for High Resolution Sea Surface Temperature. Available online: www.ghrsst.org."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"23579","DOI":"10.1029\/1999JC900106","article-title":"Toward the elimination of bias in satellite retrievals of sea surface temperature: 2. comparison with in situ measurements","volume":"104","author":"Merchant","year":"1999","journal-title":"JGR Oceans"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1175\/1520-0485(1980)010<2094:OPLDOO>2.0.CO;2","article-title":"Optimal power-law description of oceanic whitecap coverage dependence on wind speed","volume":"19","author":"Monahan","year":"1980","journal-title":"J. Phys. Oceanogr."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"13725","DOI":"10.5194\/acp-16-13725-2016","article-title":"Parameterization of oceanic whitecap fraction based on satellite observations","volume":"16","author":"Albert","year":"2016","journal-title":"Atmos. Chem. Phys."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1109\/TGRS.1980.350304","article-title":"An empirical model for the complex dielectric permittivity of soils as a function of water content","volume":"18","author":"Wang","year":"1980","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1002\/joc.3711","article-title":"Updated high-resolution grids of monthly climatic observations-the CRU TS3.10 Dataset","volume":"34","author":"Harris","year":"2014","journal-title":"Int. J. Climatol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"L06405","DOI":"10.1029\/2005GL025583","article-title":"Amazon rainforests green-up with sunlight in dry season","volume":"33","author":"Huete","year":"2006","journal-title":"Geophys. Res. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Saleska, S., Didan, K., Huete, A., and da Rocha, H. (2007). Amazon forests green-up during 2005 drought. Science, 318.","DOI":"10.1126\/science.1146663"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Samanta, A., Ganguly, S., Hashimoto, H., Devadiga, S., Vermote, E., Knyazikhin, Y., Nemani, R., and Myneni, R. (2010). Amazon forests did not green-up during the 2005 drought. Geophys. Res. Lett., 37.","DOI":"10.1029\/2009GL042154"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.rse.2015.05.020","article-title":"On the measurability of change in Amazon vegetation from MODIS","volume":"166","author":"Hilker","year":"2015","journal-title":"Remote Sens. Environ."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/8\/986\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:46:59Z","timestamp":1760186819000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/8\/986"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,25]]},"references-count":43,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["rs11080986"],"URL":"https:\/\/doi.org\/10.3390\/rs11080986","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2019,4,25]]}}}