{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T04:21:50Z","timestamp":1772252510419,"version":"3.50.1"},"reference-count":43,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2017,10,23]],"date-time":"2017-10-23T00:00:00Z","timestamp":1508716800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union Seventh Framework Programme","award":["308513"],"award-info":[{"award-number":["308513"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Data"],"abstract":"<jats:p>Environmental policy involving citizen science (CS) is of growing interest. In support of this open data stream of information, validation or quality assessment of the CS geo-located data to their appropriate usage for evidence-based policy making needs a flexible and easily adaptable data curation process ensuring transparency. Addressing these needs, this paper describes an approach for automatic quality assurance as proposed by the Citizen OBservatory WEB (COBWEB) FP7 project. This approach is based upon a workflow composition that combines different quality controls, each belonging to seven categories or \u201cpillars\u201d. Each pillar focuses on a specific dimension in the types of reasoning algorithms for CS data qualification. These pillars attribute values to a range of quality elements belonging to three complementary quality models. Additional data from various sources, such as Earth Observation (EO) data, are often included as part of the inputs of quality controls within the pillars. However, qualified CS data can also contribute to the validation of EO data. Therefore, the question of validation can be considered as \u201ctwo sides of the same coin\u201d. Based on an invasive species CS study, concerning Fallopia japonica (Japanese knotweed), the paper discusses the flexibility and usefulness of qualifying CS data, either when using an EO data product for the validation within the quality assurance process, or validating an EO data product that describes the risk of occurrence of the plant. Both validation paths are found to be improved by quality assurance of the CS data. Addressing the reliability of CS open data, issues and limitations of the role of quality assurance for validation, due to the quality of secondary data used within the automatic workflow, are described, e.g., error propagation, paving the route to improvements in the approach.<\/jats:p>","DOI":"10.3390\/data2040035","type":"journal-article","created":{"date-parts":[[2017,10,23]],"date-time":"2017-10-23T12:20:24Z","timestamp":1508761224000},"page":"35","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Earth Observation for Citizen Science Validation, or Citizen Science for Earth Observation Validation? The Role of Quality Assurance of Volunteered Observations"],"prefix":"10.3390","volume":"2","author":[{"given":"Didier","family":"Leibovici","sequence":"first","affiliation":[{"name":"Nottingham Geospatial Science, University of Nottingham, Nottingham NG7 2TU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4980-8428","authenticated-orcid":false,"given":"Jamie","family":"Williams","sequence":"additional","affiliation":[{"name":"Environment Systems Ltd., Aberystwyth SY23 3AH, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julian","family":"Rosser","sequence":"additional","affiliation":[{"name":"Nottingham Geospatial Science, University of Nottingham, Nottingham NG7 2TU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Crona","family":"Hodges","sequence":"additional","affiliation":[{"name":"Earth Observation Group, Aberystwyth University Penglais, Aberystwyth SY23 3JG, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Colin","family":"Chapman","sequence":"additional","affiliation":[{"name":"Welsh Government, Aberystwyth SY23 3UR, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris","family":"Higgins","sequence":"additional","affiliation":[{"name":"EDINA, University of Edinburgh, Edinburgh EH3 9DR, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mike","family":"Jackson","sequence":"additional","affiliation":[{"name":"Nottingham Geospatial Science, University of Nottingham, Nottingham NG7 2TU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,10,23]]},"reference":[{"key":"ref_1","unstructured":"DEFRA (2016, July 30). UK Biodiversity Indicators in Your Pocket, Available online: http:\/\/jncc.defra.gov.uk\/page-4229#download."},{"key":"ref_2","unstructured":"Williams, F., Eschen, R., Harris, A., Djeddour, D., Pratt, C., Shaw, R.S., Varia, S., Lamontagne-godwin, J., Thomas, S.E., and Murphy, S.T. (2010). The Economic Cost of Invasive Non-Native Species on Great Britain, CABI. CABI Report."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1016\/j.tree.2009.03.017","article-title":"A new dawn for citizen science","volume":"24","author":"Silvertown","year":"2009","journal-title":"Trends Ecol. Evol."},{"key":"ref_4","unstructured":"Butcher, G.S. (1990). Audubon Christmas Bird Counts."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1525\/bio.2009.59.11.9","article-title":"Citizen Science: A Developing Tool for Expanding Science Knowledge and Scientific Literacy","volume":"59","author":"Bonney","year":"2009","journal-title":"BioScience"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sui, D.Z., Elwood, S., and Goodchild, M.F. (2013). Citizen Science and Volunteered Geographic Information\u2014Overview and typology of participation. Crowdsourcing Geographic Knowledge: Volunteered Geographic Information (VGI) in Theory and Practice, Springer. [1st ed.].","DOI":"10.1007\/978-94-007-4587-2"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s10708-007-9111-y","article-title":"Citizens as sensors: The world of volunteered geography","volume":"69","author":"Goodchild","year":"2007","journal-title":"GeoJournal"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1269","DOI":"10.1080\/13658816.2015.1018266","article-title":"Usability of VGI for validation of land cover maps","volume":"29","author":"Fonte","year":"2015","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.respol.2013.07.005","article-title":"Crowd science: The organisation of scientific research in open collaborative projects","volume":"43","author":"Franzoni","year":"2014","journal-title":"Res. Policy"},{"key":"ref_10","unstructured":"Roy, H.E., Pocock, M.J.O., Preston, C.D., Roy, D.B., Savage, J., Tweddle, J.C., and Robinson, L.D. (2012). Understanding Citizen Science & Environmental Monitoring: Final Report on Behalf of UK-EOF, NERC Centre for Ecology & Hydrology and Natural History Museum."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"215","DOI":"10.3391\/mbi.2015.6.2.12","article-title":"Trying to engage the crowd in recording invasive alien species in Europe: Experienced from two smartphone applications in northwest Europe","volume":"6","author":"Adriaens","year":"2015","journal-title":"Manag. Biol. Invasions"},{"key":"ref_12","first-page":"20","article-title":"Citizen OBservatory WEB (COBWEB): A Generic Infrastructure Platform to Facilitate the Collection of Citizen Science data for Environmental Monitoring","volume":"11","author":"Higgins","year":"2016","journal-title":"Int. J. Spat. Data Infrastruct. Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1221","DOI":"10.5194\/isprsarchives-XL-7-W3-1221-2015","article-title":"Citizen Science for Earth Observation: Applications in Environmental Monitoring and Disaster Response","volume":"40","author":"Kotovirta","year":"2015","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_14","unstructured":"See, L., Sturn, T., Perger, C., Fritz, S., Mccallum, I., and Salk, C. (2014, January 3\u20136). Cropland Capture: A Gaming Approach to Improve Global Land Cover. Proceedings of the AGILE 2014 International Conference on Geographic Information Science, Castellon, Spain."},{"key":"ref_15","unstructured":"Sturn, T., Pangerl, D., See, L., Fritz, S., and Wimmer, M. (2013, January 2\u20135). Landspotting: A serious iPad game for improving global land cover. Proceedings of the GI-Forum 2013, Salzburg, Austria."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Fabrikant, S.I., Raubal, M., Bertolotto, M., Davies, C., Freundschuh, Z., and Bell, S. (2015). Citizen science land cover classification based on ground and aerial imagery. Spatial Information Theory (COSIT 2015), Lecture Notes in Computer Science, Springer.","DOI":"10.1007\/978-3-319-23374-1"},{"key":"ref_17","unstructured":"Kinley, L.R. (2015). Exploring the Use of Crowd Generated Geospatial Content in Improving the Quality of Ecological Feature Mapping. [Master\u2019s Thesis, The University of Nottingham]."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.geoderma.2015.05.006","article-title":"Can citizen science assist digital soil mapping?","volume":"259\u2013260","author":"Rossiter","year":"2015","journal-title":"Geoderma"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1016\/j.jhydrol.2016.04.062","article-title":"Filling the observational void: Scientific value and a quantitative validation of hydrometeorological data from a community-based monitoring programme","volume":"538","author":"Walker","year":"2016","journal-title":"J. Hydrol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"345","DOI":"10.3390\/rs1030345","article-title":"Geo-Wiki.Org: The Use of Crowdsourcing to Improve Global Land Cover","volume":"1","author":"Fritz","year":"2009","journal-title":"Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s10708-008-9188-y","article-title":"The credibility of volunteered geographic information","volume":"72","author":"Flanagin","year":"2008","journal-title":"GeoJournal"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.spasta.2012.03.002","article-title":"Assuring the Quality of Volunteered Geographic Information","volume":"1","author":"Goodchild","year":"2012","journal-title":"Spat. Stat."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1111\/tgis.12034","article-title":"How Reliable Are Citizen-derived Scientific Data? Assessing the Quality of Contrail Observations Made by the General Public","volume":"17","author":"Fowler","year":"2013","journal-title":"Trans. GIS"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1080\/00087041.2015.1108658","article-title":"Accurate Attribute Mapping from Volunteered Geographic Information: Issues of Volunteer Quantity and Quality","volume":"52","author":"Foody","year":"2014","journal-title":"Cartogr. J."},{"key":"ref_25","first-page":"37","article-title":"Using control data to determine the reliability of volunteered geographic information about land cover","volume":"23","author":"Comber","year":"2013","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Leibovici, D.G., Evans, B., Hodges, C., Wiemann, S., Meek, S., Rosser, J., and Jackson, M. (2017). On Data Quality Assurance and Conflation Entanglement in Crowdsourcing for Environmental Studies. ISPRS Int. J. Geo-Inf., 6.","DOI":"10.3390\/ijgi6030078"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1002\/cpe.2923","article-title":"Assessing the quality and trustworthiness of citizen science data","volume":"25","author":"Hunter","year":"2013","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/17538947.2015.1008214","article-title":"Data democracy\u2013increased supply of geospatial information and expanded participatory processes in the production of data","volume":"8","author":"Craglia","year":"2015","journal-title":"Int. J. Digit. Earth"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1191\/030913305pp437pr","article-title":"Remote sensing: Ecology","volume":"29","author":"Aplin","year":"2005","journal-title":"Prog. Phys. Geogr."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"7987","DOI":"10.3390\/rs70607987","article-title":"Remote Sensing and GIS for Habitat Quality Monitoring: New Approaches and Future Research","volume":"7","author":"Zlinsky","year":"2015","journal-title":"Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"319","DOI":"10.3390\/rs3020319","article-title":"Object-Based Image Analysis for Detection of Japanese knotweed s.l. taxa (Polygonaceae) in Wales (UK)","volume":"3","author":"Jones","year":"2011","journal-title":"Remote Sens."},{"key":"ref_32","unstructured":"Viana, H., and Aranha, J.T.M. (2010, January 21\u201327). Mapping Invasive Species (Acacia Dealbata Link) Using ASTER\/TERRA and LANDSAT 7 ETM+ Imagery. Proceedings of the Conference of IUFRO Landscape Ecology Working Group, Bragan\u00e7a, Portugal."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.biocon.2013.05.025","article-title":"Realising the full potential of citizen science monitoring programs","volume":"165","author":"Tulloch","year":"2013","journal-title":"Biol. Conserv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Alabri, A., and Hunter, J. (2010, January 7\u201310). Enhancing the Quality and Trust of Citizen Science Data. Proceedings of the 2010 IEEE Sixth International Conference on e-Science (e-Science), Brisbane, Australia.","DOI":"10.1109\/eScience.2010.33"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.ins.2013.07.013","article-title":"A Linguistic Decision Making Approach to Assess the Quality of Volunteer Geographic Information for Citizen Science","volume":"258","author":"Bordogna","year":"2014","journal-title":"Inf. Sci."},{"key":"ref_36","unstructured":"Meek, S., Jackson, M., and Leibovici, D.G. (2014, January 3\u20136). A flexible framework for assessing the quality of crowdsourced data. Proceedings of the 17th AGILE Conference, Castellon, Spain. Available online: https:\/\/agile-online.org\/index.php\/conference\/proceedings\/proceedings-2014."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.cageo.2015.12.003","article-title":"A BPMN solution for chaining OGC services to quality assure location-based crowdsourced data","volume":"87","author":"Meek","year":"2016","journal-title":"Comput. Geosci."},{"key":"ref_38","unstructured":"Rosser, J., Pourabdolllah, A., Brackin, R., Jackson, M.J., and Leibovici, D.G. (2016, January 14\u201317). Full Meta Objects for Flexible Geoprocessing Workflows: Profiling WPS or BPMN?. Proceedings of the 19th AGILE Conference, Helsinki, Finland. Available online: https:\/\/agile-online.org\/index.php\/conference\/proceedings\/proceedings-2016."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1111\/tgis.12021","article-title":"The Influence of Digital Surface Model Choice on Visibility-Based Mobile Geospatial Applications","volume":"17","author":"Meek","year":"2013","journal-title":"Trans. GIS"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"3273","DOI":"10.1080\/01431160903121126","article-title":"Methodology to map the spread of an invasive plant (Lantana camara L.) in forest ecosystems using Indian remote sensing satellite data","volume":"31","author":"Kimothi","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"119","DOI":"10.3391\/mbi.2015.6.2.02","article-title":"The importance of open data for invasive alien species research, policy and management","volume":"6","author":"Groom","year":"2015","journal-title":"Manag. Biol. Invasions"},{"key":"ref_42","unstructured":"Dodd, M. (2016, January 19\u201321). iSPot Data Quality, Metadata and Visualization. Proceedings of the 1st European Citizen Science Association conference, Berlin, Germany. Available online: http:\/\/www.ecsa2016.eu\/."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Grainger, A. (2017). Citizen Observatories and the New Earth Observation Science. Remote Sens., 9.","DOI":"10.3390\/rs9020153"}],"container-title":["Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5729\/2\/4\/35\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:48:14Z","timestamp":1760208494000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5729\/2\/4\/35"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,23]]},"references-count":43,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["data2040035"],"URL":"https:\/\/doi.org\/10.3390\/data2040035","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints201710.0016.v1","asserted-by":"object"}]},"ISSN":["2306-5729"],"issn-type":[{"value":"2306-5729","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10,23]]}}}