{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T10:32:56Z","timestamp":1762079576486,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2017,3,11]],"date-time":"2017-03-11T00:00:00Z","timestamp":1489190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Seventh Framework Programme","award":["308513"],"award-info":[{"award-number":["308513"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Volunteer geographical information (VGI), either in the context of citizen science or the mining of social media, has proven to be useful in various domains including natural hazards, health status, disease epidemics, and biological monitoring. Nonetheless, the variable or unknown data quality due to crowdsourcing settings are still an obstacle for fully integrating these data sources in environmental studies and potentially in policy making. The data curation process, in which a quality assurance (QA) is needed, is often driven by the direct usability of the data collected within a data conflation process or data fusion (DCDF), combining the crowdsourced data into one view, using potentially other data sources as well. Looking at current practices in VGI data quality and using two examples, namely land cover validation and inundation extent estimation, this paper discusses the close links between QA and DCDF. It aims to help in deciding whether a disentanglement can be possible, whether beneficial or not, in understanding the data curation process with respect to its methodology for future usage of crowdsourced data. Analysing situations throughout the data curation process where and when entanglement between QA and DCDF occur, the paper explores the various facets of VGI data capture, as well as data quality assessment and purposes. Far from rejecting the usability ISO quality criterion, the paper advocates for a decoupling of the QA process and the DCDF step as much as possible while still integrating them within an approach analogous to a Bayesian paradigm.<\/jats:p>","DOI":"10.3390\/ijgi6030078","type":"journal-article","created":{"date-parts":[[2017,3,13]],"date-time":"2017-03-13T10:26:18Z","timestamp":1489400778000},"page":"78","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["On Data Quality Assurance and Conflation Entanglement in Crowdsourcing for Environmental Studies"],"prefix":"10.3390","volume":"6","author":[{"given":"Didier","family":"Leibovici","sequence":"first","affiliation":[{"name":"Nottingham Geospatial Institute, University of Nottingham, Nottingham NG7 2RD, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julian","family":"Rosser","sequence":"additional","affiliation":[{"name":"Nottingham Geospatial Institute, University of Nottingham, Nottingham NG7 2RD, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Crona","family":"Hodges","sequence":"additional","affiliation":[{"name":"Earth Observation Group, Aberystwyth University Penglais, Aberystwyth SY23 3FL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Barry","family":"Evans","sequence":"additional","affiliation":[{"name":"College of Engineering, Mathematics and Physical Sciences, University of Exeter, Exeter EX4 4QF, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Jackson","sequence":"additional","affiliation":[{"name":"Nottingham Geospatial Institute, University of Nottingham, Nottingham NG7 2RD, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris","family":"Higgins","sequence":"additional","affiliation":[{"name":"EDINA, University of Edinburgh, Edinburgh EH8 9YL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,3,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1080\/17538947.2015.1008214","article-title":"Data democracy\u2014Increased supply of geospatial information and expanded participatory processes in the production of data","volume":"8","author":"Craglia","year":"2015","journal-title":"Int. J. Dig. Earth"},{"key":"ref_2","unstructured":"Haklay, M. (2015). Citizen Science and Policy: A European Perspective, Woodrow Wilson International Center for Scholars."},{"key":"ref_3","unstructured":"Pocock, M.J.O., Chapman, D.S., Sheppard, L.J., and Roy, H.E. (2014). A Strategic Framework to Support the Implementation of Citizen Science for Environmental Monitoring, Centre for Ecology & Hydrology. Final Report to SEPA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s10708-008-9188-y","article-title":"The credibility of volunteered geographic information","volume":"72","author":"Flanagin","year":"2008","journal-title":"GeoJournal"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1111\/tgis.12034","article-title":"How Reliable Are Citizen-derived Scientific Data? Assessing the Quality of Contrail Observations Made by the General Public","volume":"17","author":"Fowler","year":"2013","journal-title":"Trans. GIS"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Alabri, A., and Hunter, J. (2010, January 7\u201310). Enhancing the Quality and Trust of Citizen Science Data. Proceedings of the 2010 IEEE Sixth International Conference on e-Science (e-Science), Bribane, Australia.","DOI":"10.1109\/eScience.2010.33"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1080\/17538947.2014.976774","article-title":"On predicting and improving the quality of Volunteer Geographic Information projects","volume":"9","author":"Bordogna","year":"2016","journal-title":"Int. J. Dig. Earth"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.spasta.2012.03.002","article-title":"Assuring the quality of volunteered geographic information","volume":"1","author":"Goodchild","year":"2012","journal-title":"Spat. Stat."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Leibovici, D.G., Williams, J., Rosser, J.F., Hodges, C., Scott, D., Chapman, C., Higgins, C., and Jackson, M.J. (2017). Earth Observation for Citizen Science validation, or, Citizen Science for Earth Observation validation? Role of the Quality Assurance of Volunteered Observations. J. Spat. Inf. Sci., submitted.","DOI":"10.20944\/preprints201710.0016.v1"},{"key":"ref_10","unstructured":"Meek, S., Jackson, M., and Leibovici, D.G. (2014, January 3\u20136). A flexible framework for assessing the quality of crowdsourced data. Proceedings of the AGILE 2014 Conference, Castellon, Spain."},{"key":"ref_11","first-page":"20","article-title":"Citizen OBservatory WEB (COBWEB): A Generic Infrastructure Platform to Facilitate the Collection of Citizen Science data for Environmental Monitoring","volume":"11","author":"Higgins","year":"2016","journal-title":"Int. J. Spat. Data Infrastruct. Res."},{"key":"ref_12","unstructured":"Jackson, M., Meek, S., and Leibovici, D.G. (2014, January 16\u201320). NSDI data enhancement through crowdsourcing: The role of quality assurance to ensure effective conflation of authoritative and non-authoritative data sources. Proceedings of the INSPIRE Conference, Aalborg University, Aalborg, Denmark."},{"key":"ref_13","unstructured":"Leibovici, D.G., Evans, B., Hodges, C., Wiemann, S., Meek, S., Rosser, J., and Jackson, M. (2015, January 29\u201330). On Data Quality Assurance and Conflation Entanglement in Crowdsourcing for Environmental Studies. Proceedings of the ISSDQ 2015, ISPRS Geospatial Week, La Grande-Motte, France."},{"key":"ref_14","unstructured":"Wiemann, S., and Bernard, L. (2010, January 11\u201314). Conflation Services within Spatial Data Infrastructure. Proceedings of the AGILE 2010 Conference, Guimaraes, Portugal."},{"key":"ref_15","unstructured":"Wiemann, S., Meek, S., Leibovici, D.G., Jackson, M., Chapman, C., and Lars, B. (2015, January 9\u201312). Service-based combination of quality assurance and fusion processes for the validation of crowdsourced observations. Proceedings of the AGILE 2015 Conference, Lisbon, Portugal."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1016\/j.cageo.2012.09.028","article-title":"Mobile capture of remote points of interest using line of sight modelling","volume":"52","author":"Meek","year":"2013","journal-title":"Comput. Geosci."},{"key":"ref_17","first-page":"37","article-title":"Using control data to determine the reliability of volunteered geographic information about land cover","volume":"23","author":"Comber","year":"2013","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1111\/tgis.12033","article-title":"Assessing the Accuracy of Volunteered Geographic Information arising from Multiple Contributors to an Internet Based Collaborative Project","volume":"17","author":"Foody","year":"2013","journal-title":"Trans. GIS"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1080\/00087041.2015.1108658","article-title":"Accurate Attribute Mapping from Volunteered Geographic Information: Issues of Volunteer Quantity and Quality","volume":"52","author":"Foody","year":"2015","journal-title":"Cartogr. J."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"See, L., Comber, A., Salk, C., Fritz, S., van der Velde, M., Perger, C., Schill, C., McCallum, I., Kraxner, F., and Obersteiner, M. (2013). Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0069958"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.envsoft.2011.11.015","article-title":"Geo-Wiki: An online platform for improving global land cover","volume":"31","author":"Fritz","year":"2012","journal-title":"Environ. Model. Softw."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1093\/aje\/kwt286","article-title":"Latent class models in diagnostic studies when there is no reference standard\u2014A systematic review","volume":"179","author":"Naaktgeboren","year":"2014","journal-title":"Am. J. Epidemiol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Smith, L., Liang, Q., James, P., and Lin, W. (2015). Assessing the utility of social media as a data source for flood risk management using a real-time modelling framework. J. Flood Risk Manag.","DOI":"10.1111\/jfr3.12154"},{"key":"ref_24","unstructured":"Leibovici, D.G., and Rosser, J.F. (2016, January 5\u20138). Multiway sensitivity analysis of the fusion of earth observation, topography and social media data for rapid flood mapping Spatial Accuracy. Proceedings of the 12th International Symposium, Montpellier, France."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Rosser, J.F., Jackson, M.J., and Leibovici, D.G. (2017). Rapid flood inundation mapping using social media, remote sensing and topographic data. Nat. Hazards.","DOI":"10.1007\/s11069-017-2755-0"},{"key":"ref_26","unstructured":"Evans, B., Brewer, P., O\u2019Grady, M., Muldoon, C., and O\u2019Hare, G. (2016, January 7\u20139). Deriving fuzzy flood extents from geo-tagged photographs using Boolean models and smartphone technology. Proceedings of the COWM2016\u2014International Conference on Citizen Observatories for Water Management, Venice, Italy."},{"key":"ref_27","unstructured":"Krupka, M., Pender, G., Wallis, S., Sayers, P.B., and Mulet-Marti, J. (2007, January 1\u20136). A Rapid Flood Inundation Model. Proceedings of the 32th IAHR Congress, Venice, Italy."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Antelio, M., Esteves, M.G.P., Schneider, D., and de Souza, J.M. (2012, January 14\u201317). Qualitocracy: A data quality collaborative framework applied to citizen science. Proceedings of the 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Seoul, Korea.","DOI":"10.1109\/ICSMC.2012.6377847"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1068\/b35097","article-title":"How good is volunteered geographical information? A comparative study of OpenStreetMap and Ordnance Survey datasets","volume":"37","author":"Haklay","year":"2010","journal-title":"Environ. Plan. B Plan. Des."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1002\/cpe.2923","article-title":"Assessing the quality and trustworthiness of citizen science data","volume":"25","author":"Hunter","year":"2013","journal-title":"Concurr. Computat. Pract. Exp."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wamcke-Wang, M., Ayukaev, V.R., Hecht, B., and Terveen, L.G. (2015, January 14\u201318). The Success and Failure of Quality Improvement Projects in Peer Production Communities. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW\u201915, Vancouver, BC, Canada.","DOI":"10.1145\/2675133.2675241"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2282","DOI":"10.1016\/j.biocon.2009.05.006","article-title":"eBird: A citizen-based bird observation network in the biological sciences","volume":"142","author":"Sullivan","year":"2009","journal-title":"Biol. Conserv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wiggins, A., and Crowston, K. (2011, January 4\u20137). From conservation to crowdsourcing: A typology of citizen science. Proceedings of the 44th Hawaii International Conference on System Sciences (HICSS), Kauai, HI, USA.","DOI":"10.1109\/HICSS.2011.207"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Mobasheri, A., Zipf, A., Bakillah, M., and Liang, S.H. (2013, January 29\u201331). QualEvS4Geo: A peer-to-peer system architecture for semi-automated quality evaluation of geo-data in SDI. Proceedings of the Third International Conference on Innovative Computing Technology (INTECH), London, UK.","DOI":"10.1109\/INTECH.2013.6653650"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Fonte, C.C., Bastin, L., Foody, G., Kellenberger, T., Kerle, N., Mooney, P., Olteanu-Raimond, A.-M., and See, L. (2015, January 29\u201330). VGI quality control. Proceedings of the ISPRS Geospatial Week, La Grande-Motte, France.","DOI":"10.5194\/isprsannals-II-3-W5-317-2015"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Tenbrink, T., Stell, J., Galton, A., and Wood, Z. (2013). Spatial Information Theory, Lecture Notes in Computer Science, Springer International Publishing.","DOI":"10.1007\/978-3-319-01790-7"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"10","DOI":"10.3390\/ijgi5020010","article-title":"A Spatio-Temporal VGI Model Considering Trust-Related Information","volume":"5","author":"Zhao","year":"2016","journal-title":"ISPRS Int. J. Geo Inf."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ceccaroni, L., and Piera, J. (2016). Analyzing the Role of Citizen Science in Modern Research, IGI-Global.","DOI":"10.4018\/978-1-5225-0962-2"},{"key":"ref_39","unstructured":"Tweddle, J.C., Robinson, L.D., Pocock, M.J.O., and Roy, H.E. (2012). Guide to Citizen Science: Developing, Implementing and Evaluating Citizen Science to Study Biodiversity and the Environment in the UK, Natural History Museum and NERC Centre for Ecology & Hydrology for UK-EOF."},{"key":"ref_40","unstructured":"Pawlowicz, S., Leibovici, D.G., Haines-Young, R., Saull, R., and Jackson, M.J. (2011, January 5\u20137). Dynamical Surveying Adjustments for Crowd-sourced Data Observations. Proceedings of the EnviroInfo Conference, Ispra, Italy."},{"key":"ref_41","unstructured":"Victor, S. (2014). Dynamic Model-Based Validation of Crowd-Sourced Data. [Ph.D. Thesis, University of Nottingham]."},{"key":"ref_42","unstructured":"Hedges, L.V., and Olkin, I. (1985). Statistical Method for Meta-Analysis, Academic Press."},{"key":"ref_43","unstructured":"Lothian, J., and Osborne, N. (2016). Crowd Power: The COBWEB Guide to Citizen Science, Collection BHP Comics, Black Hearted Press Ltd."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/6\/3\/78\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:30:16Z","timestamp":1760207416000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/6\/3\/78"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,3,11]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2017,3]]}},"alternative-id":["ijgi6030078"],"URL":"https:\/\/doi.org\/10.3390\/ijgi6030078","relation":{},"ISSN":["2220-9964"],"issn-type":[{"type":"electronic","value":"2220-9964"}],"subject":[],"published":{"date-parts":[[2017,3,11]]}}}