{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T19:10:24Z","timestamp":1780686624337,"version":"3.54.1"},"reference-count":43,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2017,3,14]],"date-time":"2017-03-14T00:00:00Z","timestamp":1489449600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>With the development of location-aware devices and the success and high use of Web 2.0 techniques, citizens are able to act as sensors by contributing geographic information. In this context, data quality is an important aspect that should be taken into account when using this source of data for different purposes. The goal of the paper is to analyze the quality of crowdsourced data and to study its evolution over time. We propose two types of approaches: (1) use the intrinsic characteristics of the crowdsourced datasets; or (2) evaluate crowdsourced Points of Interest (POIs) using external datasets (i.e., authoritative reference or other crowdsourced datasets), and two different methods for each approach. The potential of the combination of these approaches is then demonstrated, to overcome the limitations associated with each individual method. In this paper, we focus on POIs and places coming from the very successful crowdsourcing project: OpenStreetMap. The results show that the proposed approaches are complementary in assessing data quality. The positive results obtained for data matching show that the analysis of data quality through automatic data matching is possible but considerable effort and attention are needed for schema matching given the heterogeneity of OSM and the representation of authoritative datasets. For the features studied, it can be noted that change over time is sometimes due to disagreements between contributors, but in most cases the change improves the quality of the data.<\/jats:p>","DOI":"10.3390\/ijgi6030080","type":"journal-article","created":{"date-parts":[[2017,3,14]],"date-time":"2017-03-14T11:53:52Z","timestamp":1489492432000},"page":"80","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":47,"title":["Assessing Crowdsourced POI Quality: Combining Methods Based on Reference Data, History, and Spatial Relations"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6113-6903","authenticated-orcid":false,"given":"Guillaume","family":"Touya","sequence":"first","affiliation":[{"name":"Univ. Paris-Est, LASTIG COGIT, IGN, ENSG, F-94160 Saint-Mande, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7365-9995","authenticated-orcid":false,"given":"Vyron","family":"Antoniou","sequence":"additional","affiliation":[{"name":"Hellenic Military Geographical Service, Evelpidon 4, Athens 11362, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1101-1333","authenticated-orcid":false,"given":"Ana-Maria","family":"Olteanu-Raimond","sequence":"additional","affiliation":[{"name":"Univ. Paris-Est, LASTIG COGIT, IGN, ENSG, F-94160 Saint-Mande, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marie-Dominique","family":"Van Damme","sequence":"additional","affiliation":[{"name":"Univ. Paris-Est, LASTIG COGIT, IGN, ENSG, F-94160 Saint-Mande, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,3,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1179\/000870410X12911304958827","article-title":"How many volunteers does it take to map an area well? The validity of linus\u2019s law to volunteered geographic information","volume":"47","author":"Haklay","year":"2010","journal-title":"Cartogr. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1068\/b35097","article-title":"How good is volunteered geographical information? A comparative study of OpenStreetMap and ordnance survey datasets","volume":"37","author":"Haklay","year":"2010","journal-title":"Environ. Plan. B Plan. Des."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1111\/j.1467-9671.2010.01203.x","article-title":"Quality assessment of the french OpenStreetMap dataset","volume":"14","author":"Girres","year":"2010","journal-title":"Trans. GIS"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1080\/13658816.2016.1189556","article-title":"A review of volunteered geographic information quality assessment methods","volume":"31","author":"Senaratne","year":"2017","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1269","DOI":"10.1080\/13658816.2015.1018266","article-title":"Usability of VGI for validation of land cover maps","volume":"29","author":"Fonte","year":"2015","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_6","first-page":"345","article-title":"Measures and indicators of VGI quality: An overview","volume":"II-3\/W5","author":"Antoniou","year":"2015","journal-title":"ISPRS Ann."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Fabrikant, S.I., Raubal, M., Bertolotto, M., Davies, C., Freundschuh, S., and Bell, S. (2015). Spatial Information Theory, Springer.","DOI":"10.1007\/978-3-319-23374-1"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1940","DOI":"10.1080\/13658816.2014.909045","article-title":"Fine-resolution population mapping using OpenStreetMap points-of-interest","volume":"28","author":"Bakillah","year":"2014","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_9","first-page":"41","article-title":"Estimating disaggregated employment size from points-of-interest and census data: From mining the web to model implementation and visualization","volume":"6","author":"Rodrigues","year":"2013","journal-title":"Int. J. Adv. Intell. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.compenvurbsys.2014.12.001","article-title":"Mining point-of-interest data from social networks for urban land use classification and disaggregation","volume":"53","author":"Jiang","year":"2015","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_11","unstructured":"Bawa-Cavia, A. (2011, January 12). Sensing the urban: Using location-based social network data in urban analysis. Proceedings of the Workshop on Pervasive Urban Applications (PURBA) 2011, San Francisco, CA, USA."},{"key":"ref_12","first-page":"291","article-title":"Social media as a source for studying people\u2019s perception and knowledge of environments","volume":"155","author":"Huang","year":"2013","journal-title":"Mitteilungen \u00d6sterreichischen Geogr. Ges."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"195","DOI":"10.5194\/isprsannals-II-3-W5-195-2015","article-title":"On data quality assurance and conflation entanglement in crowdsourcing for environmental studies","volume":"II-3\/W5","author":"Leibovici","year":"2015","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1111\/tgis.12073","article-title":"A comprehensive framework for intrinsic OpenStreetMap quality analysis","volume":"18","author":"Barron","year":"2014","journal-title":"Trans. GIS"},{"key":"ref_15","unstructured":"Antoniou, V. (2011). User Generated Spatial Content: An Analysis of the Phenomenon and Its Challenges for Mapping Agencies. [Ph.D. Thesis, University College London]."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1080\/17538947.2012.712273","article-title":"Digital earth from vision to practice: Making sense of citizen-generated content","volume":"5","author":"Craglia","year":"2012","journal-title":"Int. J. Dig. Earth"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Capineri, C., Haklay, M., Huang, H., Antoniou, V., Kettunen, J., Ostermann, F., and Purves, R. (2016). European Handbook of Crowdsourced Geographic Information, Ubiquity Press.","DOI":"10.5334\/bax"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jonietz, D., and Zipf, A. (2016). Defining fitness-for-use for crowdsourced points of interest (POI). ISPRS Int. J. Geo-Inf., 5.","DOI":"10.3390\/ijgi5090149"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Soden, R., and Palen, L. (2014, January 27\u201330). From crowdsourced mapping to community mapping: The post-earthquake work of OpenStreetMap Haiti. Proceedings of the 11th International Conference on the Design of Cooperative Systems, Nice, France.","DOI":"10.1007\/978-3-319-06498-7_19"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Haklay, M., Antoniou, V., Basiouka, S., Soden, R., and Mooney, P. (2014). Crowdsourced Geographic Information Use in Government, World Bank Publications.","DOI":"10.1596\/20725"},{"key":"ref_21","first-page":"17","article-title":"What is Web 2.0: Design patterns and business models for the next generation of software","volume":"1","year":"2007","journal-title":"Commun. Strateg."},{"key":"ref_22","first-page":"21","article-title":"Exploring place through user-generated content: Using Flickr tags to describe city cores","volume":"1","author":"Hollenstein","year":"2010","journal-title":"J. Spat. Inf. Sci."},{"key":"ref_23","unstructured":"Purves, R., and Weibel, R. (2010). Extended Abstracts Volume, GIScience 2010, GIScience."},{"key":"ref_24","unstructured":"Ciep\u0142uch, B., Jacob, R., Mooney, P., and Winstanley, A.C. (2010, January 20\u201323). Comparison of the accuracy of OpenStreetMap for Ireland with Google maps and Bing maps. Proceedings of the Ninth International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, Leicester, UK."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Vandenbroucke, D., Bucher, B., and Crompvoets, J. (2013). Geographic Information Science at the Heart of Europe, Springer.","DOI":"10.1007\/978-3-319-00615-4"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s10708-008-9190-4","article-title":"Commentary: Whither VGI?","volume":"72","author":"Goodchild","year":"2008","journal-title":"GeoJournal"},{"key":"ref_27","unstructured":"International Organization for Standardization (2013). ISO 19157: Geographic Information: Data Quality (DIS), ISO\/TC211."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.spasta.2012.03.002","article-title":"Assuring the quality of volunteered geographic information","volume":"1","author":"Goodchild","year":"2012","journal-title":"Spat. Stat."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"134","DOI":"10.3138\/carto.48.2.1836","article-title":"Detecting Level-of-Detail inconsistencies in volunteered geographic information data sets","volume":"48","author":"Touya","year":"2013","journal-title":"Cartographica"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/j.compenvurbsys.2009.07.002","article-title":"A functional perspective on map generalisation","volume":"33","author":"Chaudhry","year":"2009","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"507","DOI":"10.3390\/ijgi2020507","article-title":"Assessing completeness and spatial error of features in volunteered geographic information","volume":"2","author":"Jackson","year":"2013","journal-title":"ISPRS Int. J. Geo-Inf."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Leitner, M., and Jokar Arsanjani, J. (2016). Citizen Empowered Mapping, Springer.","DOI":"10.1007\/978-3-319-51629-5"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"700","DOI":"10.1080\/13658816.2013.867495","article-title":"Quality assessment for building footprints data on OpenStreetMap","volume":"28","author":"Fan","year":"2014","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_34","first-page":"21","article-title":"Knowledge formalization for vector data matching using belief theory","volume":"10","author":"Ruas","year":"2015","journal-title":"J. Spat. Inf. Scie."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Jokar Arsanjani, J., Zipf, A., Mooney, P., and Helbich, M. (2015). OpenStreetMap in GIScience: Experiences, Research, Applications, Springer.","DOI":"10.1007\/978-3-319-14280-7"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Quattrone, G., Capra, L., and de Meo, P. (2015, January 14\u201318). There\u2019s No Such Thing as the Perfect Map: Quantifying Bias in Spatial Crowd-Sourcing Datasets. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, Vancouver, BC, Canada.","DOI":"10.1145\/2675133.2675235"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Bordogna, G., Frigerio, L., Kliment, T., Brivio, P.A., Hossard, L., Manfron, G., and Sterlacchini, S. (2016). \u201cContextualized VGI\u201d Creation and Management to Cope with Uncertainty and Imprecision. ISPRS Int. J. Geo-Inf., 5.","DOI":"10.3390\/ijgi5120234"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ashish, N., and Sheth, A.P. (2011). Geospatial Semantics and the Semantic Web, Springer.","DOI":"10.1007\/978-1-4419-9446-2"},{"key":"ref_39","unstructured":"Stark, H.-J. (2011, January 5\u20138). Quality Assessment of Volunteered Geographic Information using Open Web Map Services within OpenAddresses. Proceedings of Geospatial Crossroads @ GI_Forum \u201911, Salzburg, Austria."},{"key":"ref_40","unstructured":"Brando-Escobar, C. (2013). Un Mod\u00e8le d\u2019Operations R\u00e9conciliables Pour l\u2019Acquisition Distribu\u00e9e de Donn\u00e9es G\u00e9ographiques. [Ph.D. Thesis, Universit\u00e9 Paris-Est]."},{"key":"ref_41","unstructured":"IGN BD TOPO Ontology. Available online: http:\/\/data.ign.fr\/def\/topo\/20140416.htm."},{"key":"ref_42","unstructured":"OSM Ontology. Available online: http:\/\/wiki.openstreetmap.org\/wiki\/OSMonto."},{"key":"ref_43","unstructured":"Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., and Oliva, A. (2014). Advances in Neural Information Processing Systems 27 (NIPS), Neural Information Processing Systems Foundation, Inc."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/6\/3\/80\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:30:23Z","timestamp":1760207423000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/6\/3\/80"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,3,14]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2017,3]]}},"alternative-id":["ijgi6030080"],"URL":"https:\/\/doi.org\/10.3390\/ijgi6030080","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,3,14]]}}}