{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T09:38:57Z","timestamp":1770284337584,"version":"3.49.0"},"reference-count":46,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T00:00:00Z","timestamp":1614902400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Comission H2020","award":["730329"],"award-info":[{"award-number":["730329"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Geospatial data is used not only to contemplate reality but also, in combination with analytical tools, to generate new information that requires interpretation. In this process data users gain knowledge about the data and its limitations (the user side of data quality) as well as knowledge on the status and evolutions of the studied phenomena. Knowledge can be annotations on top of the data, responses to questions, a careful description of the processes applied, a piece of software code or scripts applied to the data, usage reports or a complete scientific paper. This paper proposes an extension of the current Open Geospatial Consortium standard for Geospatial User Feedback to include the required knowledge elements, and a practical implementation. The system can incrementally collect, store, and communicate knowledge elements created by users of the data and keep them linked to the original data by means of permanent data identifiers. The system implements a Web API to manage feedback items as a frontend to a database. The paper demonstrates how a JavaScript widget accessing this API as a client can be easily integrated into existing data catalogues, such as the ECOPotential web service or the GEOEssential data catalogue, to collectively collect and share knowledge.<\/jats:p>","DOI":"10.3390\/ijgi10030141","type":"journal-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T11:46:09Z","timestamp":1614944769000},"page":"141","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Geospatial User Feedback: How to Raise Users\u2019 Voices and Collectively Build Knowledge at the Same Time"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3931-4221","authenticated-orcid":false,"given":"Alaitz","family":"Zabala","sequence":"first","affiliation":[{"name":"Grumets Research Group, CREAF, Edifici C, Universitat Aut\u00f2noma de Barcelona, 08193 Bellaterra, Catalonia, Spain"},{"name":"Grumets Research Group, Department Geografia, Edifici B, Universitat Aut\u00f2noma de Barcelona, 08193 Bellaterra, Catalonia, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2983-4629","authenticated-orcid":false,"given":"Joan","family":"Mas\u00f3","sequence":"additional","affiliation":[{"name":"Grumets Research Group, CREAF, Edifici C, Universitat Aut\u00f2noma de Barcelona, 08193 Bellaterra, Catalonia, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1321-0800","authenticated-orcid":false,"given":"Lucy","family":"Bastin","sequence":"additional","affiliation":[{"name":"School of Informatics &amp; Digital Engineering, College of Engineering &amp; Physical Sciences, Aston University, Birmingham B4 7ET, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1825-8865","authenticated-orcid":false,"given":"Gregory","family":"Giuliani","sequence":"additional","affiliation":[{"name":"enviroSPACE, Institute for Environmental Sciences, University of Geneva, Bd Carl-Vogt 66, CH-1205 Geneva, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6924-1641","authenticated-orcid":false,"given":"Xavier","family":"Pons","sequence":"additional","affiliation":[{"name":"Grumets Research Group, Department Geografia, Edifici B, Universitat Aut\u00f2noma de Barcelona, 08193 Bellaterra, Catalonia, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"177","DOI":"10.2218\/ijdc.v12i2.567","article-title":"Are the FAIR Data Principles Fair?","volume":"12","author":"Dunning","year":"2017","journal-title":"Int. J. Digit. Curation"},{"key":"ref_2","unstructured":"National Research Council (2013). Frontiers in Massive Data Analysis."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1177\/0165551506070706","article-title":"The Wisdom Hierarchy: Representations of the DIKW Hierarchy","volume":"33","author":"Rowley","year":"2007","journal-title":"J. Inf. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"792","DOI":"10.1016\/j.amjsurg.2019.07.028","article-title":"The Surgical Blog: An Important Supplement to Traditional Scientific Literature","volume":"218","author":"Zhao","year":"2019","journal-title":"Am. J. Surg."},{"key":"ref_5","unstructured":"Baeza-Yates, R.A., and Ribeiro-Neto, B.A. (2011). Modern Information Retrieval\u2014The Concepts and Technology behind Search, Addison-Wesley. [2nd ed.]."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Klaric, M., Scott, G., and Shyu, C. (August, January 31). Mining Visual Associations from User Feedback for Weighting Multiple Indexes in Geospatial Image Retrieval. Proceedings of the 2006 IEEE International Symposium on Geoscience and Remote Sensing, Denver, CO, USA.","DOI":"10.1109\/IGARSS.2006.10"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"See, L., Laso Bayas, J.C., Schepaschenko, D., Perger, C., Dresel, C., Maus, V., Salk, C., Weichselbaum, J., Lesiv, M., and McCallum, I. (2017). LACO-Wiki: A New Online Land Cover Validation Tool Demonstrated Using GlobeLand30 for Kenya. Remote Sens., 9.","DOI":"10.3390\/rs9070754"},{"key":"ref_8","unstructured":"Comber, A.J., Fisher, P.F., and Wadsworth, R.A. (2007, January 11\u201313). Approaches for Providing User Relevant Metadata and Data Quality Assessments. Proceedings of the Geographical Information Science Research UK Conference, Maynooth, Ireland."},{"key":"ref_9","unstructured":"Shi, W., Wu, B., and Stein, A. (2015). Toward a Collaborative Knowledge Discovery System for Enriching Semantic Information about Risks of Geospatial Data Misuse. Uncertainty Modelling and Quality Control for Spatial Data, CRC Press."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1016\/j.apergo.2012.10.013","article-title":"Usability of Geographic Information: Current Challenges and Future Directions","volume":"44","author":"Brown","year":"2013","journal-title":"Appl. Ergon."},{"key":"ref_11","first-page":"352","article-title":"Analysis of Quality Metadata in the GEOSS Clearinghouse","volume":"7","author":"Sevillano","year":"2012","journal-title":"Int. J. Spat. Data Infrastruct. Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1109","DOI":"10.1080\/13658816.2012.739692","article-title":"A Performance, Semantic and Service Quality-Enhanced Distributed Search Engine for Improving Geospatial Resource Discovery","volume":"27","author":"Gui","year":"2013","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_13","unstructured":"Comber, A.J., Fisher, P.F., and Wadsworth, R.A. (2007, January 8\u201311). User-Focused Metadata for Spatial Data, Geographical Information and Data Quality Assessments | Semantic Scholar. Proceedings of the 10th AGILE International Conference on Geographic Information Science 2007, Aalborg, Denmark."},{"key":"ref_14","unstructured":"Stein, A., Shi, W., and Bijker, W. (2008). Epilogue: Putting Research into Practice. Quality Aspects in Spatial Data Mining, CRC Press."},{"key":"ref_15","first-page":"20120072","article-title":"An Integrated View of Data Quality in Earth Observation","volume":"371","author":"Yang","year":"2013","journal-title":"Philos. Trans. R. Soc. Math. Phys. Eng. Sci."},{"key":"ref_16","unstructured":"Mas\u00f3, J., and Bastin, L. (2016). OGC Geospatial User Feedback Standard: Conceptual Model, Ver. 1.0, 15-097r1, Open Geospatial Consortium."},{"key":"ref_17","unstructured":"Mas\u00f3, J., and Bastin, L. (2016). OGC Geospatial User Feedback Standard: XML Encoding Extension, Ver. 1.0, 15-098r1, Open Geospatial Consortium."},{"key":"ref_18","unstructured":"L\u00f3scio, B.F., Stephan, E.G., and Purohit, S. (2020, December 29). Data on the Web Best Practices: Dataset Usage Vocabulary. Available online: https:\/\/www.w3.org\/TR\/vocab-duv\/."},{"key":"ref_19","unstructured":"Gray, A.J.G. (December, January 30). Validata: A Tool for Testing Profile Conformance. Proceedings of the Smart Descriptions & Smarter Vocabularies (SDSVoc), Amsterdam, The Netherlands."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ziaimatin, H., Nili, A., and Barros, A. (2020). Reducing Consumer Uncertainty: Towards an Ontology for Geospatial User-Centric Metadata. ISPRS Int. J. Geo Inf., 9.","DOI":"10.3390\/ijgi9080488"},{"key":"ref_21","unstructured":"Lush, V., Bastin, L., and Lumsden, J. (2012, January 10\u201313). Geospatial Data Quality Indicators. Proceedings of the 10th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, Florian\u00f3polis, SC, Brazil."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1080\/17538947.2018.1559367","article-title":"Towards a Knowledge Base to Support Global Change Policy Goals","volume":"13","author":"Nativi","year":"2020","journal-title":"Int. J. Digit. Earth"},{"key":"ref_23","unstructured":"Cripe, D., and Camera, G. (2019, January 9\u201313). Results-Oriented GEOSS: A Framework for Transforming Earth Observation Data to Knowledge for Decision Making. Proceedings of the American Geophysical Union, Fall Meeting 2019, San Francisco, CA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e5040","DOI":"10.1002\/cpe.5040","article-title":"CyberGIS-Jupyter for Reproducible and Scalable Geospatial Analytics","volume":"31","author":"Yin","year":"2019","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"179","DOI":"10.12775\/SG.2020.08","article-title":"The Problem of Using Persistent Identifiers for Historical Geographical Objects","volume":"8","author":"Myrda","year":"2020","journal-title":"Stud. Geohist."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1179\/000870405X77183","article-title":"Metaloging of Digital Geospatial Data","volume":"42","author":"Larsgaard","year":"2005","journal-title":"Cartogr. J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"37","DOI":"10.21105\/joss.00037","article-title":"Tidytext: Text Mining and Analysis Using Tidy Data Principles in R","volume":"1","author":"Silge","year":"2016","journal-title":"J. Open Source Softw."},{"key":"ref_28","unstructured":"Mas\u00f3, J., and Singh, R. (2014). OGC Testbed-10 Annotations Engineering Report, 14-002, Open Geospatial Consortium."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"15014","DOI":"10.3390\/rs71115014","article-title":"Accurate Annotation of Remote Sensing Images via Active Spectral Clustering with Little Expert Knowledge","volume":"7","author":"Xia","year":"2015","journal-title":"Remote Sens."},{"key":"ref_30","first-page":"1","article-title":"Reproducibility and Replicability: Opportunities and Challenges for Geospatial Research","volume":"35","author":"Kedron","year":"2020","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_31","unstructured":"Van den Broek, M., Mas\u00f3, J., Plag, H.-P., Jirka, S., and Serral, I. (2016). Deliverable D4.3 Feedback System Description and Results Report, v2.0, ConnectinGEO Consortium."},{"key":"ref_32","unstructured":"Pons, X. (2004). MiraMon. Sistema d\u2019Informaci\u00f3 Geogr\u00e0fica i Software de Teledetecci\u00f3, Centre de Recerca Ecol\u00f2gica i Aplicacions Forestals (CREAF)."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Mas\u03cc, J., Zabala, A., and Pons, X. (2020). Protected Areas from Space Map Browser with Fast Visualization and Analytical Operations on the Fly. Characterizing Statistical Uncertainties and Balancing Them with Visual Perception. ISPRS Int. J. Geo Inf., 9.","DOI":"10.3390\/ijgi9050300"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zabala Torres, A., Mas\u00f3 Pau, J., and Pons, X. (2020, January 4\u20138). Managing the Knowledge Created by the Users Trough Geospatial User Feedback System. The NEXTGEOSS Use Case. Proceedings of the EGU General Assembly 2020 (EGU 2020), Online.","DOI":"10.5194\/egusphere-egu2020-18976"},{"key":"ref_35","unstructured":"Moorthy, I., See, L., Batic, M., and Matheus, A. (2018, January 30\u201331). The LandSense Engagement Platform: Connecting Citizens with Earth Observation Data to Promote Environmental Monitoring. Proceedings of the ESA Earth Observation Week, Frascati, Italy."},{"key":"ref_36","unstructured":"Schut, P. (2007). OGC Web Processing Service, Ver. 1.0.0, 05-007r7, Open Geospatial Consortium."},{"key":"ref_37","unstructured":"Mueller, M., and Pross, B. (2018). OGC WPS 2.0 Interface Standard, Ver. 2.0.2, 14-065r2, Open Geospatial Consortium."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Nottingham, M., and Sayre, R. (2005). The Atom Syndication Format RFC 4287, Internet Engineering Task Force\u2014The Internet Society.","DOI":"10.17487\/rfc4287"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1080\/17538947.2019.1585977","article-title":"GEOEssential\u2014Mainstreaming Workflows from Data Sources to Environment Policy Indicators with Essential Variables","volume":"13","author":"Lehmann","year":"2020","journal-title":"Int. J. Digit. Earth"},{"key":"ref_40","first-page":"102068","article-title":"Knowledge Generation Using Satellite Earth Observations to Support Sustainable Development Goals (SDG): A Use Case on Land Degradation","volume":"88","author":"Giuliani","year":"2020","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1080\/02693798708927799","article-title":"Fundamental Operations in Computer-Assisted Map Analysis","volume":"1","author":"Berry","year":"1987","journal-title":"Int. J. Geogr. Inf. Syst."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1111\/j.1467-9671.2008.01102.x","article-title":"Semantics, Metadata, Geographical Information and Users","volume":"12","author":"Comber","year":"2008","journal-title":"Trans. GIS"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"15","DOI":"10.5334\/cstp.8","article-title":"Recruiting and Retaining Participants in Citizen Science: What Can Be Learned from the Volunteering Literature?","volume":"1","author":"West","year":"2016","journal-title":"Citiz. Sci. Theory Pract."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.envsci.2019.09.002","article-title":"Incentives and Barriers for Participation in Community-Based Environmental Monitoring and Information Systems: A Critical Analysis and Integration of the Literature","volume":"101","author":"Wehn","year":"2019","journal-title":"Environ. Sci. Policy"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1111\/tran.12136","article-title":"Going Public? Re-Thinking Visibility, Ethics and Recognition through Participatory Research Praxis","volume":"41","author":"Dickens","year":"2016","journal-title":"Trans. Inst. Br. Geogr."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"11","DOI":"10.11610\/bmdj.01102","article-title":"European Commission Policy on Open-Access to Scientific Publications and Research Data in Horizon 2020","volume":"1","author":"Guedj","year":"2015","journal-title":"Biomed. Data J."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/3\/141\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:33:31Z","timestamp":1760160811000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/3\/141"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,5]]},"references-count":46,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["ijgi10030141"],"URL":"https:\/\/doi.org\/10.3390\/ijgi10030141","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,5]]}}}