{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T23:22:10Z","timestamp":1774048930185,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2016,11,1]],"date-time":"2016-11-01T00:00:00Z","timestamp":1477958400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["617754"],"award-info":[{"award-number":["617754"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Citizens are increasingly becoming involved in data collection, whether for scientific purposes, to carry out micro-tasks, or as part of a gamified, competitive application. In some cases, volunteered data collection overlaps with that of mapping agencies, e.g., the citizen-based mapping of features in OpenStreetMap. LUCAS (Land Use Cover Area frame Sample) is one source of authoritative in-situ data that are collected every three years across EU member countries by trained personnel at a considerable cost to taxpayers. This paper presents a mobile application called FotoQuest Austria, which involves citizens in the crowdsourcing of in-situ land cover and land use data, including at locations of LUCAS sample points in Austria. The results from a campaign run during the summer of 2015 suggest that land cover and land use can be crowdsourced using a simple protocol based on LUCAS. This has implications for remote sensing as this data stream represents a new source of potentially valuable information for the training and validation of land cover maps as well as for area estimation purposes. Although the most detailed and challenging classes were more difficult for untrained citizens to recognize, the agreement between the crowdsourced data and the LUCAS data for basic high level land cover and land use classes in homogeneous areas (ca. 80%) shows clear potential. Recommendations for how to further improve the quality of the crowdsourced data in the context of LUCAS are provided so that this source of data might one day be accurate enough for land cover mapping purposes.<\/jats:p>","DOI":"10.3390\/rs8110905","type":"journal-article","created":{"date-parts":[[2016,11,1]],"date-time":"2016-11-01T11:01:44Z","timestamp":1477998104000},"page":"905","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["Crowdsourcing In-Situ Data on Land Cover and Land Use Using Gamification and Mobile Technology"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2844-3842","authenticated-orcid":false,"given":"Juan","family":"Laso Bayas","sequence":"first","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2665-7065","authenticated-orcid":false,"given":"Linda","family":"See","sequence":"additional","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Steffen","family":"Fritz","sequence":"additional","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tobias","family":"Sturn","sequence":"additional","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7206-4148","authenticated-orcid":false,"given":"Christoph","family":"Perger","sequence":"additional","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martina","family":"D\u00fcrauer","sequence":"additional","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mathias","family":"Karner","sequence":"additional","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Inian","family":"Moorthy","sequence":"additional","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7814-4990","authenticated-orcid":false,"given":"Dmitry","family":"Schepaschenko","sequence":"additional","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"},{"name":"Forestry Faculty, Bauman Moscow State Technical University, Mytischi 141005, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dahlia","family":"Domian","sequence":"additional","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ian","family":"McCallum","sequence":"additional","affiliation":[{"name":"Ecosystems Services and Management Program, International Institute for Applied Systems Analysis, Laxenburg A-2361, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,11,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1038\/510035c","article-title":"Biodiversity data: Mine centuries-old citizen science","volume":"510","author":"Clavero","year":"2014","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Nature (2015). Rise of the citizen scientist. Nature, 524, 265.","DOI":"10.1038\/524265a"},{"key":"ref_3","first-page":"1","article-title":"The rise of crowdsourcing","volume":"14","author":"Howe","year":"2006","journal-title":"Wired Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/1745691610393980","article-title":"Amazon\u2019s Mechanical Turk: A new source of inexpensive, yet high-quality, data?","volume":"6","author":"Buhrmester","year":"2011","journal-title":"Perspect. Psychol. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/j.ijdrr.2015.07.010","article-title":"A review of informal volunteerism in emergencies and disasters: Definition, opportunities and challenges","volume":"13","author":"Whittaker","year":"2015","journal-title":"Int. J. Disaster Risk Reduct."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s10708-007-9111-y","article-title":"Citizens as sensors: the world of volunteered geography","volume":"69","author":"Goodchild","year":"2007","journal-title":"GeoJournal"},{"key":"ref_7","unstructured":"Turner, A. (2006). Introduction to Neogeography, O\u2019Reilly."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"See, L., Mooney, P., Foody, G., Bastin, L., Comber, A., Estima, J., Fritz, S., Kerle, N., Jiang, B., and Laakso, M. (2016). Crowdsourcing, citizen science or Volunteered Geographic Information? The current state of crowdsourced geographic information. ISPRS Int. J. Geo-Inf., 5.","DOI":"10.3390\/ijgi5050055"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1002\/wea.1980","article-title":"The state of automated amateur weather observations","volume":"68","author":"Bell","year":"2013","journal-title":"Weather"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Arsanjani, J.J., Zipf, A., Mooney, P., and Helbich, M. (2015). OpenStreetMap in GIScience, Springer International Publishing. Lecture Notes in Geoinformation and Cartography.","DOI":"10.1007\/978-3-319-14280-7"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"7","DOI":"10.2202\/1948-4682.1069","article-title":"Volunteered Geographic Information and crowdsourcing disaster relief: A case study of the Haitian earthquake","volume":"2","author":"Zook","year":"2010","journal-title":"World Med. Health Policy"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"S179","DOI":"10.1193\/1.3636416","article-title":"Crowdsourcing for rapid damage assessment: The Global Earth Observation Catastrophe Assessment Network (GEO-CAN)","volume":"27","author":"Ghosh","year":"2011","journal-title":"Earthq. Spectra"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.1080\/00045608.2011.627058","article-title":"Citizen science in the age of neogeography: Utilizing volunteered geographic information for environmental monitoring","volume":"102","author":"Connors","year":"2012","journal-title":"Ann. Assoc. Am. Geogr."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/s10661-010-1582-5","article-title":"A review of citizen science and community-based environmental monitoring: issues and opportunities","volume":"176","author":"Conrad","year":"2010","journal-title":"Environ. Monit. Assess."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MGRS.2015.2498840","article-title":"A new generation of tools for crowdsourcing and citizen science to support Earth Observation calibration and validation","volume":"3","author":"See","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.envsoft.2011.11.015","article-title":"Geo-Wiki: An online platform for improving global land cover","volume":"31","author":"Fritz","year":"2012","journal-title":"Environ. Model. Softw."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.techfore.2015.03.002","article-title":"Harnessing the power of volunteers, the internet and Google Earth to collect and validate global spatial information using Geo-Wiki","volume":"98","author":"See","year":"2015","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"601","DOI":"10.3390\/rs3030601","article-title":"Virtual Interpretation of Earth Web-Interface Tool (VIEW-IT) for collecting land-use\/land-cover reference data","volume":"3","author":"Clark","year":"2011","journal-title":"Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Snik, F., Rietjens, J.H.H., Apituley, A., Volten, H., Mijling, B., Di Noia, A., Heikamp, S., Heinsbroek, R.C., Hasekamp, O.P., and Smit, J.M. (2014). 3187 iSPEX citizen scientists Mapping atmospheric aerosols with a citizen science network of smartphone spectropolarimeters. Geophys. Res. Lett., 41.","DOI":"10.1002\/2014GL061462"},{"key":"ref_20","unstructured":"Eurostat (2015). LUCAS 2015 (Land Use\/Cover Area Frame Survey). Technical Reference Document C1 Instructions for Surveyors, Eurostat."},{"key":"ref_21","unstructured":"Eurostat (2015). Task Force Meeting: LUCAS2018 and Beyond, Eurostat. Reference Paper."},{"key":"ref_22","unstructured":"EEA (2006). The Thematic Accuracy of Corine Land Cover 2000\u2014Assessment Using LUCAS, European Environment Agency."},{"key":"ref_23","unstructured":"B\u00fcttner, G., and Eiselt, B. (2013). LUCAS and CORINE Land Cover, EEA and Eurostat."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1080\/17538947.2010.512746","article-title":"Validation of GIS layers in the EU: Getting adapted to available reference data","volume":"4","author":"Gallego","year":"2011","journal-title":"Int. J. Digit. Earth"},{"key":"ref_25","unstructured":"Gallego, F.J., Palmieri, A., and Ramos, H. (2015). Sampling System for LUCAS 2015, Joint Research Centre of the European Commission. EUR 27595 EN."},{"key":"ref_26","unstructured":"Eurostat (2015). LUCAS 2015 Technical Reference Document C3 Classification (Land Cover & Land Use), Eurostat."},{"key":"ref_27","unstructured":"Deterding, S., Sicart, M., Nacke, L., O\u2019Hara, K., and Dixon, D. (2011). CHI \u201911 Extended Abstracts on Human Factors in Computing Systems, ACM Press."},{"key":"ref_28","unstructured":"Bowser, A., Hansen, D., and Preece, J. (May, January 27). Gamifying citizen science: Lessons and future directions. Proceedings of the CHI 2013: Designing Gameification: Creating Gameful and Playful Experiences, Paris, France."},{"key":"ref_29","unstructured":"See, L., Sturn, T., Perger, C., Fritz, S., McCallum, I., and Salk, C. (2014, January 3\u201316). Cropland Capture: A gaming approach to improve global land cover. Proceedings of the AGILE\u20192014 International Conference on Geographic Information Science, Castellon, Spain."},{"key":"ref_30","unstructured":"Sturn, T., Wimmer, M., Salk, C., Perger, C., See, L., and Fritz, S. (2015, January 20\u201322). Cropland Capture\u2014A game for improving global cropland maps. Proceedings of the Foundation of Digital Games (FDG 2015), Pacific Grove, CA, USA."},{"key":"ref_31","unstructured":"Eurostat Overview of LUCAS. Available online: http:\/\/ec.europa.eu\/eurostat\/web\/lucas\/overview."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Alonso, K., Espinoza-Molina, D., and Datcu, M. (2015, January 26\u201331). LUCAS Visual Browser: A tool for land cover visual analytics. Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7326060"},{"key":"ref_33","unstructured":"Burnham, K.P., and Anderson, D.R. (2002). Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach, Springer. [2nd ed.]."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1179\/000870410X12911304958827","article-title":"How many volunteers does it take to map an area well? The validity of Linus\u2019 Law to volunteered geographic information","volume":"47","author":"Haklay","year":"2010","journal-title":"Cartogr. J."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"97","DOI":"10.5194\/nhess-13-97-2013","article-title":"Collaborative damage mapping for emergency response: The role of Cognitive Systems Engineering","volume":"13","author":"Kerle","year":"2013","journal-title":"Nat. Hazards Earth Syst. Sci."},{"key":"ref_36","unstructured":"Tweddle, J.C., Robinson, L.D., Pocock, M.J.O., and Roy, H. (2012). Guide to Citizen Science: Developing, Implementing and Evaluating Citizen Science to Study Biodiversity and the Environment in the UK, Natural History Museum and NERC Centre for Ecology & Hydrology."},{"key":"ref_37","first-page":"138","article-title":"Observations on an OpenStreetMap mapping party organised as a social event during an open source GIS conference","volume":"10","author":"Mooney","year":"2015","journal-title":"Int. J. Spat. Data Infract. Res."},{"key":"ref_38","unstructured":"Pocock, M.J.O., Chapman, D.S., Sheppard, L.J., and Roy, H.E. (2014). Choosing and Using Citizen Science: A Guide to When and How to Use Citizen Science to Monitor Biodiversity and the Environment, NERC Centre for Ecology & Hydrology."},{"key":"ref_39","unstructured":"European Environment Agency (2013). Montoring Matters: In-Situ Coordinaton in Support of Copernicus Operations, European Environment Agency."},{"key":"ref_40","unstructured":"Surowiecki, J. (2005). The Wisdom of Crowds, Anchor Books."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/8\/11\/905\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:34:31Z","timestamp":1760211271000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/8\/11\/905"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11,1]]},"references-count":40,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2016,11]]}},"alternative-id":["rs8110905"],"URL":"https:\/\/doi.org\/10.3390\/rs8110905","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,11,1]]}}}