{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:07:54Z","timestamp":1760238474127,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T00:00:00Z","timestamp":1597104000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Global land-cover products play an important role in assisting the understanding of climate-related changes and the assessment of progress in the implementation of international initiatives for the mitigation of, and adaption to, climate change. However, concerns over the accuracies of land-cover products remain, due to the issue of validation data uncertainty. The volunteer-based Degree Confluence Project (DCP) was created in 1996, and it has been used to provide useful ground-reference information. This study aims to investigate the impact of DCP-based validation data uncertainty and the thematic issues on map accuracies. We built a reference dataset based on the DCP-interpreted dataset and applied a comparison for three existing global land-cover maps and DCP dataset-based probability maps under different classification schemes. The results of the obtained confusion matrices indicate that the uncertainty, including the number of classes and the confusion in mosaic classes, leads to a decrease in map accuracy. This paper proposes an informative classification scheme that uses a matrix structure of unaggregated land-cover and land-use classes, and has the potential to assist in the land-cover interpretation and validation processes. The findings of this study can potentially serve as a guide to select reference data and choose\/define appropriate classification schemes.<\/jats:p>","DOI":"10.3390\/rs12162589","type":"journal-article","created":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T10:56:12Z","timestamp":1597143372000},"page":"2589","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Analyzing the Uncertainty of Degree Confluence Project for Validating Global Land-Cover Maps Using Reference Data-Based Classification Schemes"],"prefix":"10.3390","volume":"12","author":[{"given":"Tana","family":"Qian","sequence":"first","affiliation":[{"name":"National Institute for Environmental Studies, Ibaraki-ken 305-8506, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tsuguki","family":"Kinoshita","sequence":"additional","affiliation":[{"name":"College of Agriculture, Ibaraki University, Ibaraki-ken 300-0393, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Minoru","family":"Fujii","sequence":"additional","affiliation":[{"name":"National Institute for Environmental Studies, Ibaraki-ken 305-8506, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuhai","family":"Bao","sequence":"additional","affiliation":[{"name":"College of Geography Science, Inner Mongolia Normal University, Hohhot 010022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/S0959-3780(02)00080-8","article-title":"Security and climate change","volume":"13","author":"Barnett","year":"2003","journal-title":"Global Environ. Chang."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1080\/17538947.2020.1743785","article-title":"Big Earth Data science: an information framework for a sustainable planet","volume":"13","author":"Huadong","year":"2020","journal-title":"Int. J. Digit. Earth"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Onoda, M., and Young, O.R. (2017). Satellite Earth Observations and Their Impact on Society and Policy, Springer Open.","DOI":"10.1007\/978-981-10-3713-9"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Mora, B., Tsendbazar, N.E., Herold, M., and Arino, O. (2014). Global Land Cover Mapping: Current Status and Future Trends, Springer.","DOI":"10.1007\/978-94-007-7969-3_2"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4254","DOI":"10.1080\/01431161.2018.1452075","article-title":"Land cover 2.0","volume":"39","author":"Michael","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.rse.2018.04.014","article-title":"Using volunteered geographic information (VGI) in design-based statistical inference for area estimation and accuracy assessment of land cover","volume":"212","author":"Stehman","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_7","unstructured":"Strahler, A.H., Boschetti, L., Foody, G.M., Friedl, M.A., Hansen, M.C., Herold, M., Mayaux, P., Morisette, J.T., Stehman, S.V., and Woodcock, C.E. (2006). Global Land Cover Validation: Recommendations for Evaluation and Accuracy Assessment of Global Land Cover Maps. Technical Report EUR 22156 EN-DG 2006, Office for Official Publications of the European Community."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.rse.2014.02.015","article-title":"Good practices for estimating area and assessing accuracy of land change","volume":"148","author":"Olofsson","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1016\/j.isprsjprs.2018.06.002","article-title":"The effects of imperfect reference data on remote sensing-assisted estimators of land cover class proportions","volume":"142","author":"McRoberts","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_10","unstructured":"Muchoney, D.M., Borak, J., and Strahler, A. (1996, January 27\u201331). Global landcover classification validation issues and requirements. Proceedings of the International Geoscience and Remote Sensing Symposium, Lincoln, NE, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1016\/S0034-4257(98)00010-8","article-title":"Design and analysis for thematic map accuracy assessment: Fundamental principles","volume":"64","author":"Stehman","year":"1998","journal-title":"Remote Sens. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/s10708-004-5050-z","article-title":"Land cover change over the last three centuries due to human activities: The availability of new global data sets","volume":"61","author":"Klein","year":"2004","journal-title":"GeoJournal"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.rse.2003.04.003","article-title":"High spatial resolution satellite observations for validation of MODIS land products: IKONOS observations acquired under the NASA Scientific Data Purchase","volume":"88","author":"Morisette","year":"2003","journal-title":"Remote Sens. Environ."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"573","DOI":"10.5589\/m04-021","article-title":"Map comparison using spatial autocorrelation: An example using AVHRR derived land cover of Canada","volume":"30","author":"Wulder","year":"2004","journal-title":"Can. J. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1016\/j.rse.2015.01.018","article-title":"A global reference database from very high resolution commercial satellite data and methodology for application to Landsat derived 30 m continuous field tree cover data","volume":"165","author":"Pengra","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0184926","article-title":"Mapping land cover change over continental Africa using Landsat and Google Earth Engine cloud computing","volume":"12","author":"Midekisa","year":"2017","journal-title":"PLoS ONE"},{"key":"ref_17","first-page":"1313","article-title":"Uncertainty assessment of GlobeLand30 Land cover data set over central Asia","volume":"41","author":"Sun","year":"2016","journal-title":"ISPRS - Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.rse.2006.04.004","article-title":"Resolution dependent errors in remote sensing of cultivated areas","volume":"103","author":"Ozdogan","year":"2006","journal-title":"Remote Sens. Environ."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1080\/2150704X.2013.798708","article-title":"Ground reference data error and the mis-estimation of the area of land cover change as a function of its abundance","volume":"4","author":"Foody","year":"2013","journal-title":"Remote Sens. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4795","DOI":"10.1080\/01431161.2014.930202","article-title":"Towards a common validation sample set for global land-cover mapping","volume":"35","author":"Zhao","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"O\u2019Reilly, T. (2020, May 01). What is Web 2.0: Design Patterns and Business Models for the Next Generation of Software. Available online: https:\/\/www.oreilly.com\/pub\/a\/web2\/archive\/what-is-web-20.html.","DOI":"10.18574\/nyu\/9780814763025.003.0008"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1111\/j.1467-8306.2007.00534.x","article-title":"Sharing geographic information: An assessment of the geospatial one-stop","volume":"97","author":"Goodchild","year":"2007","journal-title":"Ann. Assoc. Am. Geogr."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s10708-008-9188-y","article-title":"The credibility of volunteered geographic information","volume":"72","author":"Flanagin","year":"2008","journal-title":"GeoJournal"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.trc.2014.10.007","article-title":"Evaluating a concept design of a crowd-sourced \u201cmashup\u201d providing ease-of-access information for people with limited mobility","volume":"49","author":"May","year":"2004","journal-title":"Transp. Res. Part C Emerg. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s10708-007-9111-y","article-title":"Citizens as sensors: The world of volunteered geography","volume":"69","author":"Goodchild","year":"2007","journal-title":"GeoJournal"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1080\/00140139.2014.909950","article-title":"User-centred design of neogeography: The impact of volunteered geographic information on users\u2019 perceptions of online map \u201cmashups\u201d","volume":"57","author":"Parker","year":"2014","journal-title":"Ergonomics"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1111\/j.1467-9671.2012.01302.x","article-title":"Understanding Design with VGI using an Information Relevance Framework","volume":"16","author":"Parker","year":"2012","journal-title":"Trans. GIS."},{"key":"ref_28","unstructured":"Hara, K., Le, V., and Froehlich, J.E. (May, January 27). Combining Crowdsourcing and Google Street View to Identify Street-Level Accessibility Problems. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1029\/2006GL027768","article-title":"Validating land cover maps with Degree Confluence Project information","volume":"33","author":"Iwao","year":"2006","journal-title":"Geophys. Res. Lett."},{"key":"ref_30","first-page":"160","article-title":"Creation of New Global Land Cover Map with Map Integration","volume":"3","author":"Iwao","year":"2011","journal-title":"J. Geogr. Inf. Syst."},{"key":"ref_31","first-page":"70","article-title":"Creation of a global land cover and a probability map through a new map integration method","volume":"28","author":"Kinoshita","year":"2014","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_32","unstructured":"Zielstra, D., and Zipf, A. (2010, January 10\u201314). A comparative study of proprietary geodata and volunteered geographic information for germany. Proceedings of the 13th Association of Geographic Information Laboratories for Europe International Conference on Geographic Information Science, Guimar\u00e3es, Portugal."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1269","DOI":"10.1080\/13658816.2015.1018266","article-title":"Usability of VGI for validation of land cover maps","volume":"29","author":"Fonte","year":"2015","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1080\/13658816.2016.1189556","article-title":"A review of volunteered geographic information quality assessment methods","volume":"31","author":"Senaratne","year":"2017","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3390\/ijgi8030116","article-title":"The value of OpenStreetMap historical contributions as a source of sampling data for multi-temporal land use\/cover maps","volume":"8","author":"Viana","year":"2019","journal-title":"ISPRS Int. J. Geo-Information"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Foody, G., See, L., Fritz, S., Mooney, P., Olteanu-Raimond, A., Fonte, C.C., and Antoniou, V. (2017). Assessing VGI Data Quality. Mapping and the Citizen Sensor, Ubiquity Press.","DOI":"10.5334\/bbf.g"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.rse.2009.08.016","article-title":"MODIS Collection 5 global land cover: Algorithm refinements and characterization of new datasets","volume":"114","author":"Friedl","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_38","first-page":"99","article-title":"Production of global land cover data\u2014GLCNMO2008","volume":"6","author":"Tateishi","year":"2014","journal-title":"J. Geogr. Geol."},{"key":"ref_39","unstructured":"Arino, O., Ramos, P., Jose, J., Kalogirou, V., Bontemps, S., Defourny, P., and van Bogaert, E. (2012). Global Land Cover Map for 2009 (GlobCover 2009), European Space Agency (ESA) & Universit\u00e9 catholique de Louvain (UCL)."},{"key":"ref_40","unstructured":"Lambin, E.F., Baulies, X., Bockstael, N., Fischer, G., Krug, T., Leemans, R., Moran, E.F., Rindfuss, R.R., Skole, D., and Turner ll, B.L. (1999). Land-Use and Land-Cover Change (LUCC)-Implementation Strategy, IGBP Secretariat. IGBP Report No.48\/IHDP Report No. 10."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1080\/17474230802434187","article-title":"Using semantics to clarify the conceptual confusion between land cover and land use: The example of \u201cforest\u201d","volume":"3","author":"Comber","year":"2008","journal-title":"J. Land Use Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.isprsjprs.2017.01.019","article-title":"Automated cropland mapping of continental Africa using Google Earth Engine cloud computing","volume":"126","author":"Xiong","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_43","unstructured":"Bai, L. (2010). Comparison and Validation of Five Land Cover Products over the African Continent. [Master\u2019s Thesis, Lund University]."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.rse.2004.09.005","article-title":"A comparative analysis of the Global Land Cover 2000 and MODIS land cover data sets","volume":"94","author":"Giri","year":"2005","journal-title":"Remote Sens. Environ."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1080\/17538947.2016.1217942","article-title":"Integrating global land cover datasets for deriving user-specific maps","volume":"10","author":"Tsendbazar","year":"2017","journal-title":"Int. J. Digit. Earth."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"5768","DOI":"10.1080\/01431161.2012.674230","article-title":"A global land-cover validation data set, part I: Fundamental design principles","volume":"33","author":"Olofsson","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rse.2019.05.018","article-title":"Key issues in rigorous accuracy assessment of land cover products","volume":"231","author":"Stehman","year":"2019","journal-title":"Remote Sens. Environ."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/16\/2589\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:59:21Z","timestamp":1760176761000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/16\/2589"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,11]]},"references-count":47,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["rs12162589"],"URL":"https:\/\/doi.org\/10.3390\/rs12162589","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2020,8,11]]}}}