{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T14:42:49Z","timestamp":1773585769372,"version":"3.50.1"},"reference-count":32,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2022,11,13]],"date-time":"2022-11-13T00:00:00Z","timestamp":1668297600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["41971335"],"award-info":[{"award-number":["41971335"]}]},{"name":"National Natural Science Foundation of China","award":["51978144"],"award-info":[{"award-number":["51978144"]}]},{"name":"National Natural Science Foundation of China","award":["2022xjkk1006"],"award-info":[{"award-number":["2022xjkk1006"]}]},{"name":"National Natural Science Foundation of China","award":["2022B01012-1"],"award-info":[{"award-number":["2022B01012-1"]}]},{"name":"National Natural Science Foundation of China","award":["2022WLKXJ036"],"award-info":[{"award-number":["2022WLKXJ036"]}]},{"name":"National Natural Science Foundation of China","award":["KYCX22_2603"],"award-info":[{"award-number":["KYCX22_2603"]}]},{"name":"The Third Comprehensive Scientific Investigation Project of Xinjiang","award":["41971335"],"award-info":[{"award-number":["41971335"]}]},{"name":"The Third Comprehensive Scientific Investigation Project of Xinjiang","award":["51978144"],"award-info":[{"award-number":["51978144"]}]},{"name":"The Third Comprehensive Scientific Investigation Project of Xinjiang","award":["2022xjkk1006"],"award-info":[{"award-number":["2022xjkk1006"]}]},{"name":"The Third Comprehensive Scientific Investigation Project of Xinjiang","award":["2022B01012-1"],"award-info":[{"award-number":["2022B01012-1"]}]},{"name":"The Third Comprehensive Scientific Investigation Project of Xinjiang","award":["2022WLKXJ036"],"award-info":[{"award-number":["2022WLKXJ036"]}]},{"name":"The Third Comprehensive Scientific Investigation Project of Xinjiang","award":["KYCX22_2603"],"award-info":[{"award-number":["KYCX22_2603"]}]},{"name":"The Xinjiang Uygur Autonomous Region Key Research and Development Program","award":["41971335"],"award-info":[{"award-number":["41971335"]}]},{"name":"The Xinjiang Uygur Autonomous Region Key Research and Development Program","award":["51978144"],"award-info":[{"award-number":["51978144"]}]},{"name":"The Xinjiang Uygur Autonomous Region Key Research and Development Program","award":["2022xjkk1006"],"award-info":[{"award-number":["2022xjkk1006"]}]},{"name":"The Xinjiang Uygur Autonomous Region Key Research and Development Program","award":["2022B01012-1"],"award-info":[{"award-number":["2022B01012-1"]}]},{"name":"The Xinjiang Uygur Autonomous Region Key Research and Development Program","award":["2022WLKXJ036"],"award-info":[{"award-number":["2022WLKXJ036"]}]},{"name":"The Xinjiang Uygur Autonomous Region Key Research and Development Program","award":["KYCX22_2603"],"award-info":[{"award-number":["KYCX22_2603"]}]},{"name":"The Graduate Innovation Program of China University of Mining and Technology","award":["41971335"],"award-info":[{"award-number":["41971335"]}]},{"name":"The Graduate Innovation Program of China University of Mining and Technology","award":["51978144"],"award-info":[{"award-number":["51978144"]}]},{"name":"The Graduate Innovation Program of China University of Mining and Technology","award":["2022xjkk1006"],"award-info":[{"award-number":["2022xjkk1006"]}]},{"name":"The Graduate Innovation Program of China University of Mining and Technology","award":["2022B01012-1"],"award-info":[{"award-number":["2022B01012-1"]}]},{"name":"The Graduate Innovation Program of China University of Mining and Technology","award":["2022WLKXJ036"],"award-info":[{"award-number":["2022WLKXJ036"]}]},{"name":"The Graduate Innovation Program of China University of Mining and Technology","award":["KYCX22_2603"],"award-info":[{"award-number":["KYCX22_2603"]}]},{"name":"The Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["41971335"],"award-info":[{"award-number":["41971335"]}]},{"name":"The Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["51978144"],"award-info":[{"award-number":["51978144"]}]},{"name":"The Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["2022xjkk1006"],"award-info":[{"award-number":["2022xjkk1006"]}]},{"name":"The Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["2022B01012-1"],"award-info":[{"award-number":["2022B01012-1"]}]},{"name":"The Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["2022WLKXJ036"],"award-info":[{"award-number":["2022WLKXJ036"]}]},{"name":"The Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["KYCX22_2603"],"award-info":[{"award-number":["KYCX22_2603"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Land cover is important for global change studies, and its accuracy and reliability are usually verified by field sampling, which costs a lot. A method was proposed for the verification of land cover datasets with the geo-tagged natural scene images using a convolutional neural network. The nature scene images were firstly collected from the Land Use and Cover Area frame Survey (LUCAS) and global crowdsourcing images platform Flickr, then classified according to the Land Cover Classification System. The Nature Scene Image Classification (NSIC) model based on the GoogLeNet Inception network for recognition of natural scene images was then constructed. Finally, in the UK, as a verification area, the European Space Agency Climate Change Initiative Land Cover (ESA CCI-LC) datasets and the Global land-cover product with fine classification system (GLC-FCS) were verified using the NSIC-Inception model with the nature scene image set. The verification results showed that the overall accuracy verified by LUCAS was very close to the accuracy of the land cover product, which was 94.41% of CCI LC and 92.89% of GLC-FCS, demonstrating the feasibility of using geo-tagged images classified by the NSIC model. In addition, the VGG16 and ResNet50 were compared with GoogLeNet Inception. The differences in verification between LUCAS and Flickr images were discussed regarding the image\u2019s quantity, the spatial distribution, the representativeness, and so on. The uncertainties of verification arising from differences in the spatial resolution of the different datasets were explored by CCI LC and GCL-FCS. The application of the method has great potential to support and improve the efficiency of land cover verification.<\/jats:p>","DOI":"10.3390\/ijgi11110567","type":"journal-article","created":{"date-parts":[[2022,11,14]],"date-time":"2022-11-14T04:21:45Z","timestamp":1668399705000},"page":"567","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["The Verification of Land Cover Datasets with the Geo-Tagged Natural Scene Images"],"prefix":"10.3390","volume":"11","author":[{"given":"Liu","family":"Cui","sequence":"first","affiliation":[{"name":"School of Resources and Geosciences, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9421-3573","authenticated-orcid":false,"given":"Hui","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Resources and Geosciences, China University of Mining and Technology, Xuzhou 221116, China"},{"name":"Key Laboratory of Coalbed Methane Resources and Reservoir Formation Process of the Ministry of Education, China University of Mining and Technology, Xuzhou 221116, China"},{"name":"Artificial Intelligence Research Institute, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liang","family":"Chu","sequence":"additional","affiliation":[{"name":"Xuzhou Municipal Bureau of Natural Resources and Planning, Xuzhou 221116, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingping","family":"He","sequence":"additional","affiliation":[{"name":"School of Resources and Geosciences, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fei","family":"Xu","sequence":"additional","affiliation":[{"name":"Xuzhou Registration Center of Natural Resources, Xuzhou 221116, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yina","family":"Qiao","sequence":"additional","affiliation":[{"name":"School of Resources and Geosciences, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhaojin","family":"Yan","sequence":"additional","affiliation":[{"name":"School of Resources and Geosciences, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ran","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Resources and Geosciences, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui","family":"Ci","sequence":"additional","affiliation":[{"name":"School of Resources and Geosciences, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1007\/s00267-021-01573-9","article-title":"Evaluation of Water Provision Ecosystem Services Associated with Land Use\/Cover and Climate Variability in the Winike Watershed, Omo Gibe Basin of Ethiopia","volume":"69","author":"Aneseyee","year":"2022","journal-title":"Environ. Manag."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Qiao, R., Dong, C., Ji, S., and Chang, X. (2021). Spatial Scale Effects of the Relationship between Fractional Vegetation Coverage and Land Surface Temperature in Horqin Sandy Land, North China. Sensors, 21.","DOI":"10.3390\/s21206914"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Szarek-Iwaniuk, P., Dawidowicz, A., and Senetra, A. (2022). Methodology for Precision Land Use Mapping towards Sustainable Urbanized Land Development. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph19063633"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1016\/j.scitotenv.2018.11.287","article-title":"Four decades\u2019 dynamics of coastal blue carbon storage driven by land use\/land cover transformation under natural and anthropogenic processes in the Yellow River Delta, China","volume":"655","author":"Ma","year":"2019","journal-title":"Sci. Total Environ."},{"key":"ref_5","first-page":"102005","article-title":"Influence of image availability and change processes on consistency of land transformation interpretations","volume":"86","author":"Tarko","year":"2019","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Pengra, B., Gallant, A.L., Zhu, Z., and Dahal, D. (2016). Evaluation of the Initial Thematic Output from a Continuous Change-Detection Algorithm for Use in Automated Operational Land-Change Mapping by the U.S. Geological Survey. Remote Sens., 8.","DOI":"10.3390\/rs8100811"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"D\u2019Andrimont, R., Yordanov, M., Lemoine, G., Yoong, J., Nikel, K., and van der Velde, M. (2018). Crowdsourced Street-Level Imagery as a Potential Source of In-Situ Data for Crop Monitoring. Land, 7.","DOI":"10.20944\/preprints201809.0573.v1"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bayas, J.C.L., See, L., Bartl, H., Sturn, T., Karner, M., Fraisl, D., Moorthy, I., Busch, M., Van Der Velde, M., and Fritz, S. (2020). Crowdsourcing LUCAS: Citizens Generating Reference Land Cover and Land Use Data with a Mobile App. Land, 9.","DOI":"10.3390\/land9110446"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1980","DOI":"10.1111\/gcb.12838","article-title":"Mapping global cropland and field size","volume":"21","author":"Fritz","year":"2015","journal-title":"Glob. Chang. Biol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.envsoft.2017.02.004","article-title":"Automatic land cover classification of geo-tagged field photos by deep learning","volume":"91","author":"Xu","year":"2017","journal-title":"Environ. Model. Softw."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.isprsjprs.2018.04.025","article-title":"Exploring geo-tagged photos for land cover validation with deep learning","volume":"141","author":"Xing","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1109\/TGRS.2009.2039484","article-title":"Feature Selection for Classification of Hyperspectral Data by SVM","volume":"48","author":"Pal","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sitthi, A., Nagai, M., Dailey, M., and Ninsawat, S. (2016). Exploring Land Use and Land Cover of Geotagged Social-Sensing Images Using Naive Bayes Classifier. Sustainability, 8.","DOI":"10.3390\/su8090921"},{"key":"ref_14","first-page":"84","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"NIPS"},{"key":"ref_15","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the International Conference on Machine Learning, Lille, France."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_17","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"6124","DOI":"10.1109\/JSTARS.2020.3028158","article-title":"A Framework for Land Use Scenes Classification Based on Landscape Photos","volume":"13","author":"Xu","year":"2020","journal-title":"Proc. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhu, Y., and Newsam, S. (2015, January 3\u20136). Land Use Classification using Convolutional Neural Networks Applied to Ground-Level Images. Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems, Seattle, WA, USA.","DOI":"10.1145\/2820783.2820851"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Oba, H., Hirota, M., Chbeir, R., Ishikawa, H., and Yokoyama, S. (2014, January 10\u201312). Towards Better Land Cover Classification Using Geo-tagged Photographs. Proceedings of the 2014 IEEE International Symposium on Multimedia, Washington, DC, USA.","DOI":"10.1109\/ISM.2014.78"},{"key":"ref_22","unstructured":"Defourny, P., Kirches, G., Brockmann, C., Boettcher, M., Peters, M., Bontemps, S., Lamarche, C., Schlerf, M., and Santoro, M. (2016, March 05). Land Cover CCI: Product User Guide Version. Available online: http:\/\/maps.elie.ucl.ac.be\/CCI\/viewer\/download\/ESACCI-LC-Ph2-PUGv2_2.0.pdf."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2753","DOI":"10.5194\/essd-13-2753-2021","article-title":"GLC_FCS30: Global land-cover product with fine classification system at 30 m using time-series Landsat imagery","volume":"13","author":"Zhang","year":"2021","journal-title":"Earth Syst. Sci. Data"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1068\/b3344","article-title":"In Search of Classification that Supports the Dynamics of Science: The FAO Land Cover Classification System and Proposed Modifications","volume":"35","author":"Ahlqvist","year":"2008","journal-title":"Environ. Plan. B Plan. Des."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5467","DOI":"10.1080\/01431160500259931","article-title":"Land cover heterogeneity in Great Britain as identified in Land Cover Map","volume":"26","author":"Hill","year":"2005","journal-title":"Int. J. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yang, H., Li, S., Chen, J., Zhang, X., and Xu, S. (2017). The Standardization and Harmonization of Land Cover Classification Systems towards Harmonized Datasets: A Review. ISPRS Int. J. Geo-Inf., 6.","DOI":"10.3390\/ijgi6050154"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.isprsjprs.2017.01.016","article-title":"Accuracy assessment of seven global land cover datasets over China","volume":"125","author":"Yang","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Qian, T., Kinoshita, T., Fujii, M., and Bao, Y. (2020). Analyzing the Uncertainty of Degree Confluence Project for Validating Global Land-Cover Maps Using Reference Data-Based Classification Schemes. Remote Sens., 12.","DOI":"10.3390\/rs12162589"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Saha, A., Pal, S., Arabameri, A., Blaschke, T., Panahi, S., Chowdhuri, I., Chakrabortty, R., Costache, R., and Arora, A. (2021). Flood Susceptibility Assessment Using Novel Ensemble of Hyperpipes and Support Vector Regression Algorithms. Water, 13.","DOI":"10.3390\/w13020241"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"111017","DOI":"10.1016\/j.rse.2018.12.016","article-title":"Characterizing land cover\/land use from multiple years of Landsat and MODIS time series: A novel approach using land surface phenology modeling and random forest classifier","volume":"238","author":"Nguyen","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1236","DOI":"10.1016\/j.rse.2009.02.011","article-title":"Estimating accuracy of land-cover composition from two-stage cluster sampling","volume":"113","author":"Stehman","year":"2009","journal-title":"Remote Sens. Environ."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ishii, Y., Iwao, K., and Kinoshita, T. (2021). Global Land Cover Assessment Using Spatial Uniformity Validation Dataset. Remote Sens., 13.","DOI":"10.3390\/rs13152950"}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/11\/11\/567\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:17:26Z","timestamp":1760145446000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/11\/11\/567"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,13]]},"references-count":32,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["ijgi11110567"],"URL":"https:\/\/doi.org\/10.3390\/ijgi11110567","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,13]]}}}