{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T11:13:36Z","timestamp":1772622816603,"version":"3.50.1"},"reference-count":33,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T00:00:00Z","timestamp":1644537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41801276"],"award-info":[{"award-number":["41801276"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004826","name":"Beijing Natural Science Foundation","doi-asserted-by":"publisher","award":["8192015"],"award-info":[{"award-number":["8192015"]}],"id":[{"id":"10.13039\/501100004826","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Spatial sampling design is important for accurately assessing land use and land cover (LULC) classification results from remote sensing data. Spatial stratification can dramatically improve spatial sampling efficiency by dividing the study area into several strata when classification correctness is spatially stratified heterogeneous. By integrating the LULC classification results from different sources and spatial resolutions, a spatial stratification method for spatial sampling of accuracy assessment is presented in this paper. Its efficiency is demonstrated in the case study using LULC data of Beijing, China, in the following steps. First, we standardized and reclassified multiresolution remote sensing data, including China\u2019s land use\/cover datasets (CLUDs) from 2017 (resolution: 30 m), 500 m MCD12Q1, and 10 m FROM-GLC10 data, into six classes. Second, we customized stratification rules, formulated a technical specification to realize 11 strata using CLUDs and MCD12Q1, and employed FROM-GLC10 as the reference data for accuracy assessment. Furthermore, six sample sets with sizes of 16,417; 1821; 652; 337; 198; and 142 were drawn using different methods, and their overall accuracy (OA), deviation accuracy (DA), root-mean-square error (RMSE), and standard deviation (STDEV) values were also evaluated to demonstrate the efficiency brought by spatial stratification. Compared with the spatial even sampling method, the OAs of the stratified even sampling method adopting the proposed stratification method was much closer to the true OA, and the corresponding RMSE and STDEV results decreased from 2.097% and 2.127% to 0.914% and 0.713%, respectively, due to the contribution of spatial stratification in the sampling scheme. The method can be used to distinguish the differences and improve the representativeness of samples, and it can be employed to select validation samples for LULC classification.<\/jats:p>","DOI":"10.3390\/rs14040865","type":"journal-article","created":{"date-parts":[[2022,2,13]],"date-time":"2022-02-13T20:34:45Z","timestamp":1644784485000},"page":"865","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Spatial Stratification Method for the Sampling Design of LULC Classification Accuracy Assessment: A Case Study in Beijing, China"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1760-6589","authenticated-orcid":false,"given":"Shiwei","family":"Dong","sequence":"first","affiliation":[{"name":"Research Center of Information Technology, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China"}]},{"given":"Hui","family":"Guo","sequence":"additional","affiliation":[{"name":"Forestry Experiment Center of North China, Chinese Academy of Forestry, Beijing 102300, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4103-3792","authenticated-orcid":false,"given":"Ziyue","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Global Change and Earth System Science, Beijing Normal University, Beijing 100875, China"}]},{"given":"Yuchun","family":"Pan","sequence":"additional","affiliation":[{"name":"Research Center of Information Technology, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China"}]},{"given":"Bingbo","family":"Gao","sequence":"additional","affiliation":[{"name":"College of Land Science and Technology, China Agricultural University, Beijing 100193, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1038\/s41586-018-0757-z","article-title":"Assessing the efficiency of changes in land use for mitigating climate change","volume":"564","author":"Searchinger","year":"2018","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2166","DOI":"10.1038\/s41467-019-09945-w","article-title":"Key determinants of global land-use projections","volume":"10","author":"Stehfest","year":"2019","journal-title":"Nat. Commun."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/j.rse.2018.11.014","article-title":"Joint deep learning for land cover and land use classification","volume":"221","author":"Zhang","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1038\/s41586-018-0411-9","article-title":"Global land change from 1982 to 2016","volume":"560","author":"Song","year":"2018","journal-title":"Nature"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.rse.2014.02.015","article-title":"Good practices for estimating area and assessing accuracy of land change","volume":"148","author":"Olofsson","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"111199","DOI":"10.1016\/j.rse.2019.05.018","article-title":"Key issues in rigorous accuracy assessment of land cover products","volume":"231","author":"Stehman","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.rse.2015.06.027","article-title":"Optimizing sample size allocation to strata for estimating area and map accuracy","volume":"168","author":"Wagner","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.rse.2018.02.026","article-title":"A comparison of resampling methods for remote sensing classification and accuracy assessment","volume":"208","author":"Lyons","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1111\/tgis.12176","article-title":"A spatial conditioned Latin hypercube sampling method for mapping using ancillary data","volume":"20","author":"Gao","year":"2016","journal-title":"Trans. GIS"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1111\/j.1538-4632.1979.tb00700.x","article-title":"An axiomatic approach to geographical space","volume":"11","author":"Beguin","year":"1979","journal-title":"Geogr. Anal."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1300","DOI":"10.3390\/rs70201300","article-title":"An optimal sampling design for observing and validating long-term leaf area index with temporal variations in spatial heterogeneities","volume":"7","author":"Zeng","year":"2015","journal-title":"Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1403","DOI":"10.1071\/SR03005","article-title":"Soil sampling strategies for spatial prediction by correlation with auxiliary maps","volume":"41","author":"Hengl","year":"2003","journal-title":"Aust. J. Soil Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.earscirev.2019.102897","article-title":"Principles and methods of scaling geospatial earth science data","volume":"197","author":"Ge","year":"2019","journal-title":"Earth-Sci. Rev."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6427","DOI":"10.1080\/01431161.2020.1739349","article-title":"Stratified even sampling method for accuracy assessment of land use\/land cover classification: A case study of Beijing, China","volume":"41","author":"Dong","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_15","first-page":"15","article-title":"Unsupervised change detection in VHR remote sensing imagery\u2014An object-based clustering approach in a dynamic urban environment","volume":"54","author":"Leichtle","year":"2017","journal-title":"Int. J. Appl. Earth Obs."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xu, E., Zhang, H., and Yao, L. (2018). An elevation-based stratification model for simulating land use change. Remote Sens., 10.","DOI":"10.3390\/rs10111730"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Dong, S., Li, H., and Sun, D. (2017). Fractal feature analysis and information extraction of woodlands based on MODIS NDVI time series. Sustainability, 9.","DOI":"10.3390\/su9071215"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3539","DOI":"10.1016\/j.rse.2011.08.016","article-title":"Comparison and assessment of coarse resolution land cover maps for northern Eurasia","volume":"115","author":"Pflugmacher","year":"2011","journal-title":"Remote Sens. Environ."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wang, L.B., Bartlett, P., Pouliot, D., Chan, E., Lamarche, C., Wulder, M.A., Defourny, P., and Brady, M. (2019). Comparison and assessment of regional and global land cover datasets for use in class over Canada. Remote Sens., 11.","DOI":"10.3390\/rs11192286"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1016\/j.rse.2005.08.012","article-title":"Spatial and temporal patterns of China\u2019s cropland during 1990\u20132000: An analysis based on Landsat TM data","volume":"98","author":"Liu","year":"2005","journal-title":"Remote Sens. Environ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.rse.2009.08.016","article-title":"MODIS collection 5 global land cover: Algorithm refinements and characterization of new datasets","volume":"114","author":"Friedl","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.scib.2019.03.002","article-title":"Stable classification with limited sample: Transferring a 30-m resolution sample set collected in 2015 to mapping 10-m resolution global land cover in 2017","volume":"64","author":"Gong","year":"2019","journal-title":"Sci. Bull."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Gruijter, J.J.D., Bierkens, M.F.P., Brus, D.J., and Knotters, M. (2006). Sampling for Natural Resource Monitoring, Springer.","DOI":"10.1007\/3-540-33161-1"},{"key":"ref_24","unstructured":"Isaaks, E.H., and Srivastava, R.M. (1989). An Introduction to Applied Geostatistics, Oxford University Press."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.2134\/jeq1998.00472425002700050013x","article-title":"Constrained optimization of spatial sampling using continuous simulated annealing","volume":"27","author":"Stein","year":"1998","journal-title":"J. Environ. Qual."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.ecolind.2017.02.011","article-title":"Error index for additional sampling to map soil contaminant grades","volume":"77","author":"Gao","year":"2017","journal-title":"Ecol. Indic."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/S0016-7061(98)00056-1","article-title":"Constrained optimisation of soil sampling for minimisation of the Kriging variance","volume":"87","author":"Siderius","year":"1999","journal-title":"Geoderma"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1080\/2150704X.2019.1677966","article-title":"Assessing the suitability of FROM-GLC10 data for understanding agricultural ecosystems in China: Beijing as a case study","volume":"11","author":"Dong","year":"2020","journal-title":"Remote Sens. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"5273","DOI":"10.1080\/01431160903130937","article-title":"Sample size determination for image classification accuracy assessment and comparison","volume":"30","author":"Foody","year":"2009","journal-title":"Int. J. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.geoderma.2013.09.016","article-title":"Predictive soil parent material mapping at a regional-scale: A random forest approach","volume":"214\u2013215","author":"Heung","year":"2014","journal-title":"Geoderma"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"5384","DOI":"10.1109\/JSTARS.2020.3022210","article-title":"Improved mapping results of 10 m resolution land cover classification in Guangdong, China using multisource remote sensing data with Google Earth Engine","volume":"13","author":"Tu","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3185","DOI":"10.1109\/JSTARS.2021.3063849","article-title":"Global land-cover mapping with weak supervision: Outcome of the 2020 IEEE GRSS data fusion contest","volume":"14","author":"Robinson","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1016\/j.rse.2017.06.041","article-title":"Stratification and sample allocation for reference burned area data","volume":"203","author":"Padilla","year":"2017","journal-title":"Remote Sens. Environ."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/4\/865\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:17:57Z","timestamp":1760134677000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/4\/865"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,11]]},"references-count":33,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["rs14040865"],"URL":"https:\/\/doi.org\/10.3390\/rs14040865","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,11]]}}}