{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T20:19:50Z","timestamp":1767903590691,"version":"3.49.0"},"reference-count":47,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,12,25]],"date-time":"2019-12-25T00:00:00Z","timestamp":1577232000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&amp;D Program of China","award":["2016YFC0502902"],"award-info":[{"award-number":["2016YFC0502902"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41471137"],"award-info":[{"award-number":["41471137"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Strategic Priority Research Program (A) of the Chinese Academy of Sciences","award":["XDA23030105"],"award-info":[{"award-number":["XDA23030105"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Information about urban built-up areas is important for urban planning and management. However, obtaining accurate information about urban built-up areas is a challenge. This study developed a general-purpose built-up area intelligent classification (BAIC) system that supports various types of data and classifiers. All of the steps in the BAIC were implemented using Python modules including Numpy, Pandas, matplotlib, and scikit-learn. We used the BAIC to conduct a classification experiment that involved seven types of input data; namely, Point of Interest (POI), Road Network (RN), nighttime light (NTL), a combination of POI and RN data (POI_RN), a combination of POI and NTL data (POI_NTL), a combination of RN and NTL data (RN_NTL), and a combination of POI, RN, and NTL data (POI_RN_NTL), and five classifiers, namely, Logistic Regression (LR), Decision Tree (DT), Random Forests (RF), Gradient Boosted Decision Trees (GBDT), and AdaBoost. The results show the following: (1) among the 35 combinations of the five classifiers and seven types of input data, the overall accuracy (OA) ranged from 76 to 89%, F1 values ranged from 0.73 to 0.86, and the area under the receiver operating characteristic (ROC) curve (AUC) ranged from 0.83 to 0.95. The largest F1 value and OA were obtained using the POI_RN_NTL data and AdaBoost, while the largest AUC was obtained using POI_RN_NTL and POI_NTL data against AdaBoost, LR, and RF; and (2) the advantages of the BAIC include its support for multi-source input data, its objective accuracy assessment, and its robust classifiers. The BAIC can quickly and efficiently realize the automatic classification of urban built-up areas at a reasonably low cost and can be readily applied to other urban areas in the world where any kind of POI, RN, or NTL data coverage is available. The results of this study are expected to provide timely and effective reference information for urban planning and urban management departments, and could also potentially be used to develop large-scale maps of urban built-up areas in the future.<\/jats:p>","DOI":"10.3390\/rs12010091","type":"journal-article","created":{"date-parts":[[2019,12,27]],"date-time":"2019-12-27T05:37:08Z","timestamp":1577425028000},"page":"91","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["A Machine Learning-Based Classification System for Urban Built-Up Areas Using Multiple Classifiers and Data Sources"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4327-4840","authenticated-orcid":false,"given":"Lang","family":"Sun","sequence":"first","affiliation":[{"name":"Key Lab of Urban Environment and Health, Institute of Urban Environment, Chinese Academy of Sciences, Xiamen 361021, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7975-2472","authenticated-orcid":false,"given":"Lina","family":"Tang","sequence":"additional","affiliation":[{"name":"Key Lab of Urban Environment and Health, Institute of Urban Environment, Chinese Academy of Sciences, Xiamen 361021, China"}]},{"given":"Guofan","family":"Shao","sequence":"additional","affiliation":[{"name":"Department of Forestry and Natural Resources, Purdue University, West Lafayette, IN 47907, USA"}]},{"given":"Quanyi","family":"Qiu","sequence":"additional","affiliation":[{"name":"Key Lab of Urban Environment and Health, Institute of Urban Environment, Chinese Academy of Sciences, Xiamen 361021, China"}]},{"given":"Ting","family":"Lan","sequence":"additional","affiliation":[{"name":"Key Lab of Urban Environment and Health, Institute of Urban Environment, Chinese Academy of Sciences, Xiamen 361021, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0441-9565","authenticated-orcid":false,"given":"Jinyuan","family":"Shao","sequence":"additional","affiliation":[{"name":"Key Lab of Urban Environment and Health, Institute of Urban Environment, Chinese Academy of Sciences, Xiamen 361021, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,25]]},"reference":[{"key":"ref_1","unstructured":"Pendall, R., Martin, J., and Fulton, W.B. (2002). Holding the Line: Urban Containment in the United States, Center on Urban and Metropolitan Policy, The Brookings Institution."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3879","DOI":"10.3390\/rs6053879","article-title":"Supporting Global Environmental Change Research: A Review of Trends and Knowledge Gaps in Urban Remote Sensing","volume":"6","author":"Wentz","year":"2014","journal-title":"Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1016\/S0034-4257(97)00046-1","article-title":"A technique for using composite DMSP\/OLS \u201cCity Lights\u201d satellite data to map urban area","volume":"61","author":"Imhoff","year":"1997","journal-title":"Remote Sens. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1080\/01431160304982","article-title":"Validation of urban boundaries derived from global night-time satellite imagery","volume":"24","author":"Henderson","year":"2003","journal-title":"Int. J. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1080\/2150704X.2014.905728","article-title":"Evaluation of NPP-VIIRS night-time light composite data for extracting built-up urban areas","volume":"5","author":"Shi","year":"2014","journal-title":"Remote Sens. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1109\/LGRS.2018.2830797","article-title":"Urban Built-Up Area Extraction from Log-Transformed NPP-VIIRS Nighttime Light Composite Data","volume":"15","author":"Yu","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2184","DOI":"10.1109\/JSTARS.2012.2235410","article-title":"Fast and Efficient Urban Extent Extraction Using ASAR Wide Swath Mode Data","volume":"6","author":"Gamba","year":"2013","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4255","DOI":"10.1109\/JSTARS.2014.2359000","article-title":"A Texture Measure Defined Over Intuitionistic Fuzzy Set Theory for the Detection of Built-Up Areas in High-Resolution SAR Images","volume":"7","author":"Li","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xiang, D., Tang, T., Hu, C., Fan, Q., and Su, Y. (2016). Built-up Area Extraction from PolSAR Imagery with Model-Based Decomposition and Polarimetric Coherence. Remote Sens., 8.","DOI":"10.3390\/rs8080685"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1080\/15481603.2014.939539","article-title":"Built-up area extraction using Landsat 8 OLI imagery","volume":"51","author":"Bhatti","year":"2014","journal-title":"GISci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wang, L., Zhu, J., Xu, Y., and Wang, Z. (2018). Urban Built-Up Area Boundary Extraction and Spatial-Temporal Characteristics Based on Land Surface Temperature Retrieval. Remote Sens., 10.","DOI":"10.3390\/rs10030473"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Tu, M., Wang, S., and Liu, W. (2018). A Novel Approach for Identifying Urban Built-Up Area Boundaries Using High-Resolution Remote-Sensing Data Based on the Scale Effect. ISPRS Int. J. Geo Inf., 7.","DOI":"10.3390\/ijgi7040135"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1111\/cobi.13226","article-title":"Applying deep learning to right whale photo identification","volume":"33","author":"Bogucki","year":"2019","journal-title":"Conserv. Biol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.rser.2019.04.073","article-title":"Application of artificial neutral network and geographic information system to evaluate retrofit potential in public school buildings","volume":"110","author":"Cecconi","year":"2019","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.apenergy.2019.04.065","article-title":"A feedforward neural network based indoor-climate control framework for thermal comfort and energy saving in buildings","volume":"248","author":"Chaudhuri","year":"2019","journal-title":"Appl. Energy"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.landurbplan.2018.08.020","article-title":"Measuring human perceptions of a large-scale urban region using machine learning","volume":"180","author":"Zhang","year":"2018","journal-title":"Landsc. Urban Plan."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.landurbplan.2017.12.009","article-title":"A manifold learning approach to urban land cover classification with optical and radar data","volume":"172","author":"Zhang","year":"2018","journal-title":"Landsc. Urban Plan."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rse.2019.04.015","article-title":"Integrating LiDAR data and multi-temporal aerial imagery to map wetland inundation dynamics using Google Earth Engine","volume":"228","author":"Wu","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"7339","DOI":"10.3390\/rs6087339","article-title":"Urban Built-Up Area Extraction from Landsat TM\/ETM+ Images Using Spectral Information and Multivariate Texture","volume":"6","author":"Zhang","year":"2014","journal-title":"Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ma, X., Tong, X., Liu, S., Luo, X., Xie, H., and Li, C. (2017). Optimized Sample Selection in SVM Classification by Combining with DMSP-OLS, Landsat NDVI and GlobeLand30 Products for Extracting Urban Built-Up Areas. Remote Sens., 9.","DOI":"10.3390\/rs9030236"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bramhe, V.S., Ghosh, S.K., and Garg, P.K. (2019). Extraction of built-up areas from Landsat-8 OLI data based on spectral-textural information and feature selection using support vector machine method. Geocarto Int.","DOI":"10.1080\/10106049.2019.1566406"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Forget, Y., Linard, C., and Gilbert, M. (2018). Supervised Classification of Built-Up Areas in Sub-Saharan African Cities Using Landsat Imagery and OpenStreetMap. Remote Sens., 10.","DOI":"10.3390\/rs10071145"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sun, Z., Meng, Q., and Zhai, W. (2018). An Improved Boosting Learning Saliency Method for Built-Up Areas Extraction in Sentinel-2 Images. Remote Sens., 10.","DOI":"10.3390\/rs10121863"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, T., and Tang, H. (2019). A Comprehensive Evaluation of Approaches for Built-Up Area Extraction from Landsat OLI Images Using Massive Samples. Remote Sens., 11.","DOI":"10.20944\/preprints201812.0067.v1"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xu, T., Coco, G., and Gao, J. (2019). Extraction of urban built-up areas from nighttime lights using artificial neural network. Geocarto Int.","DOI":"10.1080\/10106049.2018.1559887"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhang, P., Sun, Q., Liu, M., Li, J., and Sun, D. (2017). A Strategy of Rapid Extraction of Built-Up Area Using Multi-Seasonal Landsat-8 Thermal Infrared Band 10 Images. Remote Sens., 9.","DOI":"10.3390\/rs9111126"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1080\/13658816.2012.663918","article-title":"Using kernel density estimation to assess the spatial pattern of road density and its impact on landscape fragmentation","volume":"27","author":"Cai","year":"2013","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.engappai.2015.05.004","article-title":"Electric motor defects diagnosis based on kernel density estimation and Kullback\u2013Leibler divergence in quality control scenario","volume":"44","author":"Ferracuti","year":"2015","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.knosys.2018.06.021","article-title":"Robust clustering by identifying the veins of clusters based on kernel density estimation","volume":"159","author":"Zhou","year":"2018","journal-title":"Knowl. Based Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1883","DOI":"10.1214\/aos\/1176348376","article-title":"Bandwidth Selection for Kernel Density Estimation","volume":"19","author":"Chiu","year":"1991","journal-title":"Ann. Stat."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hosmer, D.W., Lemeshow, S., and Sturdivant, R.X. (2013). Applied Logistic Regression, John Wiley & Sons.","DOI":"10.1002\/9781118548387"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1016\/S0034-4257(97)00049-7","article-title":"Decision tree classification of land cover from remotely sensed data","volume":"61","author":"Friedl","year":"1997","journal-title":"Remote Sens. Environ."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1016\/S0034-4257(03)00132-9","article-title":"An assessment of the effectiveness of decision tree methods for land cover classification","volume":"86","author":"Pal","year":"2003","journal-title":"Remote Sens. Environ."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.rse.2005.05.008","article-title":"Decision tree regression for soft classification of remote sensing data","volume":"97","author":"Xu","year":"2005","journal-title":"Remote Sens. Environ."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1621","DOI":"10.1007\/s11069-015-1915-3","article-title":"Binary logistic regression versus stochastic gradient boosted decision trees in assessing landslide susceptibility for multiple-occurring landslide events: application to the 2009 storm event in Messina (Sicily, southern Italy)","volume":"79","author":"Lombardo","year":"2015","journal-title":"Nat. Hazards."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1016\/j.nima.2004.12.018","article-title":"Boosted decision trees as an alternative to artificial neural networks for particle identification","volume":"543","author":"Roe","year":"2005","journal-title":"Nucl. Instrum. Methods Phys. Res. Sect. A Accel. Spectrometers Detect. Assoc. Equip."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting","volume":"55","author":"Freund","year":"1997","journal-title":"J. Comput. Syst. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"349","DOI":"10.4310\/SII.2009.v2.n3.a8","article-title":"Multi-class adaboost","volume":"2","author":"Hastie","year":"2009","journal-title":"Stat. Its Interface"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1023\/A:1007618119488","article-title":"Soft margins for AdaBoost","volume":"42","author":"Onoda","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Congalton, R.G., and Green, K. (2019). Assessing the Accuracy of Remotely Sensed Data: Principles and Practices, CRC Press. [3rd ed.].","DOI":"10.1201\/9780429052729"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1007\/s10980-008-9215-x","article-title":"On the accuracy of landscape pattern analysis using remote sensing data","volume":"23","author":"Shao","year":"2008","journal-title":"Landsc. Ecol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2487","DOI":"10.1007\/s10980-019-00916-6","article-title":"Overselling overall map accuracy misinforms about research reliability","volume":"34","author":"Shao","year":"2019","journal-title":"Landsc. Ecol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1016\/S0031-3203(96)00142-2","article-title":"The use of the area under the ROC curve in the evaluation of machine learning algorithms","volume":"30","author":"Bradley","year":"1997","journal-title":"Pattern Recognit."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1007\/s10994-009-5119-5","article-title":"Measuring classifier performance: A coherent alternative to the area under the ROC curve","volume":"77","author":"Hand","year":"2009","journal-title":"Mach. Learn."},{"key":"ref_47","first-page":"627","article-title":"Receiver Operating Characteristic (ROC) Curve Analysis for Medical Diagnostic Test Evaluation","volume":"4","year":"2013","journal-title":"Casp. J. Intern. Med."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/1\/91\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:45:45Z","timestamp":1760190345000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/1\/91"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,25]]},"references-count":47,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["rs12010091"],"URL":"https:\/\/doi.org\/10.3390\/rs12010091","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,25]]}}}