{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T23:19:51Z","timestamp":1783552791036,"version":"3.55.0"},"reference-count":48,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,8,16]],"date-time":"2021-08-16T00:00:00Z","timestamp":1629072000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["JP19K12681"],"award-info":[{"award-number":["JP19K12681"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Precise measuring of urban fa\u00e7ade color is necessary for urban color planning. The existing manual methods of measuring building fa\u00e7ade color are limited by time and labor costs and hardly carried out on a city scale. These methods also make it challenging to identify the role of the building function in controlling and guiding urban color planning. This paper explores a city-scale approach to fa\u00e7ade color measurement with building functional classification using state-of-the-art deep learning techniques and street view images. Firstly, we used semantic segmentation to extract building fa\u00e7ades and conducted the color calibration of the photos for pre-processing the collected street view images. Then, we proposed a color chart-based fa\u00e7ade color measurement method and a multi-label deep learning-based building classification method. Next, the field survey data were used as the ground truth to verify the accuracy of the fa\u00e7ade color measurement and building function classification. Finally, we applied our approach to generate fa\u00e7ade color distribution maps with the building classification for three metropolises in China, and the results proved the transferability and effectiveness of the scheme. The proposed approach can provide city managers with an overall perception of urban fa\u00e7ade color and building function across city-scale areas in a cost-efficient way, contributing to data-driven decision making for urban analytics and planning.<\/jats:p>","DOI":"10.3390\/ijgi10080551","type":"journal-article","created":{"date-parts":[[2021,8,16]],"date-time":"2021-08-16T21:27:45Z","timestamp":1629149265000},"page":"551","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":60,"title":["Development of a City-Scale Approach for Fa\u00e7ade Color Measurement with Building Functional Classification Using Deep Learning and Street View Images"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6330-6723","authenticated-orcid":false,"given":"Jiaxin","family":"Zhang","sequence":"first","affiliation":[{"name":"Division of Sustainable Energy and Environmental Engineering, Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita, Osaka 565-0871, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4271-4445","authenticated-orcid":false,"given":"Tomohiro","family":"Fukuda","sequence":"additional","affiliation":[{"name":"Division of Sustainable Energy and Environmental Engineering, Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita, Osaka 565-0871, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2944-4540","authenticated-orcid":false,"given":"Nobuyoshi","family":"Yabuki","sequence":"additional","affiliation":[{"name":"Division of Sustainable Energy and Environmental Engineering, Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita, Osaka 565-0871, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,16]]},"reference":[{"key":"ref_1","unstructured":"Porter, T., and Mikellides, B. (2019). Colour for Architecture Today, Taylor & Francis."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1002\/col.20728","article-title":"Method of urban color plan based on spatial configuration","volume":"38","author":"Gou","year":"2013","journal-title":"Color Res. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhong, T., Ye, C., Wang, Z., Tang, G., Zhang, W., and Ye, Y. (2021). City-Scale Mapping of Urban Fa\u00e7ade Color Using Street-View Imagery. Remote Sens., 13.","DOI":"10.3390\/rs13081591"},{"key":"ref_4","first-page":"45","article-title":"The Urban Color Image Recognition Design","volume":"36","author":"Song","year":"2015","journal-title":"Packag. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/10630732.2017.1297520","article-title":"Emerging workplaces in post-functionalist cities","volume":"24","author":"Lapintie","year":"2017","journal-title":"J. Urban Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1002\/col.22487","article-title":"Study on the preference of city color image selection based on the logistic model: A case study of Shanghai","volume":"45","author":"Wang","year":"2020","journal-title":"Color Res. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ren, X. (2011). Building Globalization: Transnational Architecture Production in Urban China, University of Chicago Press.","DOI":"10.7208\/chicago\/9780226709826.001.0001"},{"key":"ref_8","first-page":"88","article-title":"Investigation and quantitative analysis of urban color: A case study of shennan avenue in shenzhen","volume":"12","author":"Lu","year":"2010","journal-title":"City Plan. Rev."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"5016014","DOI":"10.1061\/(ASCE)UP.1943-5444.0000345","article-title":"Spatial-sensitivity analysis for urban color planning: Study of Luoyang City, China","volume":"143","author":"Li","year":"2017","journal-title":"J. Urban Plan. Dev."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1002\/col.22022","article-title":"Color in the urban environment: A user-oriented protocol for chromatic characterization and the development of a parametric typology","volume":"42","author":"Nguyen","year":"2017","journal-title":"Color Res. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1068\/b32047","article-title":"Mobile landscapes: Using location data from cell phones for urban analysis","volume":"33","author":"Ratti","year":"2006","journal-title":"Environ. Plan. B Plan. Des."},{"key":"ref_12","unstructured":"Zhang, J., Fukuda, T., and Yabuki, N. A Large-Scale Measurement and Quantitative Analysis Method of Fa\u00e7ade Color in the Urban Street Using Deep Learning. Proceedings of the International Conference on Computational Design and Robotic Fabrication."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.isprsjprs.2018.09.015","article-title":"Color calibration of digital images for agriculture and other applications","volume":"146","author":"Sunoj","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.isprsjprs.2018.02.006","article-title":"Building instance classification using street view images","volume":"145","author":"Kang","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1080\/13604810600594647","article-title":"Form follows power: A genealogy of urban shrines","volume":"10","author":"Kaika","year":"2006","journal-title":"City"},{"key":"ref_16","first-page":"3","article-title":"Influencing factors on city color tone","volume":"10","author":"Bing","year":"2011","journal-title":"Urban Probl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1002\/col.22283","article-title":"Chromatic harmony in architecture and the Munsell color system","volume":"43","year":"2018","journal-title":"Color Res. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lam, E.Y., Fung, G.S., and Lukac, R. (2009). Automatic white balancing in digital photography. Single-Sensor Imaging, CRC Press.","DOI":"10.1201\/9781420054538.ch10"},{"key":"ref_19","unstructured":"Yuan, L., and Sun, J. Automatic exposure correction of consumer photographs. Proceedings of the European Conference on Computer Vision."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.rse.2006.02.010","article-title":"Use of impervious surface in urban land-use classification","volume":"102","author":"Lu","year":"2006","journal-title":"Remote Sens. Environ."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hoffmann, E.J., Wang, Y., Werner, M., Kang, J., and Zhu, X.X. (2019). Model fusion for building type classification from aerial and street view images. Remote Sens., 11.","DOI":"10.3390\/rs11111259"},{"key":"ref_22","unstructured":"Zong, Z., Feng, J., Liu, K., Shi, H., and Li, Y. (February, January 27). DeepDPM: Dynamic population mapping via deep neural network. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.buildenv.2018.02.042","article-title":"Mapping sky, tree, and building view factors of street canyons in a high-density urban environment","volume":"134","author":"Gong","year":"2018","journal-title":"Build. Environ."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Karayazi, S.S., Dane, G., and de Vries, B. (2021). Utilizing Urban Geospatial Data to Understand Heritage Attractiveness in Amsterdam. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10040198"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Durand, T., Mehrasa, N., and Mori, G. (2019, January 16\u201320). Learning a deep convnet for multi-label classification with partial labels. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00074"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"106424","DOI":"10.1016\/j.buildenv.2019.106424","article-title":"Classification and mapping of urban canyon geometry using Google Street View images and deep multitask learning","volume":"167","author":"Hu","year":"2020","journal-title":"Build. Environ."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.landurbplan.2017.05.010","article-title":"Green streets-Quantifying and mapping urban trees with street-level imagery and computer vision","volume":"165","author":"Seiferling","year":"2017","journal-title":"Landsc. Urban Plan."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Novack, T., Vorbeck, L., Lorei, H., and Zipf, A. (2020). Towards Detecting Building Facades with Graffiti Artwork Based on Street View Images. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9020098"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016, January 30). The Cityscapes Dataset for Semantic Urban Scene Understanding. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.350"},{"key":"ref_30","first-page":"5","article-title":"The Pascal Visual Object Classes Challenge 2012 (voc2012) development kit","volume":"8","author":"Everingham","year":"2011","journal-title":"Tech. Rep."},{"key":"ref_31","unstructured":"Wong, K.-M., Chey, C.-H., Liu, T.-S., and Po, L.-M. (2003, January 25\u201328). Dominant color image retrieval using merged histogram. Proceedings of the 2003 IEEE International Symposium on Circuits and Systems (ISCAS), Bangkok, Thailand."},{"key":"ref_32","unstructured":"(2020, January 31). OpenStreetMap. Available online: https:\/\/www.openstreetmap.org."},{"key":"ref_33","unstructured":"Gehl, J. (2013). Cities for People, Island Press."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"106988","DOI":"10.1016\/j.jqsrt.2020.106988","article-title":"Mapping the brightness and color of urban to rural skyglow with all-sky photometry","volume":"250","author":"Jechow","year":"2020","journal-title":"J. Quant. Spectrosc. Radiat. Transf."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Mazzeo, P.L., Giove, L., Moramarco, G.M., Spagnolo, P., and Leo, M. (September, January 30). HSV and RGB color histograms comparing for objects tracking among non overlapping FOVs, using CBTF. Proceedings of the 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Klagenfurt, Austria.","DOI":"10.1109\/AVSS.2011.6027383"},{"key":"ref_36","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical image Computing and Computer-Assisted Intervention."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 26). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_39","unstructured":"(2020, January 31). Architectural Standard Color Chart. Available online: https:\/\/www.colortell.com\/colorbook\/?callbook=a8."},{"key":"ref_40","unstructured":"Agoston, G.A. (2013). Color Theory and Its Application in Art and Design, Springer."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.buildenv.2018.05.035","article-title":"Identification of representative buildings and building groups in urban datasets using a novel pre-processing, classification, clustering and predictive modelling approach","volume":"140","author":"Tardioli","year":"2018","journal-title":"Build. Environ."},{"key":"ref_42","unstructured":"Iandola, F., Moskewicz, M., Karayev, S., Girshick, R., Darrell, T., and Keutzer, K. (2014). Densenet: Implementing efficient convnet descriptor pyramids. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Koonce, B. (2021). EfficientNet. Convolutional Neural Networks with Swift for Tensorflow, Springer.","DOI":"10.1007\/978-1-4842-6168-2"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A. (2017, January 4\u20139). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_45","unstructured":"Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J., and Manmatha, R. (2020). ResNeSt: Split-Attention Networks. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Flad, R.K., and Chen, P. (2013). Ancient Central China: Centers and Peripheries along the Yangzi River, Cambridge University Press.","DOI":"10.1017\/CBO9781139034852"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1007\/s10115-017-1022-8","article-title":"Prequential AUC: Properties of the area under the ROC curve for data streams with concept drift","volume":"52","author":"Brzezinski","year":"2017","journal-title":"Knowl. Inf. Syst."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1002\/col.22122","article-title":"A comparison between wishes and status: Gray is not the preference for residents while the city shows neutral colors","volume":"42","author":"Gou","year":"2017","journal-title":"Color Res. Appl."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/8\/551\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:46:56Z","timestamp":1760165216000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/8\/551"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,16]]},"references-count":48,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["ijgi10080551"],"URL":"https:\/\/doi.org\/10.3390\/ijgi10080551","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,16]]}}}