{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T19:02:07Z","timestamp":1774292527658,"version":"3.50.1"},"reference-count":63,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>We propose a new convolutional neural networks method in combination with ordinal regression aiming at assessing the degree of building damage caused by earthquakes with aerial imagery. The ordinal regression model and a deep learning algorithm are incorporated to make full use of the information to improve the accuracy of the assessment. A new loss function was introduced in this paper to combine convolutional neural networks and ordinal regression. Assessing the level of damage to buildings can be considered as equivalent to predicting the ordered labels of buildings to be assessed. In the existing research, the problem has usually been simplified as a problem of pure classification to be further studied and discussed, which ignores the ordinal relationship between different levels of damage, resulting in a waste of information. Data accumulated throughout history are used to build network models for assessing the level of damage, and models for assessing levels of damage to buildings based on deep learning are described in detail, including model construction, implementation methods, and the selection of hyperparameters, and verification is conducted by experiments. When categorizing the damage to buildings into four types, we apply the method proposed in this paper to aerial images acquired from the 2014 Ludian earthquake and achieve an overall accuracy of 77.39%; when categorizing damage to buildings into two types, the overall accuracy of the model is 93.95%, exceeding such values in similar types of theories and methods.<\/jats:p>","DOI":"10.3390\/rs11232858","type":"journal-article","created":{"date-parts":[[2019,12,2]],"date-time":"2019-12-02T10:50:45Z","timestamp":1575283845000},"page":"2858","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["Assessment of the Degree of Building Damage Caused by Disaster Using Convolutional Neural Networks in Combination with Ordinal Regression"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9824-5679","authenticated-orcid":false,"given":"Tianyu","family":"Ci","sequence":"first","affiliation":[{"name":"Key Laboratory of Environmental Change and Natural Disaster of Ministry of Education, Beijing Normal University, Beijing 100875, China"},{"name":"College of Global Change and Earth System Science, Beijing Normal University, Beijing 100875, China"}]},{"given":"Zhen","family":"Liu","sequence":"additional","affiliation":[{"name":"Faculty of Education, Beijing Normal University, Beijing 100875, China"}]},{"given":"Ying","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Environmental Change and Natural Disaster of Ministry of Education, Beijing Normal University, Beijing 100875, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.isprsjprs.2013.06.011","article-title":"A comprehensive review of earthquake-induced building damage detection with remote sensing techniques","volume":"84","author":"Dong","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1080\/19479832.2014.1001879","article-title":"Building Damage Assessment after the Earthquake in Haiti using two Post-Event Satellite Stereo imagery and DSMs","volume":"6","author":"Tian","year":"2015","journal-title":"Int. J. Image Data Fusion"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1118","DOI":"10.1109\/JSTARS.2012.2205559","article-title":"Combined Edge Segment Texture Analysis for the Detection of Damaged Buildings in Crisis Areas","volume":"5","author":"Klonus","year":"2012","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4973","DOI":"10.1080\/01431161.2010.494632","article-title":"Structural damage detection using bi-temporal optical satellite images","volume":"32","author":"Chen","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3411","DOI":"10.1080\/01431161003727697","article-title":"Context-based mapping of damaged buildings from high-resolution optical satellite images","volume":"31","author":"Vu","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"S157","DOI":"10.1193\/1.3632109","article-title":"Validating assessments of seismic damage made from remote sensing","volume":"27","author":"Booth","year":"2011","journal-title":"Earthq. Spectra"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1193\/1.2101107","article-title":"Visual damage assessment using high-resolution satellite images following the 2003 Bam, Iran, earthquake","volume":"21","author":"Saito","year":"2005","journal-title":"Earthq. Spectra"},{"key":"ref_8","unstructured":"Gr\u00fcnthal, G. (1998). European Macroseismic Scale 1998, European Seismological Commission (ESC)."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1193\/1.2101907","article-title":"Towards rapid citywide damage mapping using neighborhood edge dissimilarities in very high-resolution optical satellite imagery\u2014Application to the 2003 Bam, Iran, earthquake","volume":"21","author":"Huyck","year":"2005","journal-title":"Earthq. Spectra"},{"key":"ref_10","unstructured":"Adams, B. (2004, January 12\u201323). Improved disaster management through post-earthquake building damage assessment using multitemporal satellite imagery. Proceedings of the ISPRS XXth Congress, Istanbul, Turkey."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.rse.2018.03.004","article-title":"Earthquake damage mapping: An overall assessment of ground surveys and VHR image change detection after L\u2019Aquila 2009 earthquake","volume":"210","author":"Anniballe","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4870","DOI":"10.3390\/rs6064870","article-title":"Rapid Damage Assessment by Means of Multi-Temporal SAR\u2014A Comprehensive Review and Outlook to Sentinel-1","volume":"6","author":"Plank","year":"2014","journal-title":"Remote Sens."},{"key":"ref_13","unstructured":"Gupta, R., Goodman, B., Patel, N., Hosfelt, R., Sajeev, S., Heim, E., Doshi, J., Lucas, K., Choset, H., and Gaston, M. (2019, January 16\u201320). Creating xBD: A Dataset for Assessing Building Damage from Satellite Imagery. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3393","DOI":"10.1080\/01431161003727705","article-title":"Urban building damage detection from very high resolution imagery using OCSVM and spatial features","volume":"31","author":"Li","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_15","unstructured":"Yu, H., Cheng, G., and Ge, X. (2010, January 4\u20136). Earthquake-collapsed building extraction from LiDAR and aerophotograph based on OBIA. Proceedings of the 2nd International Conference on Information Science and Engineering, Hangzhou, China."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cooner, A., Shao, Y., and Campbell, J. (2016). Detection of Urban Damage Using Remote Sensing and Machine Learning Algorithms: Revisiting the 2010 Haiti Earthquake. Remote Sens., 8.","DOI":"10.3390\/rs8100868"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ji, M., Liu, L., and Buchroithner, M. (2018). Identifying Collapsed Buildings Using Post-Earthquake Satellite Imagery and Convolutional Neural Networks: A Case Study of the 2010 Haiti Earthquake. Remote Sens., 10.","DOI":"10.3390\/rs10111689"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Duarte, D., Nex, F., Kerle, N., and Vosselman, G. (2018). Multi-Resolution Feature Fusion for Image Classification of Building Damages with Convolutional Neural Networks. Remote Sens., 10.","DOI":"10.3390\/rs10101636"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1109\/TGRS.2016.2612821","article-title":"Convolutional Neural Networks for Large-Scale Remote Sensing Image Classification","volume":"55","author":"Maggiori","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1109\/LGRS.2017.2657778","article-title":"Training Deep Convolutional Neural Networks for Land 2013; Cover Classification of High-Resolution Imagery","volume":"14","author":"Scott","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2321","DOI":"10.1109\/LGRS.2015.2475299","article-title":"Deep Learning Based Feature Selection for Remote Sensing Scene Classification","volume":"12","author":"Zou","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3373","DOI":"10.1109\/JSTARS.2017.2672736","article-title":"Object-Based Land-Cover Supervised Classification for Very-High-Resolution UAV Images Using Stacked Denoising Autoencoders","volume":"10","author":"Zhang","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3631","DOI":"10.1109\/JSTARS.2017.2686488","article-title":"Multilevel Cloud Detection in Remote Sensing Images Based on Deep Learning","volume":"10","author":"Xie","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gallego, A.-J., Pertusa, A., and Gil, P. (2018). Automatic Ship Classification from Optical Aerial Images with Convolutional Neural Networks. Remote Sens., 10.","DOI":"10.3390\/rs10040511"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1007\/s11430-010-4005-0","article-title":"Spatial distribution and inducement of collapsed buildings in Yushu earthquake based on remote sensing analysis","volume":"53","author":"Guo","year":"2010","journal-title":"Sci. China Earth Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1007\/s13753-017-0143-8","article-title":"Quantifying Disaster Physical Damage Using Remote Sensing Data\u2014A Technical Work Flow and Case Study of the 2014 Ludian Earthquake in China","volume":"8","author":"Fan","year":"2017","journal-title":"Int. J. Disaster Risk Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/s11589-014-0104-x","article-title":"Characteristics of strong motions and damage implications of M S6.5 Ludian earthquake on August 3, 2014","volume":"28","author":"Xu","year":"2015","journal-title":"Earthq. Sci."},{"key":"ref_28","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems, MIT Press. Lake Tahoe, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/323533a0","article-title":"Learning representations by back-propagating errors","volume":"323","author":"Rumelhart","year":"1986","journal-title":"Nature"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Castelluccio, M., Poggi, G., Sansone, C., and Verdoliva, L. (2017, January 6\u20138). Training convolutional neural networks for semantic classification of remote sensing imagery. Proceedings of the 2017 Joint Urban Remote Sensing Event (JURSE), Dubai, UAE.","DOI":"10.1109\/JURSE.2017.7924535"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wang, Y., Gu, L., Ren, R., Zheng, X., and Fan, X. (2018, January 7). A land-cover classification method of high-resolution remote sensing imagery based on convolution neural network. Proceedings of the Earth Observing Systems XXIII, San Diego, CA, USA.","DOI":"10.1117\/12.2318930"},{"key":"ref_32","unstructured":"LeCun, Y., Cortes, C., and Burges, C. (2019, November 28). MNIST Handwritten Digit Database. Available online: http:\/\/yann.lecun.com\/exdb\/mnist."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10115-007-0114-2","article-title":"Top 10 algorithms in data mining","volume":"14","author":"Wu","year":"2008","journal-title":"Knowl. Inf. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.isprsjprs.2010.11.001","article-title":"Support vector machines in remote sensing: A review","volume":"66","author":"Mountrakis","year":"2011","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1109\/21.97458","article-title":"A survey of decision tree classifier methodology","volume":"21","author":"Safavian","year":"1991","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Thanh Noi, P., and Kappas, M. (2018). Comparison of random forest, k-nearest neighbor, and support vector machine classifiers for land cover classification using Sentinel-2 imagery. Sensors, 18.","DOI":"10.3390\/s18010018"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1178","DOI":"10.1109\/TIP.2008.924280","article-title":"Image-based human age estimation by manifold learning and locally adjusted robust regression","volume":"17","author":"Guo","year":"2008","journal-title":"IEEE Trans. Image Process."},{"key":"ref_38","unstructured":"Eigen, D., Puhrsch, C., and Fergus, R. (2014, January 8\u201313). Depth map prediction from a single image using a multi-scale deep network. Proceedings of the Advances in Neural Information Processing Systems, Montreal, Canada."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1016\/j.ejor.2007.08.013","article-title":"Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions","volume":"191","author":"Greco","year":"2008","journal-title":"Eur. J. Oper. Res."},{"key":"ref_40","unstructured":"Niu, Z., Zhou, M., Wang, L., Gao, X., and Hua, G. (July, January 26). Ordinal regression with multiple output cnn for age estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Les Vegas, NV, USA."},{"key":"ref_41","unstructured":"Shashua, A., and Levin, A. (2003). Ranking with large margin principle: Two approaches. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_42","unstructured":"Li, L., and Lin, H.-T. (2006, January 4\u20137). Ordinal regression by extended binary classification. Proceedings of the Advances in Neural Information Processing Systems, Columbia, Canada."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Fu, H., Gong, M., Wang, C., Batmanghelich, K., and Tao, D. (2018, January 18\u201322). Deep Ordinal Regression Network for Monocular Depth Estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake, UT, USA.","DOI":"10.1109\/CVPR.2018.00214"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"049901","DOI":"10.1117\/1.2819119","article-title":"Pattern recognition and machine learning","volume":"16","author":"Nasrabadi","year":"2007","journal-title":"J. Electron. Imaging"},{"key":"ref_45","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_46","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the Computer Vision and Pattern Recognition, Les Vegas, NV, USA."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"Imagenet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_48","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv."},{"key":"ref_49","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified linear units improve restricted boltzmann machines. Proceedings of the 27th International Conference on Machine Learning (ICML-10), Haifa, Israel."},{"key":"ref_50","unstructured":"Chollet, F. (2019, November 28). Keras. In GitHub; 2015. Available online: https:\/\/github.com\/fchollet\/keras."},{"key":"ref_51","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2019, November 28). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems; In GitHub; 2015. Available online: https: \/\/www.tensorflow.org\/."},{"key":"ref_52","first-page":"57","article-title":"Python: A programming language for software integration and development","volume":"17","author":"Sanner","year":"1999","journal-title":"J. Mol. Graph. Model."},{"key":"ref_53","unstructured":"Nvidia, C. (2019, November 28). Compute Unified Device Architecture Programming Guide; NVIDIA Corporation. Available online: http:\/\/docs.nvidia.com\/cuda."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/978-3-540-74831-1_5","article-title":"The geospatial data abstraction library","volume":"Volume 2","author":"Warmerdam","year":"2008","journal-title":"Open Source Approaches in Spatial Data Handling"},{"key":"ref_55","unstructured":"Huh, M., Agrawal, P., and Efros, A.A. (2019, November 28). What Makes ImageNet Good for Transfer Learning?. Available online: https:\/\/arxiv.org\/abs\/1608.08614."},{"key":"ref_56","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and statistics, Sardinia, Italy."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Lechevallier, Y., and Saporta, G. (2010). Large-scale machine learning with stochastic gradient descent. Proceedings of the COMPSTAT\u20192010;, Springer.","DOI":"10.1007\/978-3-7908-2604-3"},{"key":"ref_58","unstructured":"Ruder, S. (2016). An overview of gradient descent optimization algorithms. arXiv."},{"key":"ref_59","unstructured":"Sutskever, I., Martens, J., Dahl, G., and Hinton, G. (2018, January 16). On the importance of initialization and momentum in deep learning. Proceedings of the International conference on machine learning, Atlanta, GA, USA."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A Coefficient of Agreement for Nominal Scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_61","unstructured":"Solomatine, D.P., See, L.M., and Abrahart, R.J. (2009). Chapter 2 Data-Driven Modelling: Concepts, Approaches and Experiences, Springer."},{"key":"ref_62","unstructured":"Ci, T. (2019, November 28). Building_Assessment_Code_and_Dataset. Available online: https:\/\/github.com\/city292\/build_assessment."},{"key":"ref_63","first-page":"2999","article-title":"Focal loss for dense object detection","volume":"39","author":"Lin","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/23\/2858\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:39:07Z","timestamp":1760189947000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/23\/2858"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,1]]},"references-count":63,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["rs11232858"],"URL":"https:\/\/doi.org\/10.3390\/rs11232858","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,1]]}}}