{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T18:29:18Z","timestamp":1773772158944,"version":"3.50.1"},"reference-count":57,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2019,3,31]],"date-time":"2019-03-31T00:00:00Z","timestamp":1553990400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["No. 2016YFB0501403"],"award-info":[{"award-number":["No. 2016YFB0501403"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No. 41771363"],"award-info":[{"award-number":["No. 41771363"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No. 41701389"],"award-info":[{"award-number":["No. 41701389"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The identification and monitoring of buildings from remotely sensed imagery are of considerable value for urbanization monitoring. Two outstanding issues in the detection of changes in buildings with composite structures and relief displacements are heterogeneous appearances and positional inconsistencies. In this paper, a novel patch-based matching approach is developed using densely connected conditional random field (CRF) optimization to detect building changes from bi-temporal aerial images. First, the bi-temporal aerial images are combined to obtain change information using an object-oriented technique, and then semantic segmentation based on a deep convolutional neural network is used to extract building areas. With the change information and extracted buildings, a graph-cuts-based segmentation algorithm is applied to generate the bi-temporal changed building proposals. Next, in the bi-temporal changed building proposals, corner and edge information are integrated for feature detection through a phase congruency (PC) model, and the structural feature descriptor, called the histogram of orientated PC, is used to perform patch-based roof matching. We determined the final change in buildings by gathering matched roof and bi-temporal changed building proposals using co-refinement based on CRF, which were further classified as \u201cnewly built,\u201d \u201cdemolished\u201d, or \u201cchanged\u201d. Experiments were conducted with two typical datasets covering complex urban scenes with diverse building types. The results confirm the effectiveness and generality of the proposed algorithm, with more than 85% and 90% in overall accuracy and completeness, respectively.<\/jats:p>","DOI":"10.3390\/s19071557","type":"journal-article","created":{"date-parts":[[2019,4,2]],"date-time":"2019-04-02T03:21:26Z","timestamp":1554175286000},"page":"1557","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Patch Matching and Dense CRF-Based Co-Refinement for Building Change Detection from Bi-Temporal Aerial Images"],"prefix":"10.3390","volume":"19","author":[{"given":"Jinqi","family":"Gong","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiangyun","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"},{"name":"Collaborative Innovation Center of Geospatial Technology, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shiyan","family":"Pang","sequence":"additional","affiliation":[{"name":"School of Educational Information Technology, Central China Normal University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kun","family":"Li","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,3,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ak\u00e7ay, H.G., and Aksoy, S. (2010, January 25\u201330). Building Detection Using Directional Spatial Constraints. Proceedings of the 2010 IEEE International Geoscience and Remote Sensing Symposium, Honolulu, HI, USA.","DOI":"10.1109\/IGARSS.2010.5652842"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3430","DOI":"10.1109\/JSTARS.2016.2542074","article-title":"Building Change Detection Using High Resolution Remotely Sensed Data and GIS","volume":"9","author":"Sofina","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"7077","DOI":"10.1109\/TGRS.2016.2594952","article-title":"Coupled Dictionary Learning for Change Detection from Multisource Data","volume":"54","author":"Gong","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1109\/JPROC.2012.2197169","article-title":"A Novel Framework for the Design of Change Detection Systems for Very-high-resolution Remote Sensing Images","volume":"101","author":"Bruzzone","year":"2013","journal-title":"Proc. IEEE."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.isprsjprs.2009.10.002","article-title":"Automatic Change Detection of Buildings in Urban Environment from Very High Spatial Resolution Images Using Existing Geodatabase and Prior Knowledge","volume":"65","author":"Bouziani","year":"2010","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1080\/01431168908903939","article-title":"Digital Change Detection Techniques Using Remotely-Sensed Data","volume":"10","author":"Singh","year":"1989","journal-title":"Int. J. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1080\/02757259609532305","article-title":"Digitial Change Detection in Forest Ecosystems with Remote Sensing Imagery","volume":"13","author":"Coppin","year":"1996","journal-title":"Remote Sens. Reviews."},{"key":"ref_8","unstructured":"Lunetta, R.S., and Elvidge, C.D. (1998). Survey of Multispectral Methods for Land Cover Change Analysis. Remote Sensing Change Detection: Environmental Monitoring Methods and Applications, Ann Arbor Press."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1007\/978-94-007-7969-3_10","article-title":"Recent Advances in Remote Sensing Change Detection\u2014A Review","volume":"Volume 18","author":"Manakos","year":"2014","journal-title":"Land Use and Land Cover Mapping in Europe"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4434","DOI":"10.1080\/01431161.2011.648285","article-title":"Object-based Change Detection","volume":"33","author":"Chen","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.isprsjprs.2013.03.006","article-title":"Change Detection from Remotely Sensed Images: From Pixel-Based to Object-Based Approaches","volume":"80","author":"Hussain","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1080\/2150704X.2014.963732","article-title":"A Novel Buiding Change Index for Automatic Building Change Detection from High-resolution Remote Sensing Imagery","volume":"5","author":"Huang","year":"2014","journal-title":"Remote Sens. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1060","DOI":"10.1109\/LGRS.2012.2228626","article-title":"Fault-Tolerant Building Change Detection from Urban High-Resolution Remote Sensing Imagery","volume":"10","author":"Tang","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.isprsjprs.2013.09.014","article-title":"Geographic Object-based Image Analysis\u2014Towards A New Paradigm","volume":"87","author":"Blaschke","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1016\/j.rse.2010.12.017","article-title":"Per-Pixel vs. Object-Based Classification of Urban Land Cover Extraction Using High Spatial Resolution Imagery","volume":"115","author":"Myint","year":"2011","journal-title":"Remote Sens. Environ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"706","DOI":"10.1109\/LGRS.2013.2276936","article-title":"Template-based Hierarchical Building Extraction","volume":"11","author":"Sellaouti","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1587","DOI":"10.1109\/TGRS.2016.2627638","article-title":"Cosegmentation for Object-Based Building Change Detection from High-resolution Remotely Sensed Images","volume":"55","author":"Xiao","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1080\/01431160601075582","article-title":"Object-Based Change Detection Using Correlation Image Analysis and Image Segmentation","volume":"29","author":"IM","year":"2008","journal-title":"Int. J. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1613","DOI":"10.3390\/s8031613","article-title":"Object-Based Land Cover Classification and Change Analysis in the Baltimore Metropolitan Area Using Multitemporal High Resolution Remote Sensing Data","volume":"8","author":"Zhou","year":"2008","journal-title":"Sensors"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hou, B., Wang, Y., and Liu, Q. (2016). A Saliency Guided Semi-Supervised Building Change Detection Method for High Resolution Remote Sensing Images. Sensors, 16.","DOI":"10.3390\/s16091377"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/JSTARS.2013.2252423","article-title":"Buiding Change Detection from Multitemporal High-resolution Remotely Sensed Images Based on a Morphological Building Index","volume":"7","author":"Huang","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1109\/JSTARS.2011.2168195","article-title":"Morphological Building\/Shadow Index for Building Extraction from High-resolution Imagery over Urban Area","volume":"5","author":"Huang","year":"2012","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","first-page":"237","article-title":"Building Change Detection Based on the Enhanced Morphological Building Index","volume":"5","author":"Feng","year":"2017","journal-title":"Sci. Surv. Mapp."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liu, H.F., Yang, M.H., Chen, J., Hou, J.L., and Deng, M. (2018). Line-Constrained Shape Feature for Building Change Detection in VHR Remote Sensing Imagery. ISPRS Int. J. Geo-Inf., 7.","DOI":"10.3390\/ijgi7100410"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2352\/J.ImagingSci.Technol.2016.60.1.010402","article-title":"Multiple Object Extraction from Aerial Imagery with Convolutional Neural Networks","volume":"60","author":"Saito","year":"2016","journal-title":"J. Imaging Sci. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2658","DOI":"10.1109\/TGRS.2017.2650198","article-title":"Superpixel-based difference representation learning for change detection in multispectral remote sensing images","volume":"55","author":"Gong","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","unstructured":"Daudt, R.C., Saux, B.L., Boulch, A., and Gousseau, Y. (arXiv, 2018). High Resolution Semantic Change Detection, arXiv."},{"key":"ref_28","unstructured":"Daudt, R.C., Saux, B.L., and Boulch, A. (arXiv, 2018). Fully Convolutional Siamese Networks for Change Detection, arXiv."},{"key":"ref_29","first-page":"999","article-title":"Change Detection Method for High Resolution Remote Sensing Images Using Deep Learning","volume":"46","author":"Zhang","year":"2017","journal-title":"Acta Geodaetica et Cartographica Sinica."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhou, Z.H., and Feng, J. (arXiv, 2017). Deep Forest: Towards an Alternative to Deep Neural Networks, arXiv.","DOI":"10.24963\/ijcai.2017\/497"},{"key":"ref_31","first-page":"2800","article-title":"Measurement of Relief Displacement from Vertical Photograph","volume":"3","author":"Devi","year":"2014","journal-title":"Int. J. Sci. Eng. Technol Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2138","DOI":"10.1109\/TGRS.2005.848417","article-title":"A comprehensive study on urban true orthorectification","volume":"43","author":"Zhou","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1080\/01490419.2017.1304472","article-title":"Object-oriented island land cover change detection by iteratively reweighted multivariate statistical analysis","volume":"40","author":"Gong","year":"2017","journal-title":"Marine Geodesy"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","article-title":"SLIC Superpixels Compared to State-of-the-Art Superpixel Methods","volume":"34","author":"Achanta","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1109\/34.1000236","article-title":"Mean shift: A robust approach toward feature space analysis","volume":"24","author":"Comaniciu","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","first-page":"299","article-title":"The Watershed Transformation Applied to Image Segmentation","volume":"6","author":"Beucher","year":"1991","journal-title":"Scann. Microsc. Supp."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rse.2015.01.006","article-title":"A critical synthesis of remotely sensed optical image change detection techniques","volume":"160","author":"Tewkesbury","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","article-title":"Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns","volume":"24","author":"Ojala","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ma, W.Y., and Manjunath, B.S. (1996, January 18\u201320). Texture Features and Learning Similarity. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.1996.517107"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Canty, M.J., and Nielsen, A.A. (2007, January 1). Investigation of alternative iteration schemes for the IR-MAD algorithm. Proceedings of the International Society for Optical Engineering, Bellingham, WA, USA.","DOI":"10.1117\/12.736409"},{"key":"ref_41","unstructured":"Nielsen, A.A., and Canty, M.J. (2005, January 16\u201318). Multi- and hyperspectral remote sensing change detection with generalized difference images by the IR-MAD method. Proceedings of the International Workshop on Analysis of Multi-temporal Remote Sensing Images, Biloxi, MS, USA."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhang, M., Hu, X., Zhao, L., Lv, Y., Luo, M., and Pang, S. (2017). Learning dual multi-scale manifold ranking for semantic segmentation of high-resolution images. Remote Sens., 9.","DOI":"10.20944\/preprints201704.0061.v1"},{"key":"ref_43","unstructured":"Boykov, Y. (2001, January 7\u201314). Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images. Proceedings of the 8th IEEE International Conference on Computer Vision (ICCV), Vancouver, BC, Canada."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1109\/TPAMI.2004.60","article-title":"An experimental comparison of min-cut\/max-flow algorithms for energy minimization in vision","volume":"26","author":"Boykov","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Papadopoulos, D.P., Uijlings, J.R.R., Keller, F., and Ferrari, V. (2017, January 22\u201329). Extreme clicking for efficient object annotation. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.528"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1145\/1015706.1015720","article-title":"\u201cGrabCut\u201d: Interactive foreground extraction using iterated graph cuts","volume":"23","author":"Rother","year":"2004","journal-title":"ACM Siggraph."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/0167-8655(87)90013-4","article-title":"Feature Detection from Local Energy","volume":"6","author":"Morrone","year":"1987","journal-title":"Pattern Recogn. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2379","DOI":"10.1364\/JOSAA.4.002379","article-title":"Relations between the statistics of natural images and the response properties of cortical cells","volume":"4","author":"Field","year":"1987","journal-title":"J. Opt. Soc. Am. A."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1007\/s004260000024","article-title":"Phase Congruency: A Low-Level Image Invariant","volume":"64","author":"Kovesi","year":"2000","journal-title":"Psycholog. Res."},{"key":"ref_50","unstructured":"Horn, B.K.P. (1986). Robot Vision, MIT press."},{"key":"ref_51","unstructured":"Li, J., Hu, Q., and Ai, M. (arXiv, 2018). RIFT: Multi-modal Image Matching Based on Radiation-Invariant Feature Transform, arXiv."},{"key":"ref_52","unstructured":"Kovesi, P.D. (2003, January 10\u201312). Phase Congruency Detects Corners and Edges. Proceedings of the 7th International Conference on Digital Image Computing: Techniques and Applications, Sydney, Australia."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"2941","DOI":"10.1109\/TGRS.2017.2656380","article-title":"Robust registration of multimodal remote sensing images based on structural similarity","volume":"55","author":"Ye","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_54","unstructured":"Kr\u00e4henb\u00fchl, P., and Koltun, V. (arXiv, 2012). Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials, arXiv."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1111\/cgf.12758","article-title":"DenseCut: Densely Connected CRFs for Realtime GrabCut","volume":"34","author":"Cheng","year":"2015","journal-title":"Comput. Graphics Forum"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1128","DOI":"10.1016\/j.patrec.2009.10.016","article-title":"Performance measures for object detection evaluation","volume":"31","author":"Aksoy","year":"2010","journal-title":"Pattern Recogn. Lett."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1701","DOI":"10.1109\/TGRS.2012.2207123","article-title":"Automated Detection of Arbitrarily Shaped Buildings in Complex Environments from Monocular VHR Optical Satellite Imagery","volume":"51","author":"Ok","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/7\/1557\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:41:54Z","timestamp":1760186514000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/7\/1557"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,31]]},"references-count":57,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["s19071557"],"URL":"https:\/\/doi.org\/10.3390\/s19071557","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,31]]}}}