{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T16:23:50Z","timestamp":1773246230709,"version":"3.50.1"},"reference-count":57,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,11,17]],"date-time":"2018-11-17T00:00:00Z","timestamp":1542412800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001321","name":"National Research Foundation","doi-asserted-by":"publisher","award":["NRF-2016R1A2B4016301"],"award-info":[{"award-number":["NRF-2016R1A2B4016301"]}],"id":[{"id":"10.13039\/501100001321","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003565","name":"Ministry of Land, Infrastructure and Transport","doi-asserted-by":"publisher","award":["18SIUE-B148326-01"],"award-info":[{"award-number":["18SIUE-B148326-01"]}],"id":[{"id":"10.13039\/501100003565","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Hyperspectral change detection (CD) can be effectively performed using deep-learning networks. Although these approaches require qualified training samples, it is difficult to obtain ground-truth data in the real world. Preserving spatial information during training is difficult due to structural limitations. To solve such problems, our study proposed a novel CD method for hyperspectral images (HSIs), including sample generation and a deep-learning network, called the recurrent three-dimensional (3D) fully convolutional network (Re3FCN), which merged the advantages of a 3D fully convolutional network (FCN) and a convolutional long short-term memory (ConvLSTM). Principal component analysis (PCA) and the spectral correlation angle (SCA) were used to generate training samples with high probabilities of being changed or unchanged. The strategy assisted in training fewer samples of representative feature expression. The Re3FCN was mainly comprised of spectral\u2013spatial and temporal modules. Particularly, a spectral\u2013spatial module with a 3D convolutional layer extracts the spectral\u2013spatial features from the HSIs simultaneously, whilst a temporal module with ConvLSTM records and analyzes the multi-temporal HSI change information. The study first proposed a simple and effective method to generate samples for network training. This method can be applied effectively to cases with no training samples. Re3FCN can perform end-to-end detection for binary and multiple changes. Moreover, Re3FCN can receive multi-temporal HSIs directly as input without learning the characteristics of multiple changes. Finally, the network could extract joint spectral\u2013spatial\u2013temporal features and it preserved the spatial structure during the learning process through the fully convolutional structure. This study was the first to use a 3D FCN and a ConvLSTM for the remote-sensing CD. To demonstrate the effectiveness of the proposed CD method, we performed binary and multi-class CD experiments. Results revealed that the Re3FCN outperformed the other conventional methods, such as change vector analysis, iteratively reweighted multivariate alteration detection, PCA-SCA, FCN, and the combination of 2D convolutional layers-fully connected LSTM.<\/jats:p>","DOI":"10.3390\/rs10111827","type":"journal-article","created":{"date-parts":[[2018,11,21]],"date-time":"2018-11-21T11:23:27Z","timestamp":1542799407000},"page":"1827","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":164,"title":["Change Detection in Hyperspectral Images Using Recurrent 3D Fully Convolutional Networks"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9190-2848","authenticated-orcid":false,"given":"Ahram","family":"Song","sequence":"first","affiliation":[{"name":"Department of Civil and Environmental Engineering, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul 08826, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3967-6481","authenticated-orcid":false,"given":"Jaewan","family":"Choi","sequence":"additional","affiliation":[{"name":"School of Civil Engineering, Chungbuk National University, 1 Chungdae-ro, Seowon-gu, Cheongju, Chungbuk 28644, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6586-8503","authenticated-orcid":false,"given":"Youkyung","family":"Han","sequence":"additional","affiliation":[{"name":"School of Convergence and Fusion System Engineering, Kyungpook National University, Sangju 37224, Korea"}]},{"given":"Yongil","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul 08826, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2018,11,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ad\u00e3o, T., Hru\u0161ka, J., P\u00e1dua, L., Bessa, J., Peres, E., Morais, R., and Sousa, J.J. (2017). Hyperspectral imaging: A review on UAV-based sensors, data processing and applications for agriculture and forestry. Remote Sens., 9.","DOI":"10.3390\/rs9111110"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5408","DOI":"10.1109\/TGRS.2018.2815613","article-title":"Hyperspectral image classification with deep learning models","volume":"56","author":"Yang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1016\/j.neucom.2014.06.024","article-title":"Semi-supervised change detection method for multi-temporal hyperspectral images","volume":"148","author":"Yuan","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1080\/01431168908903939","article-title":"Review article digital change detection techniques using remotely-sensed data","volume":"10","author":"Singh","year":"1989","journal-title":"Int. J. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.compag.2010.06.009","article-title":"Early detection and classification of plant diseases with support vector machines based on hyperspectral reflectance","volume":"74","author":"Rumpf","year":"2010","journal-title":"Comput. Electron. Agric."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/s10661-007-9843-7","article-title":"Invasive species change detection using artificial neural networks and CASI hyperspectral imagery","volume":"140","author":"Pu","year":"2008","journal-title":"Environ. Monit. Assess."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"14118","DOI":"10.1109\/ACCESS.2018.2812999","article-title":"Modern trends in hyperspectral image analysis: A Review","volume":"6","author":"Khan","year":"2018","journal-title":"IEEE Access"},{"key":"ref_8","first-page":"54","article-title":"Change detection in hyper spectral images","volume":"6","author":"Khanday","year":"2016","journal-title":"Asian J. Technol. Manag. Res."},{"key":"ref_9","unstructured":"Liu, S. (2015). Advanced Techniques for Automatic Change Detection in Multitemporal Hyperspectral Images. [Ph.D. Thesis, University of Trento]."},{"key":"ref_10","first-page":"1","article-title":"GETNET: A general end-to-end 2-D CNN for hyperspectral image change detection","volume":"99","author":"Wang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1007\/s11704-015-4103-4","article-title":"Generating labeled samples for hyperspectral image classification using correlation of spectral bands","volume":"10","author":"Yu","year":"2016","journal-title":"Front. Comput. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.proenv.2011.12.037","article-title":"Change detection using change vector analysis from Landsat TM images in Wuhan","volume":"11","author":"Xiaolu","year":"2011","journal-title":"Procedia Environ. Sci."},{"key":"ref_13","unstructured":"Liu, S., Bruzzone, L., Bovolo, F., and Du, P. (2014, January 13\u201318). A novel sequential spectral change vector analysis for representing and detecting multiple changes in hyperspectral images. Proceedings of the 2014 IEEE International Geoscience and Remote Sensing Symposium, Quebec City, QC, Canada."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1311","DOI":"10.1007\/s12046-014-0286-x","article-title":"A comparative study on change vector analysis based change detection techniques","volume":"39","author":"Singh","year":"2014","journal-title":"Sadhana"},{"key":"ref_15","unstructured":"Hansanlou, M., and Seydi, S.T. (2018). Hyperspectral change detection: An experimental comparative study. Int. J. Remote Sens., 1\u201355."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ortiz-Rivera, V., V\u00e9lez-Reyes, M., and Roysam, B. (2006, January 8). Change detection in hyperspectral imagery using temporal principal components. Proceedings of the SPIE 2006 Algorithms and Technologies for Multispectral, Hyperspectral, Ultraspectral Imagery XII, Orlando, FL, USA.","DOI":"10.1117\/12.667961"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0034-4257(97)00162-4","article-title":"Multivariate alteration detection (MAD) and MAF postprocessing in multispectral, bitemporal image data: New approaches to change detection studies","volume":"64","author":"Nielsen","year":"1998","journal-title":"Remote Sens. Environ."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1109\/TIP.2006.888195","article-title":"The regularized iteratively reweighted MAD method for change detection in multi-and hyperspectral data","volume":"16","author":"Nielsen","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/0146-664X(80)90054-4","article-title":"Euclidean distance mapping","volume":"14","author":"Danielsson","year":"1980","journal-title":"Comput. Gr. Image Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0034-4257(93)90013-N","article-title":"The spectral image processing system (SIPS)\u2014Interactive visualization and analysis of imaging spectrometer data","volume":"44","author":"Kruse","year":"1993","journal-title":"Remote Sens. Environ."},{"key":"ref_21","unstructured":"De Carvalho, O.A., and Meneses, P.R. (2000, January 23\u201325). Spectral correlation mapper (SCM): An improvement on the spectral angle mapper (SAM). Proceedings of the 9th Airborne Earth Science Workshop, Pasadena, CA, US."},{"key":"ref_22","unstructured":"Chang, C.I. (July, January 28). Spectral information divergence for hyperspectral image analysis. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS 1999), Hamburg, Germany."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1109\/JSTARS.2013.2241396","article-title":"A subspace-based change detection method for hyperspectral images","volume":"6","author":"Wu","year":"2013","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1186\/s13634-016-0397-0","article-title":"Change detection of bitemporal multispectral images based on FCM and D-S theory","volume":"2016","author":"Shi","year":"2016","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Du, Q. (2012, January 4\u20137). A new method for change analysis of multi-temporal hyperspectral images. Proceedings of the Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), Shanghai, China.","DOI":"10.1109\/WHISPERS.2012.6874223"},{"key":"ref_26","first-page":"1","article-title":"An Unsupervised algorithm for change detection in hyperspectral remote sensing data using synthetically fused images and derivative spectral profiles","volume":"2017","author":"Han","year":"2017","journal-title":"J. Sens."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Gao, F., Liu, X., Dong, J., Zhong, G., and Jian, M. (2017). Change detection in SAR images based on deep Semi-NMF and SVD networks. Remote Sens., 9.","DOI":"10.3390\/rs9050435"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Fu, G., Liu, C., Zhou, R., Sun, T., and Zhang, Q. (2017). Classification for high resolution remote sensing imagery using a fully convolutional network. Remote Sens., 9.","DOI":"10.3390\/rs9050498"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1080\/014311697218700","article-title":"Introduction neural networks in remote sensing","volume":"18","author":"Atkinson","year":"1997","journal-title":"Int. J. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lyu, H., Lu, H., and Mou, L. (2016). Learning a transferable change rule from a recurrent neural network for land cover change detection. Remote Sens., 8.","DOI":"10.3390\/rs8060506"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Mou, L., Bruzzone, L., and Zhu, X.X. (arXiv, 2018). Learning spectral-spatial-temporal features via a recurrent convolutional neural network for change detection in multispectral imagery, arXiv.","DOI":"10.1109\/TGRS.2018.2863224"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep learning for remote sensing data: A technical tutorial on the state of the art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Liu, S., Du, Q., Tong, X., Samat, A., Pan, H., and Ma, X. (2017). Band selection-based dimensionality reduction for change detection in multi-temporal Hyperspectral Images. Remote Sens., 9.","DOI":"10.3390\/rs9101008"},{"key":"ref_34","first-page":"147","article-title":"A learning algorithm for Boltzmann machines","volume":"9","author":"Ackley","year":"1985","journal-title":"Cogn. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bengio, Y., Lamblin, P., Popovici, D., and Larochelle, H. (2006, January 4\u20137). Greedy layer-wise training of deep networks. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.","DOI":"10.7551\/mitpress\/7503.003.0024"},{"key":"ref_36","first-page":"802","article-title":"Convolutional LSTM network: A machine learning approach for precipitation nowcasting","volume":"1","author":"Xingjian","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MGRS.2017.2762307","article-title":"Deep learning in remote sensing: A comprehensive review and list of resources","volume":"5","author":"Zhu","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Valipour, S., Siam, M., Jafersand, M., and Ray, N. (2017, January 24\u201331). Recurrent fully convolutional networks for video segmentation. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.","DOI":"10.1109\/WACV.2017.11"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lu, N., Wu, Y., Feng, L., and Song, J. (2018). Deep Learning for Fall Detection: 3D-CNN Combined with LSTM on Video Kinematic Data. IEEE J. Biomed. Health Inform., 1\u201310.","DOI":"10.1109\/JBHI.2018.2808281"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhang, L., Zhu, G., Shen, P., and Song, J. (2017, January 22\u201329). Learning spatiotemporal features using 3dcnn and convolutional LSTM for gesture recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Venice, Italy.","DOI":"10.1109\/ICCVW.2017.369"},{"key":"ref_41","unstructured":"Robila, S.A. (2004, January 20\u201324). An analysis of spectral metrics for hyperspectral image processing. Proceedings of the 2004 IGARSS Geoscience and Remote Sensing Symposium, Anchorage, AK, USA."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"4823","DOI":"10.1080\/01431160801950162","article-title":"PCA-based land-use change detection and analysis using multitemporal and multisensor satellite data","volume":"29","author":"Deng","year":"2008","journal-title":"Int. J. Remote Sens."},{"key":"ref_43","first-page":"1649","article-title":"Application of principal components analysis to change detection","volume":"53","author":"Fung","year":"1987","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2473","DOI":"10.3390\/rs3112473","article-title":"A new approach to change vector analysis using distance and similarity measures","volume":"3","author":"Gillespie","year":"2011","journal-title":"Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Neville, R.A., Staenz, K., Szeredi, T., and Lefebvre, J. (1999, January 21\u201324). Automatic endmember extraction from hyperspectral data for mineral exploration. Proceedings of the 21st Canadian Symposium on remote Sensing, Ottawa, ON, Canada.","DOI":"10.4095\/219526"},{"key":"ref_46","unstructured":"Santurkar, S., Tsipras, D., Ilyas, A., and Madry, A. (arXiv, 2018). How does batch normalization help optimization? (no, it is not about internal covariate shift), arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2354","DOI":"10.1109\/TIP.2018.2799324","article-title":"Hyperspectral image classification with Markov random fields and a convolutional neural network","volume":"27","author":"Cao","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"5585","DOI":"10.1109\/TGRS.2017.2710079","article-title":"Deep fully convolutional network-based spatial distribution prediction for hyperspectral image classification","volume":"55","author":"Jiao","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, H., and Shen, Q. (2017). Spectral\u2013spatial classification of hyperspectral imagery with 3D convolutional neural network. Remote Sens., 9.","DOI":"10.3390\/rs9010067"},{"key":"ref_50","unstructured":"Chen, L.C., Kokkinos, I., Murphy, K., and Yuille, A.L. (2015, January 7\u20139). Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_51","unstructured":"Yu, F., and Koltun, V. (2016, January 2\u20134). Multi-scale context aggregation by dilated convolutions. Proceedings of the 2016 International Conference on Learning Representations, San Juan, Puerto Rico."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Rumelhart, D.E., and McClelland, J.L. (1986). Learning Internal Representations by Error Propagation. Parallel Distributed Processing\u2014Explorations in the Microstructure of Cognition, The MIT Press.","DOI":"10.7551\/mitpress\/5236.001.0001"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/5254.708428","article-title":"Support vector machines","volume":"13","author":"Hearst","year":"1998","journal-title":"IEEE Intell. Syst. Appl."},{"key":"ref_56","unstructured":"(2018, October 11). ArcGIS Webmap. Available online: https:\/\/www.arcgis.com\/home\/webmap\/viewer.html."},{"key":"ref_57","unstructured":"(2018, October 11). Earth Science Data Archives of U.S. Geological Survey (USGS), Available online: http:\/\/earthexplorer.usgs.gov\/."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/11\/1827\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:30:26Z","timestamp":1760196626000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/11\/1827"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,17]]},"references-count":57,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["rs10111827"],"URL":"https:\/\/doi.org\/10.3390\/rs10111827","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,17]]}}}