{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T07:11:31Z","timestamp":1765609891509,"version":"build-2065373602"},"reference-count":57,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2019,1,19]],"date-time":"2019-01-19T00:00:00Z","timestamp":1547856000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000104","name":"National Aeronautics and Space Administration","doi-asserted-by":"publisher","award":["NNX17AK14G"],"award-info":[{"award-number":["NNX17AK14G"]}],"id":[{"id":"10.13039\/100000104","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Classification is a common objective when analyzing hyperspectral images, where each pixel is assigned to a predefined label. Deep learning-based algorithms have been introduced in the remote-sensing community successfully in the past decade and have achieved significant performance improvements compared with conventional models. However, research on the extraction of sequential features utilizing a single image, instead of multi-temporal images still needs to be further investigated. In this paper, a novel strategy for constructing sequential features from a single image in long short-term memory (LSTM) is proposed. Two pixel-wise-based similarity measurements, including pixel-matching (PM) and block-matching (BM), are employed for the selection of sequence candidates from the whole image. Then, the sequential structure of a given pixel can be constructed as the input of LSTM by utilizing the first several matching pixels with high similarities. The resulting PM-based LSTM and BM-based LSTM are appealing, as all pixels in the whole image are taken into consideration when calculating the similarity. In addition, BM-based LSTM also utilizes local spectral-spatial information that has already shown its effectiveness in hyperspectral image classification. Two common distance measures, Euclidean distance and spectral angle mapping, are also investigated in this paper. Experiments with two benchmark hyperspectral images demonstrate that the proposed methods achieve marked improvements in classification performance relative to the other state-of-the-art methods considered. For instance, the highest overall accuracy achieved on the Pavia University image is 96.20% (using both BM-based LSTM and spectral angle mapping), which is an improvement compared with 84.45% overall accuracy generated by 1D convolutional neural networks.<\/jats:p>","DOI":"10.3390\/rs11020194","type":"journal-article","created":{"date-parts":[[2019,1,22]],"date-time":"2019-01-22T03:08:22Z","timestamp":1548126502000},"page":"194","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":48,"title":["Hyperspectral Image Classification Using Similarity Measurements-Based Deep Recurrent Neural Networks"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1520-7381","authenticated-orcid":false,"given":"Andong","family":"Ma","sequence":"first","affiliation":[{"name":"Department of Geography, College of Geosciences, Texas A&amp;M University, College Station, TX 77843, USA"},{"name":"Center for Geospatial Sciences, Applications and Technology, Texas A&amp;M University, College Station, TX 77843, USA"}]},{"given":"Anthony M.","family":"Filippi","sequence":"additional","affiliation":[{"name":"Department of Geography, College of Geosciences, Texas A&amp;M University, College Station, TX 77843, USA"},{"name":"Center for Geospatial Sciences, Applications and Technology, Texas A&amp;M University, College Station, TX 77843, USA"}]},{"given":"Zhangyang","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Texas A&amp;M University, College Station, TX 77843, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7199-5517","authenticated-orcid":false,"given":"Zhengcong","family":"Yin","sequence":"additional","affiliation":[{"name":"Department of Geography, College of Geosciences, Texas A&amp;M University, College Station, TX 77843, USA"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.rse.2003.12.013","article-title":"Hyperspectral vegetation indices and novel algorithms for predicting green LAI of crop canopies: Modeling and validation in the context of precision agriculture","volume":"90","author":"Haboudane","year":"2004","journal-title":"Remote Sens. Environ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/MSP.2013.2279179","article-title":"Advances in hyperspectral image classification: Earth monitoring with statistical learning methods","volume":"31","author":"Tuia","year":"2014","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MGRS.2013.2244672","article-title":"Hyperspectral remote sensing data analysis and future challenges","volume":"1","author":"Plaza","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1109\/TGRS.2007.907973","article-title":"Hyperspectral change detection in the presenceof diurnal and seasonal variations","volume":"46","author":"Eismann","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","first-page":"1","article-title":"GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection","volume":"57","author":"Wang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1109\/JSTARS.2010.2095495","article-title":"High performance computing for hyperspectral remote sensing","volume":"4","author":"Plaza","year":"2011","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_7","first-page":"4099","article-title":"Local manifold learning-based k-nearest-neighbor for hyperspectral image classification","volume":"48","author":"Ma","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1109\/LGRS.2005.846437","article-title":"Fast k-NN classification using the cluster-space approach","volume":"2","author":"Jia","year":"2005","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_9","first-page":"1","article-title":"Optimal Clustering Framework for Hyperspectral Band Selection","volume":"56","author":"Wang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TGRS.2004.831865","article-title":"Classification of hyperspectral remote sensing images with support vector machines","volume":"42","author":"Melgani","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","unstructured":"Gualtieri, J., and Chettri, S. (2000, January 24\u201328). Support vector machines for classification of hyperspectral data. Proceedings of the IEEE 2000 International Geoscience and Remote Sensing Symposium (IGARSS 2000), Honolulu, HI, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"736","DOI":"10.1109\/LGRS.2010.2047711","article-title":"SVM and MRF-based method for accurate classification of hyperspectral images","volume":"7","author":"Tarabalka","year":"2010","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3973","DOI":"10.1109\/TGRS.2011.2129595","article-title":"Hyperspectral image classification using dictionary-based sparse representation","volume":"49","author":"Chen","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1109\/TGRS.2012.2201730","article-title":"Hyperspectral image classification via kernel sparse representation","volume":"51","author":"Chen","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2056","DOI":"10.1109\/JSTARS.2013.2264720","article-title":"A nonlocal weighted joint sparse representation classification method for hyperspectral imagery","volume":"7","author":"Zhang","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_16","unstructured":"Wang, Q., He, X., and Li, X. (2018). Locality and Structure Regularized Low Rank Representation for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens., 1\u201313."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2883","DOI":"10.1080\/01431169308904316","article-title":"Conjugate-gradient neural networks in classification of multisource and very-high-dimensional remote sensing data","volume":"14","author":"Benediktsson","year":"1993","journal-title":"Int. J. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1080\/014311699213622","article-title":"A back-propagation neural network for mineralogical mapping from AVIRIS data","volume":"20","author":"Yang","year":"1999","journal-title":"Int. J. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1109\/LGRS.2008.916070","article-title":"Semisupervised image classification with Laplacian support vector machines","volume":"5","author":"Calpe","year":"2008","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3363","DOI":"10.1109\/TGRS.2006.877950","article-title":"A novel transductive SVM for semisupervised classification of remote-sensing images","volume":"44","author":"Bruzzone","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2832","DOI":"10.1109\/TGRS.2014.2365676","article-title":"Local-manifold-learning-based graph construction for semisupervised hyperspectral image classification","volume":"53","author":"Ma","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.patrec.2016.01.022","article-title":"Graph-based semi-supervised learning for spectral-spatial hyperspectral image classification","volume":"83","author":"Ma","year":"2016","journal-title":"Pattern Recognit. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1109\/TGRS.2014.2335177","article-title":"Semisupervised hyperspectral classification using task-driven dictionary learning with Laplacian regularization","volume":"53","author":"Wang","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"4192","DOI":"10.1016\/j.patcog.2012.04.033","article-title":"Higher rank support tensor machines for visual recognition","volume":"45","author":"Kotsia","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1080\/01621459.2013.776499","article-title":"Tensor regression with applications in neuroimaging data analysis","volume":"108","author":"Zhou","year":"2013","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"6884","DOI":"10.1109\/TGRS.2018.2845450","article-title":"Tensor-based classification models for hyperspectral data analysis","volume":"56","author":"Makantasis","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1109\/TGRS.2004.842478","article-title":"Classification of hyperspectral data from urban areas based on extended morphological profiles","volume":"43","author":"Benediktsson","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1109\/TGRS.2011.2162339","article-title":"On combining multiple features for hyperspectral remote sensing image classification","volume":"50","author":"Zhang","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1201","DOI":"10.1109\/TGRS.2005.843786","article-title":"Using multiband correlation models for the invariant recognition of 3-D hyperspectral textures","volume":"43","author":"Shi","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep learning for remote sensing data: A technical tutorial on the state of the art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_31","unstructured":"Wang, Q., Liu, S., Chanussot, J., and Li, X. (2018). Scene classification with recurrent attention of VHR remote sensing images. IEEE Trans. Geosci. Remote Sens., 1\u201313."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/JSTARS.2014.2329330","article-title":"Deep learning-based classification of hyperspectral data","volume":"7","author":"Chen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2381","DOI":"10.1109\/JSTARS.2015.2388577","article-title":"Spectral\u2013spatial classification of hyperspectral data based on deep belief network","volume":"8","author":"Chen","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2015\/258619","article-title":"Deep convolutional neural networks for hyperspectral image classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sens."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Makantasis, K., Karantzalos, K., Doulamis, A., and Doulamis, N. (2015, January 26\u201331). Deep supervised learning for hyperspectral data classification through convolutional neural networks. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7326945"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, H., and Shen, Q. (2017). Spectral\u2013spatial classification of hyperspectral imagery with 3D convolutional neural network. Remote Sens., 9.","DOI":"10.3390\/rs9010067"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1207\/s15516709cog1402_1","article-title":"Finding structure in time","volume":"14","author":"Elman","year":"1990","journal-title":"Cogn. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mikolov, T., Karafi\u00e1t, M., Burget, L., \u010cernock\u1ef3, J., and Khudanpur, S. (2010, January 26\u201330). Recurrent neural network based language model. Proceedings of the Eleventh Annual Conference of the International Speech Communication Association, Chiba, Japan.","DOI":"10.21437\/Interspeech.2010-343"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Graves, A., Mohamed, A.R., and Hinton, G. (2013, January 26\u201331). Speech recognition with deep recurrent neural networks. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6638947"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1685","DOI":"10.1109\/LGRS.2017.2728698","article-title":"Land cover classification via multitemporal spatial data by deep recurrent neural networks","volume":"14","author":"Ienco","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.neunet.2018.05.019","article-title":"Land cover classification from multi-temporal, multi-spectral remotely sensed imagery using patch-based recurrent neural networks","volume":"105","author":"Sharma","year":"2018","journal-title":"Neural Netw."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"3639","DOI":"10.1109\/TGRS.2016.2636241","article-title":"Deep recurrent neural networks for hyperspectral image classification","volume":"55","author":"Mou","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wu, H., and Prasad, S. (2017). Convolutional recurrent neural networks for hyperspectral data classification. Remote Sens., 9.","DOI":"10.3390\/rs9030298"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.neucom.2018.03.012","article-title":"Multi-scale hierarchical recurrent neural networks for hyperspectral image classification","volume":"294","author":"Shi","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Romera-Paredes, B., and Torr, P.H.S. (2016, January 8\u201316). Recurrent instance segmentation. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46466-4_19"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"7023","DOI":"10.1109\/TGRS.2014.2306692","article-title":"A hybrid object-oriented conditional random field classification framework for high spatial resolution remote sensing imagery","volume":"52","author":"Zhong","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","unstructured":"Yin, W., Kann, K., Yu, M., and Sch\u00fctze, H. (arXiv, 2017). Comparative study of cnn and rnn for natural language processing, arXiv."},{"key":"ref_50","first-page":"290","article-title":"Enhancing endmember selection in multiple endmember spectral mixture analysis (MESMA) for urban impervious surface area mapping using spectral angle and spectral distance parameters","volume":"33","author":"Fan","year":"2014","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1126\/science.290.5500.2323","article-title":"Nonlinear dimensionality reduction by locally linear embedding","volume":"290","author":"Roweis","year":"2000","journal-title":"Science"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1162\/089976603321780317","article-title":"Laplacian eigenmaps for dimensionality reduction and data representation","volume":"15","author":"Belkin","year":"2003","journal-title":"Neural Comput."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"3939","DOI":"10.1080\/01431160110115960","article-title":"Spectral unmixing of vegetation, soil and dry carbon cover in arid regions: Comparing multispectral and hyperspectral observations","volume":"23","author":"Asner","year":"2002","journal-title":"Int. J. Remote Sens."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"234","DOI":"10.2307\/143141","article-title":"A computer movie simulating urban growth in the Detroit region","volume":"46","author":"Tobler","year":"1970","journal-title":"Econ. Geogr."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"7008","DOI":"10.1109\/TGRS.2014.2306687","article-title":"A novel spatial\u2013spectral similarity measure for dimensionality reduction and classification of hyperspectral imagery","volume":"52","author":"Pu","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"850","DOI":"10.1109\/34.232073","article-title":"Comparing images using the Hausdorff distance","volume":"15","author":"Huttenlocher","year":"1993","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/0034-4257(91)90048-B","article-title":"A review of assessing the accuracy of classifications of remotely sensed data","volume":"37","author":"Congalton","year":"1991","journal-title":"Remote Sens. Environ."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/2\/194\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:27:24Z","timestamp":1760185644000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/2\/194"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,19]]},"references-count":57,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,1]]}},"alternative-id":["rs11020194"],"URL":"https:\/\/doi.org\/10.3390\/rs11020194","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2019,1,19]]}}}