{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T23:26:58Z","timestamp":1773703618723,"version":"3.50.1"},"reference-count":58,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T00:00:00Z","timestamp":1623801600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Henan Province Science and Technology Breakthrough Project","award":["212102210105"],"award-info":[{"award-number":["212102210105"]}]},{"name":"Henan Province Science and Technology Breakthrough Project","award":["212102210102"],"award-info":[{"award-number":["212102210102"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Recently, deep learning methods based on the combination of spatial and spectral features have been successfully applied in hyperspectral image (HSI) classification. To improve the utilization of the spatial and spectral information from the HSI, this paper proposes a unified network framework using a three-dimensional convolutional neural network (3-D CNN) and a band grouping-based bidirectional long short-term memory (Bi-LSTM) network for HSI classification. In the framework, extracting spectral features is regarded as a procedure of processing sequence data, and the Bi-LSTM network acts as the spectral feature extractor of the unified network to fully exploit the close relationships between spectral bands. The 3-D CNN has a unique advantage in processing the 3-D data; therefore, it is used as the spatial-spectral feature extractor in this unified network. Finally, in order to optimize the parameters of both feature extractors simultaneously, the Bi-LSTM and 3-D CNN share a loss function to form a unified network. To evaluate the performance of the proposed framework, three datasets were tested for HSI classification. The results demonstrate that the performance of the proposed method is better than the current state-of-the-art HSI classification methods.<\/jats:p>","DOI":"10.3390\/rs13122353","type":"journal-article","created":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T21:58:32Z","timestamp":1623880712000},"page":"2353","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":39,"title":["Spatial-Spectral Network for Hyperspectral Image Classification: A 3-D CNN and Bi-LSTM Framework"],"prefix":"10.3390","volume":"13","author":[{"given":"Junru","family":"Yin","sequence":"first","affiliation":[{"name":"College of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou 450000, China"}]},{"given":"Changsheng","family":"Qi","sequence":"additional","affiliation":[{"name":"College of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou 450000, China"}]},{"given":"Qiqiang","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou 450000, China"}]},{"given":"Jiantao","family":"Qu","sequence":"additional","affiliation":[{"name":"College of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou 450000, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,16]]},"reference":[{"key":"ref_1","unstructured":"Chang, C.I. (2003). Hyperspectral Imaging: Techniques for Spectral Detection and Classification, Springer."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"6547","DOI":"10.1109\/TGRS.2017.2729882","article-title":"Multiple Kernel Learning for Hyperspectral Image Classification: A Review","volume":"55","author":"Gu","year":"2017","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6690","DOI":"10.1109\/TGRS.2019.2907932","article-title":"Deep Learning for Hyperspectral Image Classification: An Overview","volume":"57","author":"Li","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sun, L., Wu, F., He, C., Zhan, T., Liu, W., and Zhang, D. (2020). Weighted Collaborative Sparse and L1\/2 Low-Rank Regularizations with Superpixel Segmentation for Hyperspectral Unmixing. IEEE Geosci. Remote Sens. Lett., 1\u20135.","DOI":"10.1109\/LGRS.2020.3019427"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/79.974715","article-title":"Signal processing for hyperspectral image exploitation","volume":"19","author":"Shaw","year":"2002","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1109\/79.974718","article-title":"Hyperspectral image data analysis","volume":"19","author":"Landgrebe","year":"2002","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2516","DOI":"10.1109\/TGRS.2005.852082","article-title":"Multisensor approach to determine changes of wetland characteristics in semiarid envi-ronments (Central Spain)","volume":"43","author":"Schmid","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1837","DOI":"10.1080\/01431160902926681","article-title":"A review on hyperspectral remote sensing for homogeneous and heterogeneous forest bio-diversity assessment","volume":"31","author":"Ghiyamat","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2665","DOI":"10.1016\/j.rse.2007.12.011","article-title":"Ash decline assessment in emerald ash borer-infested regions: A test of tree-level, hyperspectral technologies","volume":"112","author":"Pontius","year":"2008","journal-title":"Remote Sens. Environ."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2215","DOI":"10.1080\/01431169608948770","article-title":"Review Article Hyperspectral geological remote sensing: Evaluation of analytical techniques","volume":"17","author":"Cloutis","year":"1996","journal-title":"Int. J. Remote Sens."},{"key":"ref_11","first-page":"805","article-title":"Hyperspectral Mineral Target Detection Based on Density Peak","volume":"25","author":"Hou","year":"2019","journal-title":"Intell. Autom. Soft Comput."},{"key":"ref_12","first-page":"585","article-title":"Hyperspectral Data Segmentation and Classification in Precision Agriculture: A Multi-Scale Analysis","volume":"2","author":"Lanthier","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1300\/J064v22n03_03","article-title":"Relationship Between Hyperspectral Reflectance, Soil Nitrate-Nitrogen, Cotton Leaf Chlorophyll, and Cotton Yield: A Step Toward Precision Agriculture","volume":"22","author":"Boggs","year":"2003","journal-title":"J. Sustain. Agric."},{"key":"ref_14","first-page":"1","article-title":"Military applications of hyperspectral imagery","volume":"Volume 6239","author":"Briottet","year":"2006","journal-title":"Defense and Security Symposium"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"108060","DOI":"10.1016\/j.sigpro.2021.108060","article-title":"TSLRLN: Tensor subspace low-rank learning with non-local prior for hyperspectral image mixed denoising","volume":"184","author":"He","year":"2021","journal-title":"Signal Process."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sun, L., He, C., Zheng, Y., and Tang, S. (2020). SLRL4D: Joint restoration of subspace low-rank learning and non-local 4-D transform filtering for hyperspectral image. Remote Sens., 12.","DOI":"10.3390\/rs12182979"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1109\/TGRS.2011.2162649","article-title":"Spectral\u2013Spatial Hyperspectral Image Segmentation Using Subspace Multinomial Logistic Regression and Markov Random Fields","volume":"50","author":"Li","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TGRS.2004.831865","article-title":"Classification of hyperspectral remote sensing images with support vector machines","volume":"42","author":"Melgani","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4550","DOI":"10.1109\/JSTARS.2020.3014492","article-title":"Local binary patterns and superpixel-based multiple kernels for hy-perspectral image classification","volume":"13","author":"Huang","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4494","DOI":"10.1109\/TNNLS.2017.2749428","article-title":"L1-Norm Distance Minimization-Based Fast Robust Twin Support Vector kk -Plane Clustering","volume":"29","author":"Ye","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kramer, O. (2013). Dimensionality Reduction with Unsupervised Nearest Neighbors, Springer.","DOI":"10.1007\/978-3-642-38652-7"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1109\/TGRS.2011.2162589","article-title":"An Adaptive Artificial Immune Network for Supervised Classification of Multi-\/Hyperspectral Remote Sensing Imagery","volume":"50","author":"Zhong","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","unstructured":"Fu, L., Li, Z., Ye, Q., Yin, H., Liu, Q., Chen, X., Fan, X., Yang, W., and Yang, G. (2020). Learning Robust Discriminant Subspace Based on Joint L2, p- and L2, s-Norm Distance Metrics. IEEE Trans. Neural Netw. Learn. Syst., 1\u201315."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3818","DOI":"10.1109\/TNNLS.2019.2944869","article-title":"Nonpeaked Discriminant Analysis for Data Representation","volume":"30","author":"Ye","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1109\/TCSVT.2016.2596158","article-title":"L1-Norm Distance Linear Discriminant Analysis Based on an Effective Iterative Algorithm","volume":"28","author":"Ye","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.rse.2014.01.026","article-title":"A novel maximum likelihood based method for mapping depth and water quality from hyperspectral remote-sensing data","volume":"147","author":"Jay","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/MGRS.2018.2854840","article-title":"New Frontiers in Spectral-Spatial Hyperspectral Image Classification: The Latest Advances Based on Mathematical Morphology, Markov Random Fields, Segmentation, Sparse Representation, and Deep Learning","volume":"6","author":"Ghamisi","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1579","DOI":"10.1109\/TGRS.2017.2765364","article-title":"Recent Advances on Spectral\u2013Spatial Hyperspectral Image Classification: An Overview and New Guidelines","volume":"56","author":"He","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"7416","DOI":"10.1109\/TGRS.2016.2603190","article-title":"Probabilistic Fusion of Pixel-Level and Superpixel-Level Hyperspectral Image Classification","volume":"54","author":"Li","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4398","DOI":"10.1109\/TGRS.2017.2691906","article-title":"From Subpixel to Superpixel: A Novel Fusion Framework for Hyperspectral Image Classification","volume":"55","author":"Lu","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.31209\/2018.100000041","article-title":"Adaptive Image Enhancement using Hybrid Particle Swarm Optimization and Watershed Segmentation","volume":"25","author":"Mohanapriya","year":"2018","journal-title":"Intell. Autom. Soft Comput."},{"key":"ref_32","first-page":"1","article-title":"Compressive Hyperspectral Image Reconstruction Based on Spatial-Spectral Residual Dense Network","volume":"17","author":"Huang","year":"2019","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_33","first-page":"329","article-title":"Modified PSO Algorithm on Recurrent Fuzzy Neural Network for System Identification","volume":"25","author":"Mao","year":"2019","journal-title":"Intell. Autom. Soft Comput."},{"key":"ref_34","first-page":"601","article-title":"Deep Feature Fusion Model for Sentence Semantic Matching","volume":"61","author":"Zhang","year":"2019","journal-title":"Comput. Mater. Contin."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1109\/36.298007","article-title":"Hyperspectral image classification and dimensionality reduction: An orthogonal subspace projection approach","volume":"32","author":"Harsanyi","year":"1994","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","first-page":"575","article-title":"A Review on Deep Learning Approaches to Image Classification and Object Segmentation","volume":"60","author":"Wu","year":"2019","journal-title":"Comput. Mater. Contin."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"6844","DOI":"10.1109\/TGRS.2014.2303895","article-title":"A Discriminative Metric Learning Based Anomaly Detection Method","volume":"52","author":"Du","year":"2014","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Huang, W., Li, G., Chen, Q., Ju, M., and Qu, J. (2021). CF2PN: A Cross-Scale Feature Fusion Pyramid Network Based Remote Sensing Target Detection. Remote Sens., 13.","DOI":"10.3390\/rs13050847"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/79.974724","article-title":"Detection algorithms for hyperspectral imaging applications","volume":"19","author":"Manolakis","year":"2002","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_41","unstructured":"Bordes, A., Glorot, X., Weston, J., and Bengio, Y. (2012, January 21\u201323). Joint Learning of Words and Meaning Representations for Open-Text Semantic Parsing. Proceedings of the Artificial Intelligence and Statistics, La Palma, Spain."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2381","DOI":"10.1109\/JSTARS.2015.2388577","article-title":"Spectral\u2013Spatial Classification of Hyperspectral Data Based on Deep Belief Network","volume":"8","author":"Chen","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1007\/s00429-013-0687-3","article-title":"Latent feature representation with stacked auto-encoder for AD\/MCI diagnosis","volume":"220","author":"Suk","year":"2015","journal-title":"Brain Struct. Funct."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"3639","DOI":"10.1109\/TGRS.2016.2636241","article-title":"Deep Recurrent Neural Networks for Hyperspectral Image Classification","volume":"55","author":"Mou","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Seydgar, M., Alizadeh Naeini, A., Zhang, M., Li, W., and Satari, M. (2019). 3-D convolution-recurrent networks for spectral-spatial clas-sification of hyperspectral images. Remote Sens., 11.","DOI":"10.3390\/rs11070883"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"4781","DOI":"10.1109\/TGRS.2018.2837142","article-title":"Hyperspectral Image Classification Based on Deep Deconvolution Network with Skip Architecture","volume":"56","author":"Ma","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"4133","DOI":"10.1109\/JSTARS.2020.3008949","article-title":"A novel cubic convolutional neural network for hyperspectral image classi-fication","volume":"13","author":"Wang","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1109\/TGRS.2017.2755542","article-title":"Spectral\u2013Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework","volume":"56","author":"Zhong","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Wang, G., and Ren, P. (2020). Hyperspectral Image Classification with Feature-Oriented Adversarial Active Learning. Remote Sens., 12.","DOI":"10.3390\/rs12233879"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Li, J. (2015, January 2\u20135). Active learning for hyperspectral image classification with a stacked autoencoders based neural network. Proceedings of the 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), Tokyo, Japan.","DOI":"10.1109\/WHISPERS.2015.8075429"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Guofeng, T., Yong, L., Lihao, C., and Chen, J. (2017, January 18\u201320). A DBN for hyperspectral remote sensing image classification. Proceedings of the 2017 12th IEEE Conference on Industrial Electronics and Applications (ICIEA), Siem Reap, Cambodia. Institute of Electrical and Electronics Engineers (IEEE).","DOI":"10.1109\/ICIEA.2017.8283123"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2015\/258619","article-title":"Deep Convolutional Neural Networks for Hyperspectral Image Classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sens."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"3368","DOI":"10.1080\/2150704X.2015.1062157","article-title":"On combining multiscale deep learning features for the classification of hy-perspectral remote sensing imagery","volume":"36","author":"Zhao","year":"2015","journal-title":"Int. J. Remote Sens."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Liu, Q., Zhou, F., Hang, R., and Yuan, X. (2017). Bidirectional-Convolutional LSTM Based Spectral-Spatial Feature Learning for Hyperspectral Image Classification. Remote Sens., 9.","DOI":"10.3390\/rs9121330"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.isprsjprs.2019.09.006","article-title":"Deep learning classifiers for hyperspectral imaging: A review","volume":"158","author":"Paoletti","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_57","first-page":"1","article-title":"Spectral-Spatial Unified Networks for Hyperspectral Image Classification","volume":"56","author":"Xu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/LGRS.2019.2918719","article-title":"HybridSN: Exploring 3-D\u20132-D CNN Feature Hierarchy for Hyperspectral Image Classification","volume":"17","author":"Roy","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/12\/2353\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:17:00Z","timestamp":1760163420000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/12\/2353"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,16]]},"references-count":58,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["rs13122353"],"URL":"https:\/\/doi.org\/10.3390\/rs13122353","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,16]]}}}