{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T06:50:06Z","timestamp":1780987806941,"version":"3.54.1"},"reference-count":38,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,8,2]],"date-time":"2022-08-02T00:00:00Z","timestamp":1659398400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the National Natural Science Foundation of China","award":["NSFC-61671190"],"award-info":[{"award-number":["NSFC-61671190"]}]},{"name":"Reserved Leaders of Heilongjiang Provincial Leading Talent Echelon 2021","award":["NSFC-61671190"],"award-info":[{"award-number":["NSFC-61671190"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In recent years, methods based on deep convolutional neural networks (CNNs) have dominated the classification task of hyperspectral images. Although CNN-based HSI classification methods have the advantages of spatial feature extraction, HSI images are characterized by approximately continuous spectral information, usually containing hundreds of spectral bands. CNN cannot mine and represent the sequence properties of spectral features well, and the transformer model of attention mechanism proves its advantages in processing sequence data. This study proposes a new spectral spatial kernel combined with the improved Vision Transformer (ViT) to jointly extract spatial spectral features to complete classification task. First, the hyperspectral data are dimensionally reduced by PCA; then, the shallow features are extracted with an spectral spatial kernel, and the extracted features are input into the improved ViT model. The improved ViT introduces a re-attention mechanism and a local mechanism based on the original ViT. The re-attention mechanism can increase the diversity of attention maps at different levels. The local mechanism is introduced into ViT to make full use of the local and global information of the data to improve the classification accuracy. Finally, a multi-layer perceptron is used to obtain the classification result. Among them, the Focal Loss function is used to increase the loss weight of small-class samples and difficult-to-classify samples in HSI data samples and reduce the loss weight of easy-to-classify samples, so that the network can learn more useful hyperspectral image information. In addition, using the Apollo optimizer to train the HSI classification model to better update and compute network parameters that affect model training and model output, thereby minimizing the loss function. We evaluated the classification performance of the proposed method on four different datasets, and achieved good classification results on urban land object classification, crop classification and mineral classification, respectively. Compared with the state-of-the-art backbone network, the method achieves a significant improvement and achieves very good classification accuracy.<\/jats:p>","DOI":"10.3390\/rs14153705","type":"journal-article","created":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T00:15:26Z","timestamp":1659485726000},"page":"3705","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["A Hyperspectral Image Classification Method Based on Adaptive Spectral Spatial Kernel Combined with Improved Vision Transformer"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9118-230X","authenticated-orcid":false,"given":"Aili","family":"Wang","sequence":"first","affiliation":[{"name":"Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuang","family":"Xing","sequence":"additional","affiliation":[{"name":"Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Zhao","sequence":"additional","affiliation":[{"name":"Communication Construction Operation and Maintenance Center, State Grid Heilongjiang Electric Power Co., Ltd. Information and Communication Company, Harbin 150010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2453-3691","authenticated-orcid":false,"given":"Haibin","family":"Wu","sequence":"additional","affiliation":[{"name":"Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1016-1636","authenticated-orcid":false,"given":"Yuji","family":"Iwahori","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Chubu University, Aichi 487-8501, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.rse.2017.10.041","article-title":"Atmospheric correction for hyperspectral ocean color retrieval with application to the Hyperspectral Imager for the Coastal Ocean (HICO)","volume":"204","author":"Ibrahim","year":"2018","journal-title":"Remote Sens. Environ. Interdiscip. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1949","DOI":"10.1007\/s12524-019-01041-2","article-title":"Evaluation of deep learning CNN model for land use land cover classification and crop identification using hyperspectral remote sensing images","volume":"47","author":"Bhosle","year":"2019","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wang, B., Shao, Q., and Song, D. (2021). A Spectral-Spatial Features Integrated Network for Hyperspectral Detection of Marine Oil Spill. Remote Sens., 13.","DOI":"10.3390\/rs13081568"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Gao, A.F., Rasmussen, B., Kulits, P., Scheller, E.L., Greenberger, R., and Ehlmann, B.L. (2021, January 19\u201325). Generalized Unsupervised Clustering of Hyperspectral Images of Geological Targets in the Near Infrared. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Nashville, TN, USA.","DOI":"10.1109\/CVPRW53098.2021.00485"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"10419","DOI":"10.1007\/s11042-017-4403-9","article-title":"Spectral-spatial K-Nearest Neighbor approach for hyperspectral image classification","volume":"77","author":"Bo","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_6","first-page":"139","article-title":"Simultaneous feature selection and SVM parameter determination in classification of hyperspectral imagery using Ant Colony Optimization","volume":"38","author":"Samadzadegan","year":"2012","journal-title":"Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Li, M., Zhang, N., Pan, B., Xie, S., Wu, X., and Shi, Z. (2017, January 13\u201315). Hyperspectral Image Classification Based on Deep Forest and Spectral-Spatial Cooperative Feature and Deep Forest. Proceedings of the International Conference on Image and Graphics, Shanghai, China.","DOI":"10.1007\/978-3-319-71598-8_29"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kayabol, K. (September, January 31). Bayesian Gaussian mixture model for spatial-spectral classification of hyperspectral images. Proceedings of the 2015 23rd European Signal Processing Conference (EUSIPCO), Nice, France.","DOI":"10.1109\/EUSIPCO.2015.7362695"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wang, M., Gao, K., Wang, L., and Miu, X. (2012, January 17\u201319). A Novel Hyperspectral Classification Method Based on C5.0 Decision Tree of Multiple Combined Classifiers. Proceedings of the 2012 Fourth International Conference on Computational and Information Sciences, Chongqing, China.","DOI":"10.1109\/ICCIS.2012.33"},{"key":"ref_10","first-page":"436","article-title":"Classification of hyperspectral image with small-sized samples based on spatial-spectral feature enhancement","volume":"43","author":"Lu","year":"2022","journal-title":"J. Harbin Eng. Univ."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/JSTARS.2014.2329330","article-title":"Deep learning-based classification of hyperspectral data","volume":"7","author":"Chen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.neucom.2016.09.010","article-title":"Convolutional neural networks for hyperspectral image classification","volume":"219","author":"Yu","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep feature extraction and classification of hyperspectral images based on convolutional neural networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/LGRS.2019.2918719","article-title":"HybridSN: Exploring 3-D\u20132-D CNN Feature Hierarchy for Hyperspectral Image Classification","volume":"17","author":"Roy","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1109\/TGRS.2017.2755542","article-title":"Spectral\u2013Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework","volume":"56","author":"Zhong","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7831","DOI":"10.1109\/TGRS.2020.3043267","article-title":"Attention-Based Adaptive Spectral\u2013Spatial Kernel ResNet for Hyperspectral Image Classification","volume":"59","author":"Roy","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.1109\/LGRS.2020.2990971","article-title":"Multibranch Selective Kernel Networks for Hyperspectral Image Classification","volume":"18","author":"Paoletti","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, X., Chen, Y., and Lin, Z. (2021). Spatial-Spectral Transformer for Hyperspectral Image Classification. Remote Sens., 13.","DOI":"10.3390\/rs13030498"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3172371","article-title":"SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers","volume":"60","author":"Hong","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1109\/TGRS.2019.2934760","article-title":"HSI-BERT: Hyperspectral Image Classification Using the Bidirectional Encoder Representation from Transformers","volume":"58","author":"He","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","unstructured":"Han, K., Xiao, A., Wu, E., Guo, J., Xu, C., and Wang, Y. (2021). Transformer in Transformer. arXiv."},{"key":"ref_22","unstructured":"Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., and Jegou, H. (2020). Training data-efficient image transformers & distillation through attention. arXiv."},{"key":"ref_23","unstructured":"Li, Y., Zhang, K., Cao, J., Radu, T., and Luc, V.G. (2021). LocalViT: Bringing Locality to Vision Transformers. arXiv."},{"key":"ref_24","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., and Unterthiner, T. (2020). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_26","unstructured":"Jimmy, L.B., Jamie, R.K., and Geoffrey, E.H. (2016). Layer normalization. arXiv."},{"key":"ref_27","unstructured":"Zhou, D., Kang, B., Jin, X., Yang, L., Lian, X., Jiang, Z., Hou, Q., and Feng, J. (2021). DeepViT: Towards Deeper Vision Transformer. arXiv."},{"key":"ref_28","unstructured":"Ma, X. (2020). Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization. arXiv."},{"key":"ref_29","first-page":"1","article-title":"Lightweight Spectral\u2013Spatial Attention Network for Hyperspectral Image Classification","volume":"60","author":"Cui","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liang, Y., Zhao, Z., and Wang, H. (October, January 26). Unbalanced Geologic Body Classification of Hyperspectral Data Based on Squeeze and Excitation Networks at Tianshan Area. Proceedings of the IGARSS 2020-2020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA.","DOI":"10.1109\/IGARSS39084.2020.9323795"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1109\/JSTARS.2019.2892975","article-title":"A Parallel Gaussian-Bernoulli Restricted Boltzmann Machine for Mining Area Classification with Hyperspectral Imagery","volume":"12","author":"Tan","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"7232","DOI":"10.1109\/TGRS.2019.2912468","article-title":"Caps-TripleGAN: GAN-Assisted CapsNet for Hyperspectral Image Classification","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"112012","DOI":"10.1016\/j.rse.2020.112012","article-title":"WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets and classifier for precise crop identification based on deep convolutional neural network with CRF","volume":"250","author":"Zhong","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/MGRS.2018.2867592","article-title":"Mini-UAV-borne hyperspectral remote sensing: From observation and processing to applications","volume":"6","author":"Zhong","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1109\/TGRS.2004.842478","article-title":"Classification of hyperspectral data from urban areas based on extended morphological profiles","volume":"43","author":"Benediktsson","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2355","DOI":"10.1109\/LGRS.2017.2764915","article-title":"Hyperspectral Images Classification with Gabor Filtering and Convolutional Neural Network","volume":"14","author":"Chen","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1109\/TGRS.2018.2860125","article-title":"Deep pyramidal residual networks for spectral-spatial hyperspectral image classification","volume":"57","author":"Paoletti","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"5522214","DOI":"10.1109\/TGRS.2022.3221534","article-title":"Spectral-Spatial Feature Tokenization Transformer for Hyperspectral Image Classifiction","volume":"60","author":"Sun","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3705\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:01:30Z","timestamp":1760140890000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3705"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,2]]},"references-count":38,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["rs14153705"],"URL":"https:\/\/doi.org\/10.3390\/rs14153705","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,2]]}}}