{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T16:52:51Z","timestamp":1767891171267,"version":"3.49.0"},"reference-count":51,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2024,10,28]],"date-time":"2024-10-28T00:00:00Z","timestamp":1730073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Science Foundation of Shaanxi Province","award":["2020JQ-298"],"award-info":[{"award-number":["2020JQ-298"]}]},{"name":"Natural Science Foundation of Shaanxi Province","award":["2023-JC-YB-501"],"award-info":[{"award-number":["2023-JC-YB-501"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>While many neural networks have been proposed for hyperspectral image classification, current backbones cannot achieve accurate results due to the insufficient representation by scalar features and always cause a cumbersome calculation burden. To solve the problem, we propose the capsule attention network (CAN), which combines an activity vector with an attention mechanism to improve HSI classification. In particular, we consider two attention mechanisms to improve the effectiveness of the activity vectors. First, an attention-based feature extraction (AFE) module is proposed to preprocess the spectral-spatial features of HSI data, which effectively mines useful information before the generation of the activity vectors. Second, we propose a self-weighted mechanism (SWM) to distinguish the importance of different capsule convolutions, which enhances the representation of the primary activity vectors. Experiments on four well-known HSI datasets have shown our CAN surpasses state-of-the-art (SOTA) methods on three widely used metrics with a much lower computational burden.<\/jats:p>","DOI":"10.3390\/rs16214001","type":"journal-article","created":{"date-parts":[[2024,10,28]],"date-time":"2024-10-28T07:47:18Z","timestamp":1730101638000},"page":"4001","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Capsule Attention Network for Hyperspectral Image Classification"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0154-5195","authenticated-orcid":false,"given":"Nian","family":"Wang","sequence":"first","affiliation":[{"name":"Xi\u2019an Research Institute of High-Tech, Xi\u2019an 710025, China"}]},{"given":"Aitao","family":"Yang","sequence":"additional","affiliation":[{"name":"Xi\u2019an Research Institute of High-Tech, Xi\u2019an 710025, China"}]},{"given":"Zhigao","family":"Cui","sequence":"additional","affiliation":[{"name":"Xi\u2019an Research Institute of High-Tech, Xi\u2019an 710025, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2040-2640","authenticated-orcid":false,"given":"Yao","family":"Ding","sequence":"additional","affiliation":[{"name":"Xi\u2019an Research Institute of High-Tech, Xi\u2019an 710025, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8753-4990","authenticated-orcid":false,"given":"Yuanliang","family":"Xue","sequence":"additional","affiliation":[{"name":"Xi\u2019an Research Institute of High-Tech, Xi\u2019an 710025, China"}]},{"given":"Yanzhao","family":"Su","sequence":"additional","affiliation":[{"name":"Xi\u2019an Research Institute of High-Tech, Xi\u2019an 710025, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhang, H., Liu, H., Yang, R., Wang, W., Luo, Q., and Tu, C. (2024). Hyperspectral Image Classification Based on Double-Branch Multi-Scale Dual-Attention Network. Remote Sens., 16.","DOI":"10.3390\/rs16122051"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Guo, Y., Han, S., Li, Y., Zhang, C., and Bai, Y. (2018). K-nearest neighbor combined with guided filter for hyperspectral image classification. Procedia Computer Science, Elsevier.","DOI":"10.1016\/j.procs.2018.03.066"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1109\/LGRS.2011.2145353","article-title":"A daptive Markov random field approach for classification of hyperspectral imagery","volume":"8","author":"Zhang","year":"2011","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1080\/10095020.2017.1399674","article-title":"Object-based classification of hyperspectral data using random forest algorithm","volume":"21","author":"Amini","year":"2018","journal-title":"Geo-Spat. Inf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TGRS.2004.831865","article-title":"Classification of hyperspectral remote sensing images with support vector machines","volume":"42","author":"Melgani","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1109\/LGRS.2013.2250905","article-title":"Hyperspectral image classification using Gaussian mixture models and Markov random fields","volume":"11","author":"Li","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Islam, M.R., Islam, M.T., Uddin, M.P., and Ulhaq, A. (2024). Improving Hyperspectral Image Classification with Compact Multi-Branch Deep Learning. Remote Sens., 16.","DOI":"10.3390\/rs16122069"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"258619","DOI":"10.1155\/2015\/258619","article-title":"Deep convolutional neural networks for hyperspectral image classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4420","DOI":"10.1109\/TGRS.2018.2818945","article-title":"3-D Deep Learning Approach for Remote Sensing Image Classification","volume":"56","author":"Benoit","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.1109\/TNNLS.2022.3182715","article-title":"Graph-in-Graph Convolutional Network for Hyperspectral Image Classification","volume":"35","author":"Jia","year":"2024","journal-title":"IEEE Trans. Neural Networks Learn. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1109\/TGRS.2020.2994057","article-title":"Residual spectral\u2013spatial attention network for hyperspectral image classification","volume":"59","author":"Zhu","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Li, R., Zheng, S., Duan, C., Yang, Y., and Wang, X. (2020). Classification of hyperspectral image based on double-branch dual-attention mechanism network. Remote Sens., 12.","DOI":"10.20944\/preprints201912.0059.v2"},{"key":"ref_13","first-page":"5536716","article-title":"Unsupervised self-correlated learning smoothy enhanced locality preserving graph convolution embedding clustering for hyperspectral images","volume":"60","author":"Ding","year":"2022","journal-title":"IEEE Geosci. Remote Sens."},{"key":"ref_14","first-page":"5507714","article-title":"Spectral partitioning residual network with spatial attention mechanism for hyperspectral image classification","volume":"60","author":"Zhang","year":"2021","journal-title":"IEEE Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3948","DOI":"10.1109\/JSTARS.2022.3171586","article-title":"Hybrid dense network with attention mechanism for hyperspectral image classification","volume":"15","author":"Ahmad","year":"2022","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1049\/cvi2.12167","article-title":"CDF-net: A convolutional neural network fusing frequency domain and spatial domain features","volume":"17","author":"Yang","year":"2023","journal-title":"IET Comput. Vision"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"5618815","DOI":"10.1109\/TGRS.2023.3305728","article-title":"SmallTrack: Wavelet pooling and graph enhanced classification for UAV small object tracking","volume":"61","author":"Xue","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","first-page":"5536016","article-title":"Self-Supervised Locality Preserving Low-Pass Graph Convolutional Embedding for Large-Scale Hyperspectral Image Clustering","volume":"60","author":"Ding","year":"2022","journal-title":"IEEE Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/JSTARS.2014.2329330","article-title":"Deep Learning-Based Classification of Hyperspectral Data","volume":"7","author":"Chen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"5384","DOI":"10.1109\/TGRS.2019.2899129","article-title":"Cascaded Recurrent Neural Networks for Hyperspectral Image Classification","volume":"57","author":"Hang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5966","DOI":"10.1109\/TGRS.2020.3015157","article-title":"Graph Convolutional Networks for Hyperspectral Image Classification","volume":"59","author":"Hong","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3162","DOI":"10.1109\/TGRS.2019.2949180","article-title":"Multiscale Dynamic Graph Convolutional Network for Hyperspectral Image Classification","volume":"58","author":"Wan","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wu, K., Zhan, Y., An, Y., and Li, S. (2024). Multiscale Feature Search-Based Graph Convolutional Network for Hyperspectral Image Classification. Remote Sens., 16.","DOI":"10.3390\/rs16132328"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5522214","DOI":"10.1109\/TGRS.2022.3221534","article-title":"Spectral\u2013Spatial Feature Tokenization Transformer for Hyperspectral Image Classification","volume":"60","author":"Sun","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5539014","DOI":"10.1109\/TGRS.2022.3207933","article-title":"Hyperspectral Image Classification Using Group-Aware Hierarchical Transformer","volume":"60","author":"Mei","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"5518615","DOI":"10.1109\/TGRS.2021.3130716","article-title":"SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers","volume":"60","author":"Hong","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","first-page":"5524216","article-title":"MambaHSI: Spatial-Spectral Mamba for Hyperspectral Image Classification","volume":"62","author":"Li","year":"2024","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","article-title":"SLIC superpixels compared to state-of-the-art superpixel methods","volume":"34","author":"Achanta","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","first-page":"5519316","article-title":"Superpixel-level global and local similarity graph-based clustering for large hyperspectral images","volume":"60","author":"Zhao","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wang, X., Zhu, M., Bo, D., Cui, P., Shi, C., and Pei, J. (2020, January 6\u201310). AM-GCN: Adaptive Multi-channel Graph Convolutional Networks. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Long Beach, CA, USA.","DOI":"10.1145\/3394486.3403177"},{"key":"ref_32","unstructured":"Li, G., Muller, M., Thabet, A., and Ghanem, B. (November, January 27). Deepgcns: Can gcns go as deep as cnns?. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_33","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2\u20137). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the NaacL-HLT, Minneapolis, MN, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R. (2020, January 14\u201319). Momentum contrast for unsupervised visual representation learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Xue, Y., Jin, G., Shen, T., Tan, L., Wang, N., Gao, J., and Wang, L. (2024). Consistent Representation Mining for Multi-Drone Single Object Tracking. IEEE Trans. Circuits Syst. Video Technol.","DOI":"10.1109\/TCSVT.2024.3411301"},{"key":"ref_36","first-page":"21271","article-title":"Bootstrap your own latent-a new approach to self-supervised learning","volume":"33","author":"Grill","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"8657","DOI":"10.1109\/TGRS.2020.3037361","article-title":"CNN-enhanced graph convolutional network with pixel-and superpixel-level feature fusion for hyperspectral image classification","volume":"59","author":"Liu","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1559","DOI":"10.1109\/TIP.2022.3144017","article-title":"Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification","volume":"31","author":"Dong","year":"2022","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","first-page":"5508614","article-title":"Attention multi-hop graph and multi-scale convolutional fusion network for hyperspectral image classification","volume":"61","author":"Zhou","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","first-page":"6600115","article-title":"GTFN: GCN and transformer fusion with spatial-spectral features for hyperspectral image classification","volume":"61","author":"Yang","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Han, Z., Yang, J., Gao, L., Zeng, Z., Zhang, B., and Chanussot, J. (2024). Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2024.3418583"},{"key":"ref_42","first-page":"3859","article-title":"Dynamic routing between capsules","volume":"30","author":"Sabour","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2145","DOI":"10.1109\/TGRS.2018.2871782","article-title":"Capsule networks for hyperspectral image classification","volume":"57","author":"Paoletti","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","first-page":"379","article-title":"A spectral\u2013spatial 3D-convolutional capsule network for hyperspectral image classification with limited training samples","volume":"15","author":"Kumar","year":"2023","journal-title":"Int. J. Inf. Technol."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"56815","DOI":"10.1109\/ACCESS.2024.3390558","article-title":"Attention based Deep Convolutional Capsule Network for Hyperspectral Image Classification","volume":"12","author":"Xiaoxia","year":"2024","journal-title":"IEEE Access"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2021.3135506","article-title":"Multiple Attention-Guided Capsule Networks for Hyperspectral Image Classification","volume":"60","author":"Paoletti","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_48","first-page":"103614","article-title":"Two-Stream spectral-spatial convolutional capsule network for Hyperspectral image classification","volume":"127","author":"Zhai","year":"2024","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-excitation networks. Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_51","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/21\/4001\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:22:08Z","timestamp":1760113328000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/21\/4001"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,28]]},"references-count":51,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["rs16214001"],"URL":"https:\/\/doi.org\/10.3390\/rs16214001","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,28]]}}}