{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T03:47:17Z","timestamp":1782186437439,"version":"3.54.5"},"reference-count":58,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T00:00:00Z","timestamp":1648598400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42171453"],"award-info":[{"award-number":["42171453"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Models based on capsule neural network (CapsNet), a novel deep learning method, have recently made great achievements in hyperspectral remote sensing image (HSI) classification due to their excellent ability to implicitly model the spatial relationship knowledge embedded in HSIs. However, the number of labeled samples is a common bottleneck in HSI classification, limiting the performance of these deep learning models. To alleviate the problem of limited labeled samples and further explore the potential of CapsNet in the HSI classification field, this study proposes a multiscale feature aggregation capsule neural network (MS-CapsNet) based on CapsNet via the implementation of two branches that simultaneously extract spectral, local spatial, and global spatial features to integrate multiscale features and improve model robustness. Furthermore, because deep features are generally more discriminative than shallow features, two kinds of capsule residual (CapsRES) blocks based on 3D convolutional capsule (3D-ConvCaps) layers and residual connections are proposed to increase the depth of the network and solve the limited labeled sample problem in HSI classification. Moreover, a squeeze-and-excitation (SE) block is introduced in the shallow layers of MS-CapsNet to enhance its feature extraction ability. In addition, a reasonable initialization strategy that transfers parameters from two well-designed, pretrained deep convolutional capsule networks is introduced to help the model find a good set of initializing weight parameters and further improve the HSI classification accuracy of MS-CapsNet. Experimental results on four widely used HSI datasets demonstrate that the proposed method can provide results comparable to those of state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/rs14071652","type":"journal-article","created":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T21:28:39Z","timestamp":1648675719000},"page":"1652","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Multiscale Feature Aggregation Capsule Neural Network for Hyperspectral Remote Sensing Image Classification"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2686-4208","authenticated-orcid":false,"given":"Runmin","family":"Lei","sequence":"first","affiliation":[{"name":"School of Civil Engineering, Hefei University of Technology, Hefei 230009, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunju","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Civil Engineering, Hefei University of Technology, Hefei 230009, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xueying","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Virtual Geographic Environment, Ministry of Education, Nanjing 210023, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0207-8800","authenticated-orcid":false,"given":"Jianwei","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Civil Engineering, Hefei University of Technology, Hefei 230009, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0528-8328","authenticated-orcid":false,"given":"Zhenxuan","family":"Li","sequence":"additional","affiliation":[{"name":"School of Civil Engineering, Hefei University of Technology, Hefei 230009, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wencong","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Civil Engineering, Hefei University of Technology, Hefei 230009, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Cui","sequence":"additional","affiliation":[{"name":"School of Civil Engineering, Hefei University of Technology, Hefei 230009, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3140","DOI":"10.1109\/JSTARS.2015.2406339","article-title":"Generation of Spectral\u2013Temporal Response Surfaces by Combining Multispectral Satellite and Hyperspectral UAV Imagery for Precision Agriculture Applications","volume":"8","author":"Gevaert","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1007\/s12665-011-1112-y","article-title":"Application of hyperspectral remote sensing for environment monitoring in mining areas","volume":"65","author":"Zhang","year":"2012","journal-title":"Environ. Earth Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1808","DOI":"10.1109\/JSTARS.2015.2489838","article-title":"Developing a Spectral-Based Strategy for Urban Object Detection from Airborne Hyperspectral TIR and Visible Data","volume":"9","author":"Eslami","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Naoto, Y., Jonathan, C., and Karl, S. (2016). Potential of Resolution-Enhanced Hyperspectral Data for Mineral Mapping Using Simulated EnMAP and Sentinel-2 Images. Remote Sens., 8.","DOI":"10.3390\/rs8030172"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3778","DOI":"10.1109\/TGRS.2019.2957135","article-title":"Ensemble Learning for Hyperspectral Image Classification Using Tangent Collaborative Representation","volume":"58","author":"Su","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1109\/TGRS.2004.842481","article-title":"Investigation of the random forest framework for classification of hyperspectral data","volume":"43","author":"Ham","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TGRS.2004.831865","article-title":"Classification of hyperspectral remote sensing images with support vector machines","volume":"42","author":"Melgani","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Qian, Y., and Li, C. (2017, January 11\u201313). Improved KNN text classification algorithm with MapReduce implementation. Proceedings of the 2017 4th International Conference on Systems and Informatics (ICSAI), Hangzhou, China.","DOI":"10.1109\/ICSAI.2017.8248509"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"5039","DOI":"10.1109\/TGRS.2011.2157166","article-title":"Three-Dimensional Gabor Wavelets for Pixel-Based Hyperspectral Imagery Classification","volume":"49","author":"Shen","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2467","DOI":"10.1109\/TGRS.2017.2781805","article-title":"Multifeature dictionary learning for collaborative representation classification of hyperspectral imagery","volume":"56","author":"Su","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1230","DOI":"10.1109\/TGRS.2018.2866190","article-title":"Kernel collaborative representation with local correlation features for hyperspectral image classification","volume":"57","author":"Su","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1109\/TGRS.2010.2059707","article-title":"Band-Subset-Based Clustering and Fusion for Hyperspectral Imagery Classification","volume":"49","author":"Zhao","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3804","DOI":"10.1109\/TGRS.2008.922034","article-title":"Spectral and Spatial Classification of Hyperspectral Data Using SVMs and Morphological Profiles","volume":"46","author":"Fauvel","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6547","DOI":"10.1109\/TGRS.2017.2729882","article-title":"Multiple Kernel Learning for Hyperspectral Image Classification: A Review","volume":"55","author":"Gu","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TIT.1968.1054102","article-title":"On the mean accuracy of statistical pattern recognizers","volume":"14","author":"Hughes","year":"1968","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/JSTARS.2014.2329330","article-title":"Deep Learning-Based Classification of Hyperspectral Data","volume":"7","author":"Chen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2381","DOI":"10.1109\/JSTARS.2015.2388577","article-title":"Spectral\u2013Spatial Classification of Hyperspectral Data Based on Deep Belief Network","volume":"8","author":"Chen","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3639","DOI":"10.1109\/TGRS.2016.2636241","article-title":"Deep Recurrent Neural Networks for Hyperspectral Image Classification","volume":"55","author":"Mou","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3173","DOI":"10.1109\/TGRS.2018.2794326","article-title":"Hyperspectral Image Classification with Deep Feature Fusion Network","volume":"56","author":"Song","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"7048","DOI":"10.1109\/TGRS.2019.2910603","article-title":"Automatic Design of Convolutional Neural Network for Hyperspectral Image Classification","volume":"57","author":"Chen","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1080\/2150704X.2017.1331053","article-title":"A semi-supervised convolutional neural network for hyperspectral image classification","volume":"8","author":"Liu","year":"2017","journal-title":"Remote Sens. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"844","DOI":"10.1109\/TGRS.2016.2616355","article-title":"Hyperspectral Image Classification Using Deep Pixel-Pair Features","volume":"55","author":"Li","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5293","DOI":"10.1109\/TGRS.2017.2705073","article-title":"BASS Net: Band-Adaptive Spectral-Spatial Feature Learning Neural Network for Hyperspectral Image Classification","volume":"55","author":"Santara","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1975","DOI":"10.1109\/JSTARS.2017.2655516","article-title":"R-VCANet: A New Deep-Learning-Based Hyperspectral Image Classification Method","volume":"10","author":"Pan","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, H., and Shen, Q. (2017). Spectral\u2013Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network. Remote Sens., 9.","DOI":"10.3390\/rs9010067"},{"key":"ref_27","unstructured":"Srivastava, R.K., Greff, K., and Schmidhuber, J. (2015). Training Very Deep Networks. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1109\/TGRS.2018.2860125","article-title":"Deep pyramidal residual networks for spectral-spatial hyperspectral image classification","volume":"57","author":"Paoletti","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1109\/TGRS.2017.2755542","article-title":"Spectral\u2013Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework","volume":"56","author":"Zhong","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","first-page":"016519","article-title":"3D densely connected convolutional network for hyperspectral remote sensing image classification","volume":"13","author":"Zhang","year":"2019","journal-title":"Appl. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Paoletti, M.E., Haut, J.M., Plaza, J., and Plaza, A. (2018). Deep&Dense Convolutional Neural Network for Hyperspectral Image Classification. Remote Sens., 10.","DOI":"10.3390\/rs10091454"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"5314","DOI":"10.1109\/JSTARS.2020.3020733","article-title":"Deep Feature Aggregation Network for Hyperspectral Remote Sensing Image Classification","volume":"13","author":"Zhang","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2615","DOI":"10.1109\/TGRS.2019.2952758","article-title":"Deep Feature Fusion via Two-Stream Convolutional Neural Network for Hyperspectral Image Classification","volume":"58","author":"Li","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Liu, Y., Gao, L., Xiao, C., Qu, Y., Zheng, K., and Marinoni, A. (2020). Hyperspectral Image Classification Based on a Shuffled Group Convolutional Neural Network with Transfer Learning. Remote Sens., 12.","DOI":"10.3390\/rs12111780"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Liang, H., and Li, Q. (2016). Hyperspectral Imagery Classification Using Sparse Representations of Convolutional Neural Network Features. Remote Sens., 8.","DOI":"10.3390\/rs8020099"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3599","DOI":"10.1109\/TGRS.2018.2886022","article-title":"A CNN With Multiscale Convolution and Diversified Metric for Hyperspectral Image Classification","volume":"57","author":"Gong","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4311","DOI":"10.1109\/JSTARS.2020.3011992","article-title":"3-D Channel and Spatial Attention Based Multiscale Spatial\u2013Spectral Residual Network for Hyperspectral Image Classification","volume":"13","author":"Lu","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2355","DOI":"10.1109\/LGRS.2017.2764915","article-title":"Hyperspectral images classification with Gabor filtering and convolutional neural network","volume":"14","author":"Chen","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"5046","DOI":"10.1109\/TGRS.2018.2805286","article-title":"Generative Adversarial Networks for Hyperspectral Image Classification","volume":"56","author":"Zhu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"3318","DOI":"10.1109\/TCYB.2019.2915094","article-title":"Generative Adversarial Networks and Conditional Random Fields for Hyperspectral Image Classification","volume":"50","author":"Zhong","year":"2020","journal-title":"IEEE Trans. Cybern."},{"key":"ref_41","unstructured":"Sabour, S., Frosst, N., and Hinton, G. (2014). Dynamic routing between capsules. arXiv."},{"key":"ref_42","unstructured":"Ma, Y., Zheng, Z., Guo, Z., Mou, F., Zhou, F., Kong, R., and Hou, A. (August, January 28). Classification Based on Capsule Network with Hyperspectral Image. Proceedings of the International Geoscience and Remote Sensing Symposium, Yokohama, Japan."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Deng, F., Pu, S., Chen, X., Shi, Y., Yuan, T., and Pu, S. (2018). Hyperspectral Image Classification with Capsule Network Using Limited Training Samples. Sensors, 18.","DOI":"10.3390\/s18093153"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Wang, W., Li, H., Pan, L., Yang, G., and Du, Q. (2018, January 22\u201327). Hyperspectral Image Classification Based on Capsule Network. Proceedings of the International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8518951"},{"key":"ref_45","first-page":"7352","article-title":"Spectral\u2013spatial classification of hyperspectral remote sensing image based on capsule network","volume":"2019","author":"Jia","year":"2019","journal-title":"J. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2145","DOI":"10.1109\/TGRS.2018.2871782","article-title":"Capsule Networks for Hyperspectral Image Classification","volume":"57","author":"Paoletti","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1109\/LGRS.2020.2991405","article-title":"Spectral\u2013Spatial Hyperspectral Image Classification Using Dual-Channel Capsule Networks","volume":"18","author":"Jiang","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1095","DOI":"10.1109\/LGRS.2019.2891076","article-title":"Hyperspectral Image Classification Using CapsNet With Well-Initialized Shallow Layers","volume":"16","author":"Yin","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1080\/2150704X.2020.1864052","article-title":"A non-local capsule neural network for hyperspectral remote sensing image classification","volume":"12","author":"Lei","year":"2020","journal-title":"Remote Sens. Lett."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1109\/JSTARS.2020.2968930","article-title":"Robust Capsule Network Based on Maximum Correntropy Criterion for Hyperspectral Image Classification","volume":"13","author":"Li","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1109\/LGRS.2020.2976482","article-title":"Generative Adversarial Capsule Network with ConvLSTM for Hyperspectral Image Classification","volume":"18","author":"Wang","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_52","unstructured":"Zhang, H., Meng, L., Wei, X., Tang, X., Tang, X., Wang, X., Jin, B., and Yao, W. (2019). 1D-Convolutional Capsule Network for Hyperspectral Image Classification. arXiv."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Zhu, K., Chen, Y., Ghamisi, P., Jia, X., and Benediktsson, J.A. (2019). Deep Convolutional Capsule Network for Hyperspectral Image Spectral and Spectral-Spatial Classification. Remote Sens., 11.","DOI":"10.3390\/rs11030223"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"8297","DOI":"10.1109\/JSTARS.2021.3101511","article-title":"Hyperspectral Remote Sensing Image Classification Using Deep Convolutional Capsule Network","volume":"14","author":"Lei","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep residual learning for image recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_57","unstructured":"Misra, D. (2019). Mish: A Self Regularized Non-Monotonic Neural Activation Function. arXiv."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"112012","DOI":"10.1016\/j.rse.2020.112012","article-title":"WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets and classifier for precise crop identification based on deep convolutional neural network with CRF","volume":"250","author":"Zhong","year":"2020","journal-title":"Remote Sens. Environ."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/7\/1652\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:46:25Z","timestamp":1760136385000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/7\/1652"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,30]]},"references-count":58,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,4]]}},"alternative-id":["rs14071652"],"URL":"https:\/\/doi.org\/10.3390\/rs14071652","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,30]]}}}