{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T14:34:37Z","timestamp":1784644477687,"version":"3.55.0"},"reference-count":49,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,6,9]],"date-time":"2021-06-09T00:00:00Z","timestamp":1623196800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Major Special Projects of China","award":["GFZX04014308"],"award-info":[{"award-number":["GFZX04014308"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61775176"],"award-info":[{"award-number":["61775176"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shaanxi Province Key Research and Development Program of China","award":["2020GY-131"],"award-info":[{"award-number":["2020GY-131"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["xjh012020021"],"award-info":[{"award-number":["xjh012020021"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007219","name":"Natural Science Foundation of Shanghai","doi-asserted-by":"publisher","award":["8ZR1437200"],"award-info":[{"award-number":["8ZR1437200"]}],"id":[{"id":"10.13039\/100007219","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Hyperspectral images are widely used for classification due to its rich spectral information along with spatial information. To process the high dimensionality and high nonlinearity of hyperspectral images, deep learning methods based on convolutional neural network (CNN) are widely used in hyperspectral classification applications. However, most CNN structures are stacked vertically in addition to using a onefold size of convolutional kernels or pooling layers, which cannot fully mine the multiscale information on the hyperspectral images. When such networks meet the practical challenge of a limited labeled hyperspectral image dataset\u2014i.e., \u201csmall sample problem\u201d\u2014the classification accuracy and generalization ability would be limited. In this paper, to tackle the small sample problem, we apply the semantic segmentation function to the pixel-level hyperspectral classification due to their comparability. A lightweight, multiscale squeeze-and-excitation pyramid pooling network (MSPN) is proposed. It consists of a multiscale 3D CNN module, a squeezing and excitation module, and a pyramid pooling module with 2D CNN. Such a hybrid 2D-3D-CNN MSPN framework can learn and fuse deeper hierarchical spatial\u2013spectral features with fewer training samples. The proposed MSPN was tested on three publicly available hyperspectral classification datasets: Indian Pine, Salinas, and Pavia University. Using 5%, 0.5%, and 0.5% training samples of the three datasets, the classification accuracies of the MSPN were 96.09%, 97%, and 96.56%, respectively. In addition, we also selected the latest dataset with higher spatial resolution, named WHU-Hi-LongKou, as the challenge object. Using only 0.1% of the training samples, we could achieve a 97.31% classification accuracy, which is far superior to the state-of-the-art hyperspectral classification methods.<\/jats:p>","DOI":"10.3390\/rs13122268","type":"journal-article","created":{"date-parts":[[2021,6,9]],"date-time":"2021-06-09T22:18:29Z","timestamp":1623277109000},"page":"2268","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":62,"title":["Multiscale Information Fusion for Hyperspectral Image Classification Based on Hybrid 2D-3D CNN"],"prefix":"10.3390","volume":"13","author":[{"given":"Hang","family":"Gong","sequence":"first","affiliation":[{"name":"School of Physics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiuxia","family":"Li","sequence":"additional","affiliation":[{"name":"School of Physics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4364-6867","authenticated-orcid":false,"given":"Chunlai","family":"Li","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haishan","family":"Dai","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Satellite Engineering, Shanghai Academy of Spaceflight Technology, Shanghai 201109, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiping","family":"He","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenjing","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Physics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haoyang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Physics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feng","family":"Han","sequence":"additional","affiliation":[{"name":"School of Physics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abudusalamu","family":"Tuniyazi","sequence":"additional","affiliation":[{"name":"School of Physics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7927-7760","authenticated-orcid":false,"given":"Tingkui","family":"Mu","sequence":"additional","affiliation":[{"name":"School of Physics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1109\/LGRS.2005.844658","article-title":"Band selection based on feature weighting for classification of hyperspectral data","volume":"2","author":"Huang","year":"2005","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_2","first-page":"4955","article-title":"Hyperspectral Remote Sensing Image Subpixel Target Detection Based on Supervised Metric Learning","volume":"52","author":"Hang","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1109\/TGRS.2012.2198826","article-title":"Crop yield estimation based on unsupervised linear unmixing of multidate hyperspectral imagery","volume":"51","author":"Luo","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1381","DOI":"10.1109\/TGRS.2016.2623742","article-title":"Discriminative Low-Rank Gabor Filtering for Spectral-Spatial Hyperspectral Image Classification","volume":"55","author":"He","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_6","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"9775","DOI":"10.4249\/scholarpedia.9775","article-title":"Local Binary Patterns","volume":"5","year":"2010","journal-title":"Scholarpedia"},{"key":"ref_8","first-page":"4085","article-title":"Semisupervised hyperspec- tral image segmentation using multinomial logistic regression with active learning","volume":"48","author":"Li","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3947","DOI":"10.1109\/TGRS.2011.2128330","article-title":"Hyperspectral image segmen- tation using a new Bayesian approach with active learning","volume":"49","author":"Li","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11220-015-0126-z","article-title":"Spectral\u2013Spatial Hyperspectral Image Classification Based on KNN","volume":"17","author":"Huang","year":"2016","journal-title":"Sens. Imaging Int. J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TGRS.2004.831865","article-title":"Classification of hyperspectral remote sensing images with support vector machines","volume":"42","author":"Melgani","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Arvelyna, Y., Shuichi, M., Atsushi, M., Nguno, A., Mhopjeni, K., Muyongo, A., Sibeso, M., and Muvangua, E. (2011, January 24\u201329). Hyperspectral mapping for rock and alteration mineral with Spectral Angle Mapping and Neural Network classification method: Study case in Warmbad district, south of Namibia. Proceedings of the 2011 IEEE International Geoscience and Remote Sensing Symposium, Vancouver, BC, Canada.","DOI":"10.1109\/IGARSS.2011.6049458"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1109\/LGRS.2011.2172185","article-title":"Linear versus nonlinear PCA for the classification of hyperspectral data based on the extended morphological profiles","volume":"9","author":"Licciardi","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4865","DOI":"10.1109\/TGRS.2011.2153861","article-title":"Hyper- spectral image classification with independent component discrimi- nant analysis","volume":"49","author":"Villa","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"862","DOI":"10.1109\/TGRS.2008.2005729","article-title":"Classification of hyperspectral images with regularized linear discriminant analysis","volume":"47","author":"Bandos","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1109\/JPROC.2012.2197589","article-title":"Advances in spectral-spatial classification of hyperspectral images","volume":"101","author":"Fauvel","year":"2013","journal-title":"Proc. IEEE"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1118","DOI":"10.1109\/TGRS.2014.2334608","article-title":"Gabor feature-based collaborative repre- sentation for hyperspectral imagery classification","volume":"53","author":"Jia","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3838","DOI":"10.1109\/TGRS.2018.2813366","article-title":"Hyperspectral image classification with imbalanced data based on orthogonal complement subspace projection","volume":"56","author":"Li","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going Deeper with Convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_21","unstructured":"Bordes, A., Glorot, X., Weston, J., and Bengio, Y. (2012, January 12\u201315). Joint learning of words and meaning representations for open-text semantic parsing. Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics, La Palma, Canary Islands."},{"key":"ref_22","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2012","journal-title":"Commun. ACM"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"6690","DOI":"10.1109\/TGRS.2019.2907932","article-title":"Deep Learning for Hyperspectral Image Classification: An Overview","volume":"57","author":"Li","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/JSTARS.2014.2329330","article-title":"Deep Learning-Based Classification of Hyperspectral Data","volume":"7","author":"Chen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2381","DOI":"10.1109\/JSTARS.2015.2388577","article-title":"Spectral-spatial classification of hyper- spectral data based on deep belief network","volume":"8","author":"Chen","year":"2015","journal-title":"IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2015\/258619","article-title":"Deep Convolutional Neural Networks for Hyperspectral Image Classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sensors"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Makantasis, K., Karantzalos, K., Doulamis, A., and Doulamis, N. (2015, January 26\u201331). Deep supervised learning for hyperspectral data classification through con volutional neural networks. Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium, Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7326945"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1109\/LGRS.2018.2830403","article-title":"Deformable Convolutional Neural Networks for Hyperspectral Image Classification","volume":"15","author":"Zhu","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1968","DOI":"10.1109\/LGRS.2019.2960528","article-title":"DSSNet: A Simple Dilated Semantic Segmentation Network for Hyperspectral Imagery Classification","volume":"17","author":"Pan","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2615","DOI":"10.1109\/TGRS.2019.2952758","article-title":"Deep Feature Fusion via Two-Stream Convolutional Neural Network for Hyperspectral Image Classification","volume":"58","author":"Li","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3173","DOI":"10.1109\/TGRS.2018.2794326","article-title":"Hyperspectral Image Classification with Deep Feature Fusion Network","volume":"56","author":"Song","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1109\/TGRS.2017.2755542","article-title":"Spectral\u2013Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework","volume":"56","author":"Zhong","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"He, M., Li, B., and Chen, H. (2017, January 17\u201320). Multi-scale 3D deep convolutional neural network for hyperspectral image classification. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8297014"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1016\/j.patrec.2020.08.020","article-title":"Fused 3-D spectral-spatial deep neural networks and spectral clustering for hyperspectral image classification","volume":"138","author":"Sellami","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1109\/TGRS.2018.2860125","article-title":"Deep Pyramidal Residual Networks for Spectral-Spatial Hyperspectral Image Classification","volume":"57","author":"Paoletti","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","first-page":"277","article-title":"HybridSN: Exploring 3-D-2-D CNN Feature Hierarchy for Hyperspectral Image Classification","volume":"17","author":"Swalpa","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Feng, F., Wang, S., Wang, C., and Zhang, J. (2019). Learning Deep Hierarchical Spatial\u2013Spectral Features for Hyperspectral Image Classification Based on Residual 3D-2D CNN. Sensors, 19.","DOI":"10.3390\/s19235276"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"5776","DOI":"10.1109\/JSTARS.2020.3024841","article-title":"Hyperspectral Image Classification Method Based on 2D\u20133D CNN and Multibranch Feature Fusion","volume":"13","author":"Ge","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2011","DOI":"10.1109\/TPAMI.2019.2913372","article-title":"Squeeze-and-Excitation Networks","volume":"42","author":"Hu","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid Scene Parsing Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2911","DOI":"10.1109\/JSTARS.2018.2836671","article-title":"Deep multiscale spectral-spatial feature fusion for hyperspectral images classification","volume":"11","author":"Liang","year":"2018","journal-title":"IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1109\/TGRS.2018.2860464","article-title":"Feature Extraction with Multiscale Covariance Maps for Hyperspectral Image Classification","volume":"57","author":"He","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"3599","DOI":"10.1109\/TGRS.2018.2886022","article-title":"A CNN with Multiscale Convolution and Diversified Metric for Hyperspectral Image Classification","volume":"57","author":"Gong","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1109\/LGRS.2018.2882551","article-title":"Squeeze and Excitation Rank Faster R-CNN for Ship Detection in SAR Images","volume":"16","author":"Lin","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"5277","DOI":"10.1109\/TGRS.2019.2961681","article-title":"Lightweight Spectral\u2013Spatial Squeeze-and- Excitation Residual Bag-of-Features Learning for Hyperspectral Classification","volume":"58","author":"Roy","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1109\/LGRS.2018.2868880","article-title":"Objects Segmentation From High-Resolution Aerial Images Using U-Net With Pyramid Pooling Layers","volume":"16","author":"Kim","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"39401","DOI":"10.1109\/ACCESS.2018.2856088","article-title":"An End-to-End Neural Network for Road Extraction from Remote Sensing Imagery by Multiple Feature Pyramid Network","volume":"6","author":"Gao","year":"2018","journal-title":"IEEE Access"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"112012","DOI":"10.1016\/j.rse.2020.112012","article-title":"WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets and classifier for precise crop identification based on deep convolutional neural network with CRF","volume":"250","author":"Zhong","year":"2020","journal-title":"Remote Sens. Environ."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/12\/2268\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:12:42Z","timestamp":1760163162000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/12\/2268"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,9]]},"references-count":49,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["rs13122268"],"URL":"https:\/\/doi.org\/10.3390\/rs13122268","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,9]]}}}