{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T00:10:36Z","timestamp":1772064636403,"version":"3.50.1"},"reference-count":53,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,2,6]],"date-time":"2020-02-06T00:00:00Z","timestamp":1580947200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Major Special Project of the China High-Resolution Earth Observation system","award":["41416040203"],"award-info":[{"award-number":["41416040203"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The convolutional neural network (CNN) has been gradually applied to the hyperspectral images (HSIs) classification, but the lack of training samples caused by the difficulty of HSIs sample marking and ignoring of correlation between spatial and spectral information seriously restrict the HSIs classification accuracy. In an attempt to solve these problems, this paper proposes a dual-branch extraction and classification method under limited samples of hyperspectral images based on deep learning (DBECM). At first, a sample augmentation method based on local and global constraints in this model is designed to augment the limited training samples and balance the number of different class samples. Then spatial-spectral features are simultaneously extracted by the dual-branch spatial-spectral feature extraction method, which improves the utilization of HSIs data information. Finally, the extracted spatial-spectral feature fusion and classification are integrated into a unified network. The experimental results of two typical datasets show that the DBECM proposed in this paper has certain competitive advantages in classification accuracy compared with other public HSIs classification methods, especially in the Indian pines dataset. The parameters of the overall accuracy (OA), average accuracy (AA), and Kappa of the method proposed in this paper are at least 4.7%, 5.7%, and 5% higher than the existing methods.<\/jats:p>","DOI":"10.3390\/rs12030536","type":"journal-article","created":{"date-parts":[[2020,2,7]],"date-time":"2020-02-07T03:13:27Z","timestamp":1581045207000},"page":"536","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A Dual-Branch Extraction and Classification Method Under Limited Samples of Hyperspectral Images Based on Deep Learning"],"prefix":"10.3390","volume":"12","author":[{"given":"Bingqing","family":"Niu","sequence":"first","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology, Beijing 100083, China"},{"name":"Beijing Engineering Research Center of Industrial Spectrum Imaging, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinhui","family":"Lan","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology, Beijing 100083, China"},{"name":"Beijing Engineering Research Center of Industrial Spectrum Imaging, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4870-7406","authenticated-orcid":false,"given":"Yang","family":"Shao","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology, Beijing 100083, China"},{"name":"Beijing Engineering Research Center of Industrial Spectrum Imaging, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8401-5888","authenticated-orcid":false,"given":"Hui","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology, Beijing 100083, China"},{"name":"Beijing Engineering Research Center of Industrial Spectrum Imaging, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/S0034-4257(98)00064-9","article-title":"Imaging spectroscopy and the Airborne Visible\/Infrared Imaging Spectrometer (AVIRIS)","volume":"65","author":"Green","year":"1998","journal-title":"Remote Sens. Environ."},{"key":"ref_2","unstructured":"Pearlman, J., Carman, S., Segal, C., Jarecke, P., Clancy, P., and Browne, W. (2001, January 9\u201313). Overview of the Hyperion Imaging Spectrometer for the NASA EO-1 mission. Proceedings of the IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217), Sydney, Australia."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1109\/TGRS.2003.815018","article-title":"Hyperion, a space-based imaging spectrometer","volume":"41","author":"Pearlman","year":"2003","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2335","DOI":"10.1109\/TGRS.2014.2358934","article-title":"A Survey on Spectral\u2013Spatial Classification Techniques Based on Attribute Profiles","volume":"53","author":"Ghamisi","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1109\/JSTARS.2015.2470129","article-title":"A discontinuity preserving relaxation scheme for spectral\u2013spatial hyperspectral image classification","volume":"9","author":"Li","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3235","DOI":"10.1109\/TGRS.2015.2514161","article-title":"Nonlinear multiple kernel learning with multiple-structure-element extended morphological profiles for hyperspectral image classification","volume":"54","author":"Gu","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3693","DOI":"10.1109\/TGRS.2012.2186305","article-title":"Application of model-based change detection to airborne VNIR\/SWIR hyperspectral imagery","volume":"50","author":"Meola","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1109\/TGRS.2012.2195727","article-title":"Updating land-cover maps by classification of image time series: A novel change-detection-driven transfer learning approach","volume":"51","author":"Demir","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2858","DOI":"10.1109\/TGRS.2013.2266673","article-title":"Slow feature analysis for change detection in multispectral imagery","volume":"52","author":"Wu","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"14680","DOI":"10.3390\/rs71114680","article-title":"Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery","volume":"7","author":"Hu","year":"2015","journal-title":"Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1876","DOI":"10.1109\/TCYB.2014.2361489","article-title":"Scene parsing from an MAP perspective","volume":"45","author":"Li","year":"2015","journal-title":"IEEE Trans. Cybern."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/j.rse.2012.11.023","article-title":"Airborne hyperspectral remote sensing to assess spatial distribution of water quality characteristics in large rivers: The Mississippi River and its tributaries in Minnesota","volume":"130","author":"Olmanson","year":"2013","journal-title":"Remote Sens. Environ."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1016\/S0034-4257(97)00045-X","article-title":"Opportunities and limitations for image-based remote sensing in precision crop management","volume":"61","author":"Moran","year":"1997","journal-title":"Remote Sens. Environ."},{"key":"ref_14","first-page":"13","article-title":"Research progress on unmixing of hyperspectral remote sensing imagery","volume":"22","author":"Lan","year":"2018","journal-title":"J. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3528","DOI":"10.3390\/s18103528","article-title":"Spectral Unmixing of Hyperspectral Remote Sensing Imagery via Preserving the Intrinsic Structure Invariant","volume":"18","author":"Shao","year":"2018","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"738","DOI":"10.3390\/rs10050738","article-title":"A hierarchical sparsity unmixing method to address endmember variability in hyperspectral image","volume":"10","author":"Zou","year":"2018","journal-title":"Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"500","DOI":"10.3390\/rs11050500","article-title":"A Multiscale Hierarchical Model for Sparse Hyperspectral Unmixing","volume":"11","author":"Zou","year":"2019","journal-title":"Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.3390\/rs11091045","article-title":"A Spectral Unmixing Method by Maximum Margin Criterion and Derivative Weights to Address Spectral Variability in Hyperspectral Imagery","volume":"11","author":"Shao","year":"2019","journal-title":"Remote Sens."},{"key":"ref_19","first-page":"026514","article-title":"One hyperspectral object detection algorithm for solving spectral variability problems of the same object in different conditions","volume":"13","author":"Yu","year":"2019","journal-title":"Appl. Rem. Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1109\/TGRS.2015.2465899","article-title":"Matrix-Based Discriminant Subspace Ensemble for Hyperspectral Image Spatial-Spectral Feature Fusion","volume":"54","author":"Hang","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TIT.1968.1054102","article-title":"On the Mean Accuracy of Statistical Pattern Recognizers","volume":"14","author":"Hughes","year":"1968","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1109\/TGRS.2011.2162339","article-title":"On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification","volume":"50","author":"Zhang","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1846","DOI":"10.1080\/01431161.2013.879349","article-title":"Patch-Based Active Learning PTAL for Spectral-Spatial Classification on Hyperspectral Data","volume":"35","author":"Xu","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2652","DOI":"10.1109\/TGRS.2014.2363477","article-title":"Model-Based Fusion of Multi- and Hyperspectral Images Using PCA and Wavelets","volume":"53","author":"Palsson","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.1109\/TGRS.2004.825578","article-title":"Nonparametric Weighted Feature Extraction for Classification","volume":"42","author":"Kuo","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","unstructured":"Chen, H.T., Chang, H.W., and Liu, T.L. (2005, January 20\u201325). Local Discriminant Embedding and Its Variants. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2077","DOI":"10.1109\/LGRS.2017.2751559","article-title":"Locality Adaptive Discriminant Analysis for Spectral\u2013Spatial Classification of Hyperspectral Images","volume":"14","author":"Wang","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1760","DOI":"10.1109\/29.60107","article-title":"Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution","volume":"38","author":"Reed","year":"1990","journal-title":"IEEE Trans. Acoust. Speech Signal Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4865","DOI":"10.1109\/TGRS.2011.2153861","article-title":"Hyperspectral Image Classification with Independent Component Discriminant Analysis","volume":"49","author":"Villa","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/S0168-1699(03)00020-6","article-title":"Classification of hyperspectral data by decision trees and artificial neural networks to identify weed stress and nitrogen status of corn","volume":"39","author":"Goel","year":"2003","journal-title":"Comput. Electron. Agric."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1109\/TGRS.2004.842481","article-title":"Investigation of the random forest framework for classification of hyperspectral data","volume":"43","author":"Ham","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","unstructured":"Joelsson, S.R., Benediktsson, J.A., and Sveinsson, J.R. (2005, January 29). Random forest classifiers for hyperspectral data. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS \u201805, Seoul, Korea."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TGRS.2004.831865","article-title":"Classification of hyperspectral remote sensing images with support vector machines","volume":"42","author":"Melgani","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1109\/TGRS.2004.842478","article-title":"Classification of hyperspectral data from urban areas based on extended morphological profiles","volume":"43","author":"Benediktsson","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3804","DOI":"10.1109\/TGRS.2008.922034","article-title":"Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles","volume":"46","author":"Fauvel","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4816","DOI":"10.1109\/TGRS.2012.2230268","article-title":"Generalized composite kernel framework for hyperspectral image classification","volume":"51","author":"Li","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2276","DOI":"10.1109\/TGRS.2012.2209657","article-title":"Hyperspectral image classification based on structured sparse logistic regression and three-dimensional wavelet texture features","volume":"51","author":"Qian","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1118","DOI":"10.1109\/TGRS.2014.2334608","article-title":"Gabor feature-based collaborative representation for hyperspectral imagery classification","volume":"53","author":"Jia","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_41","first-page":"3371","article-title":"Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion","volume":"11","author":"Vincent","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_42","first-page":"1097","article-title":"ImageNet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Proc. Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"4544","DOI":"10.1109\/TGRS.2016.2543748","article-title":"Spectral spatial feature extraction for hyperspectral image classification: A dimension reduction and deep learning approach","volume":"54","author":"Zhao","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.isprsjprs.2016.01.004","article-title":"Learning multiscale and deep representations for classifying remotely sensed imagery","volume":"113","author":"Zhao","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.3390\/rs9121330","article-title":"Bidirectional-Convolutional LSTM Based Spectral-Spatial Feature Learning for Hyperspectral Image Classification","volume":"9","author":"Liu","year":"2017","journal-title":"Remote Sensing."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.isprsjprs.2017.11.021","article-title":"A new deep convolutional neural network for fast hyperspectral image classification","volume":"145","author":"Paoletti","year":"2017","journal-title":"ISPRS J. Photogram. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1109\/78.650093","article-title":"Bidirectional recurrent neural networks","volume":"45","author":"Schuster","year":"1997","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"258619","DOI":"10.1155\/2015\/258619","article-title":"Deep convolutional neural networks for hyperspectral image classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sens."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2381","DOI":"10.1109\/JSTARS.2015.2388577","article-title":"Spectral\u2013spatial classification of hyperspectral data based on deep belief network","volume":"8","author":"Chen","year":"2015","journal-title":"IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"844","DOI":"10.1109\/TGRS.2016.2616355","article-title":"Hyperspectral image classification using deep pixel-pair features","volume":"55","author":"Li","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"3639","DOI":"10.1109\/TGRS.2016.2636241","article-title":"Deep recurrent neural networks for hyperspectral image classification","volume":"55","author":"Mou","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1080\/2150704X.2019.1569274","article-title":"Hyperspectral images classification with convolutional neural network and textural feature using limited training samples","volume":"10","author":"Zhao","year":"2019","journal-title":"Remote Sens. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/3\/536\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T08:55:26Z","timestamp":1760172926000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/3\/536"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,6]]},"references-count":53,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["rs12030536"],"URL":"https:\/\/doi.org\/10.3390\/rs12030536","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,6]]}}}