{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T17:01:37Z","timestamp":1769274097499,"version":"3.49.0"},"reference-count":52,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T00:00:00Z","timestamp":1671408000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Recently, hyperspectral image (HSI) classification has become a hot topic in the geographical images research area. Sufficient samples are required for image classes to properly train classification models. However, a class imbalance problem has emerged in hyperspectral image (HSI) datasets as some classes do not have enough samples for training, and some classes have many samples. Therefore, the performance of classifiers is likely to be biased toward the classes with the largest samples, and this can lead to a decrease in the classification accuracy. Therefore, a new deep-learning-based model is proposed for hyperspectral images generation and classification of imbalanced data. Firstly, the spectral features are extracted by a 1D convolutional neural network, whereas a 2D convolutional neural network extracts the spatial features and the extracted spatial features and spectral features are catenated into a stacked spatial\u2013spectral feature vector. Secondly, an autoencoder model was developed to generate synthetic images for minority classes, and the image samples were balanced. The GAN model is applied to determine the synthetic images from the real ones and then enhancing the classification performance. Finally, the balanced datasets are fed to a 2D CNN model for performing classification and validating the efficiency of the proposed model. Our model and the state-of-the-art classifiers are evaluated by four open-access HSI datasets. The results showed that the proposed approach can generate better quality samples for rebalancing datasets, which in turn noticeably enhances the classification performance compared to the existing classification models.<\/jats:p>","DOI":"10.3390\/rs14246406","type":"journal-article","created":{"date-parts":[[2022,12,20]],"date-time":"2022-12-20T02:05:02Z","timestamp":1671501902000},"page":"6406","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A Hypered Deep-Learning-Based Model of Hyperspectral Images Generation and Classification for Imbalanced Data"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2035-0759","authenticated-orcid":false,"given":"Hasan A. H.","family":"Naji","sequence":"first","affiliation":[{"name":"School of Digital Media, Nanyang Institute of Technology, Chang Jiang Road No. 80, Nanyang 473004, China"}]},{"given":"Tianfeng","family":"Li","sequence":"additional","affiliation":[{"name":"School of Digital Media, Nanyang Institute of Technology, Chang Jiang Road No. 80, Nanyang 473004, China"}]},{"given":"Qingji","family":"Xue","sequence":"additional","affiliation":[{"name":"School of Digital Media, Nanyang Institute of Technology, Chang Jiang Road No. 80, Nanyang 473004, China"}]},{"given":"Xindong","family":"Duan","sequence":"additional","affiliation":[{"name":"School of Digital Media, Nanyang Institute of Technology, Chang Jiang Road No. 80, Nanyang 473004, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2623","DOI":"10.1109\/TIP.2018.2809606","article-title":"Diverse Region-Based CNN for Hyperspectral Image Classification","volume":"27","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MGRS.2016.2616418","article-title":"Advanced Spectral Classifiers for Hyperspectral Images: A review","volume":"5","author":"Ghamisi","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3838","DOI":"10.1109\/TGRS.2018.2813366","article-title":"Hyperspectral Image Classification with Imbalanced Data Based on Orthogonal Complement Subspace Projection","volume":"56","author":"Li","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6690","DOI":"10.1109\/TGRS.2019.2907932","article-title":"Deep Learning for Hyperspectral Image Classification: An Overview","volume":"57","author":"Li","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","first-page":"102603","article-title":"Hyperspectral image classification on insufficient-sample and feature learning using deep neural networks: A review","volume":"105","author":"Wambugu","year":"2021","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_6","first-page":"102687","article-title":"Adaptive spectral-spatial feature fusion network for hyperspectral image classification using limited training samples","volume":"107","author":"Gao","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1109\/TBDATA.2019.2923243","article-title":"Beyond the Patchwise Classification: Spectral-Spatial Fully Convolutional Networks for Hyperspectral Image Classification","volume":"6","author":"Xu","year":"2019","journal-title":"IEEE Trans. Big Data"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Naji, H.A.H., Xue, Q., Lyu, N., Duan, X., and Li, T. (2022). Risk Levels Classification of Near-Crashes in Naturalistic Driving Data. Sustainability, 14.","DOI":"10.3390\/su14106032"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Naji, H.A.H., Xue, Q., Zhu, H., and Li, T. (2021). Forecasting Taxi Demands Using Generative Adversarial Networks with Multi-Source Data. Appl. Sci., 11.","DOI":"10.3390\/app11209675"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.neucom.2021.03.035","article-title":"A survey: Deep learning for hyperspectral image classification with few labeled samples","volume":"448","author":"Jia","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_11","first-page":"1","article-title":"A Guide to Convolutional Neural Networks for Computer Vision","volume":"8","author":"Khan","year":"2018","journal-title":"Synth. Lect. Comput. Vis."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1109\/TGRS.2018.2860464","article-title":"Feature Extraction with Multiscale Covariance Maps for Hyperspectral Image Classification","volume":"57","author":"He","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"7048","DOI":"10.1109\/TGRS.2019.2910603","article-title":"Automatic Design of Convolutional Neural Network for Hyperspectral Image Classification","volume":"57","author":"Chen","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2355","DOI":"10.1109\/LGRS.2017.2764915","article-title":"Hyperspectral Images Classification with Gabor Filtering and Convolutional Neural Network","volume":"14","author":"Chen","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"10473","DOI":"10.1109\/TGRS.2020.3046840","article-title":"Spectral\u2013Spatial Fractal Residual Convolutional Neural Network with Data Balance Augmentation for Hyperspectral Classification","volume":"59","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"8180","DOI":"10.1109\/JSTARS.2021.3103176","article-title":"A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification","volume":"14","author":"Gao","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Seydgar, M., Naeini, A.A., Zhang, M., Li, W., and Satari, M. (2019). 3-D Convolution-Recurrent Networks for Spectral-Spatial Classification of Hyperspectral Images. Remote Sens., 11.","DOI":"10.3390\/rs11070883"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4420","DOI":"10.1109\/TGRS.2018.2818945","article-title":"3-D deep learning approach for remote sensing image classification","volume":"56","author":"Hamida","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"118971","DOI":"10.1016\/j.eswa.2022.118971","article-title":"ETR: Enhancing transformation reduction for reducing dimensionality and classification complexity in hyperspectral images","volume":"213","author":"Cai","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.isprsjprs.2022.06.008","article-title":"UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery","volume":"190","author":"Wang","year":"2022","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, L., Li, R., Wang, D., Duan, C., Wang, T., and Meng, X. (2021). Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Images. Remote Sens., 13.","DOI":"10.3390\/rs13163065"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"109096","DOI":"10.1016\/j.patcog.2022.109096","article-title":"IDA: Improving distribution analysis for reducing data complexity and dimensionality in hyperspectral images","volume":"134","author":"Cai","year":"2023","journal-title":"Pattern Recognit."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5612","DOI":"10.1109\/TGRS.2020.2967821","article-title":"FPGA: Fast Patch-Free Global Learning Framework for Fully End-to-End Hyperspectral Image Classification","volume":"58","author":"Zheng","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/LGRS.2019.2918719","article-title":"HybridSN: Exploring 3-D\u20132-D CNN Feature Hierarchy for Hyperspectral Image Classification","volume":"17","author":"Roy","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shi, C., Liao, D., Zhang, T., and Wang, L. (2022). Hyperspectral Image Classification Based on 3D Coordination Attention Mechanism Network. Remote Sens., 14.","DOI":"10.3390\/rs14030608"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Al-Alimi, D., Al-Qaness, M.A.A., Cai, Z., Dahou, A., Shao, Y., and Issaka, S. (2022). Meta-Learner Hybrid Models to Classify Hyperspectral Images. Remote Sens., 14.","DOI":"10.3390\/rs14041038"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1016\/j.ins.2021.07.043","article-title":"Hyperspectral image classification based on spatial and spectral kernels generation network","volume":"578","author":"Ma","year":"2021","journal-title":"Inf. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/j.neucom.2020.01.119","article-title":"Imbalanced data learning by minority class augmentation using capsule adversarial networks","volume":"459","author":"Shamsolmoali","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_30","unstructured":"Du, J., Zhou, Y., Liu, P., Vong, C.-M., and Wang, T. (2021). Parameter-Free Loss for Class-Imbalanced Deep Learning in Image Classification. IEEE Trans. Neural Networks Learn. Syst., 1\u20137."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"88399","DOI":"10.1109\/ACCESS.2020.2992683","article-title":"Towards Imbalanced Image Classification: A Generative Adversarial Network Ensemble Learning Method","volume":"8","author":"Huang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"114986","DOI":"10.1016\/j.eswa.2021.114986","article-title":"Classification of imbalanced hyperspectral images using SMOTE-based deep learning methods","volume":"178","author":"Polat","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_33","first-page":"389","article-title":"Enhanced classification of hyperspectral images using improvised oversampling and undersampling techniques","volume":"14","author":"Singh","year":"2022","journal-title":"Int. J. Inf. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3988","DOI":"10.1109\/JSTARS.2021.3069013","article-title":"Enhanced-Random-Feature-Subspace-Based Ensemble CNN for the Imbalanced Hyperspectral Image Classification","volume":"14","author":"Lv","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5046","DOI":"10.1109\/TGRS.2018.2805286","article-title":"Generative Adversarial Networks for Hyperspectral Image Classification","volume":"56","author":"Zhu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5329","DOI":"10.1109\/TGRS.2019.2899057","article-title":"Classification of Hyperspectral Images Based on Multiclass Spatial\u2013Spectral Generative Adversarial Networks","volume":"57","author":"Feng","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"7232","DOI":"10.1109\/TGRS.2019.2912468","article-title":"Caps-TripleGAN: GAN-assisted CapsNet for hyperspectral image classification","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1049\/iet-ipr.2019.0869","article-title":"Semi-supervised convolutional generative adversarial network for hyperspectral image classification","volume":"14","author":"Xue","year":"2020","journal-title":"IET Image Process."},{"key":"ref_39","first-page":"1","article-title":"Generative Adversarial Minority Oversampling for Spectral\u2013Spatial Hyperspectral Image Classification","volume":"60","author":"Roy","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","unstructured":"Mish, M.D. (2019). A self-regularized non-monotonic neural activation function. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"5776","DOI":"10.1109\/JSTARS.2020.3024841","article-title":"Hyperspectral Image Classification Method Based on 2D\u20133D CNN and Multibranch Feature Fusion","volume":"13","author":"Ge","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Chen, Z., Tong, L., Qian, B., Yu, J., and Xiao, C. (2021). Self-Attention-Based Conditional Variational Auto-Encoder Generative Adversarial Networks for Hyperspectral Classification. Remote Sens., 13.","DOI":"10.3390\/rs13163316"},{"key":"ref_43","unstructured":"(2022, May 06). Hyperspectral Remote Sensing Scenes. Available online: https:\/\/www.ehu.eus\/ccwintco\/index.php\/Hyperspectral_Remote_Sensing_Scenes."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Meng, Z., Zhao, F., and Liang, M. (2021). SS-MLP: A Novel Spectral-Spatial MLP Architecture for Hyperspectral Image Classification. Remote Sens., 13.","DOI":"10.3390\/rs13204060"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TGRS.2004.831865","article-title":"Classification of hyperspectral remote sensing images with support vector machines","volume":"42","author":"Melgani","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1947","DOI":"10.1021\/ci034160g","article-title":"Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling","volume":"43","author":"Svetnik","year":"2003","journal-title":"J. Chem. Inf. Comput. Sci."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1725","DOI":"10.1016\/j.neucom.2017.09.004","article-title":"Hyperspectral image classification by AdaBoost weighted composite kernel extreme learning machines","volume":"275","author":"Li","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"4032","DOI":"10.1109\/JSTARS.2018.2872969","article-title":"KNN-Based Representation of Superpixels for Hyperspectral Image Classification","volume":"11","author":"Tu","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_49","first-page":"40","article-title":"Application of PCA dimensionality reduction and decision tree in hyperspectral image classification","volume":"5","author":"Hao","year":"2017","journal-title":"Comput. Era"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.neucom.2018.02.105","article-title":"Hyperspectral image classification using spectral-spatial LSTMs\u2014ScienceDirect","volume":"328","author":"Zhou","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"258619","DOI":"10.1155\/2015\/258619","article-title":"Deep Convolutional Neural Networks for Hyperspectral Image Classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sens."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, H., and Shen, Q. (2017). Spectral\u2013Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network. Remote Sens., 9.","DOI":"10.3390\/rs9010067"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/24\/6406\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:44:24Z","timestamp":1760147064000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/24\/6406"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,19]]},"references-count":52,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["rs14246406"],"URL":"https:\/\/doi.org\/10.3390\/rs14246406","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,19]]}}}