{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,18]],"date-time":"2026-04-18T13:34:09Z","timestamp":1776519249864,"version":"3.51.2"},"reference-count":50,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,21]],"date-time":"2021-08-21T00:00:00Z","timestamp":1629504000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61701009"],"award-info":[{"award-number":["61701009"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61801479"],"award-info":[{"award-number":["61801479"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Beijing Municipal Education Commission Science and Technology Program","award":["KM202010005016"],"award-info":[{"award-number":["KM202010005016"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Hyperspectral classification is an important technique for remote sensing image analysis. For the current classification methods, limited training data affect the classification results. Recently, Conditional Variational Autoencoder Generative Adversarial Network (CVAEGAN) has been used to generate virtual samples to augment the training data, which could improve the classification performance. To further improve the classification performance, based on the CVAEGAN, we propose a Self-Attention-Based Conditional Variational Autoencoder Generative Adversarial Network (SACVAEGAN). Compared with CVAEGAN, we first use random latent vectors to obtain more enhanced virtual samples, which can improve the generalization performance. Then, we introduce the self-attention mechanism into our model to force the training process to pay more attention to global information, which can achieve better classification accuracy. Moreover, we explore model stability by incorporating the WGAN-GP loss function into our model to reduce the mode collapse probability. Experiments on three data sets and a comparison of the state-of-art methods show that SACVAEGAN has great advantages in accuracy compared with state-of-the-art HSI classification methods.<\/jats:p>","DOI":"10.3390\/rs13163316","type":"journal-article","created":{"date-parts":[[2021,8,22]],"date-time":"2021-08-22T22:59:27Z","timestamp":1629673167000},"page":"3316","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Self-Attention-Based Conditional Variational Auto-Encoder Generative Adversarial Networks for Hyperspectral Classification"],"prefix":"10.3390","volume":"13","author":[{"given":"Zhitao","family":"Chen","sequence":"first","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"},{"name":"Engineering Research Center of Intelligent Perception and Autonomous Control, Ministry of Education, Beijing 100124, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lei","family":"Tong","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"},{"name":"Engineering Research Center of Intelligent Perception and Autonomous Control, Ministry of Education, Beijing 100124, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bin","family":"Qian","sequence":"additional","affiliation":[{"name":"Traffic Management Research Institute of the Ministry of Public Security, Wuxi 214151, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing","family":"Yu","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chuangbai","family":"Xiao","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1923","DOI":"10.1109\/TIP.2018.2878958","article-title":"An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing","volume":"28","author":"Hong","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3140","DOI":"10.1109\/JSTARS.2015.2406339","article-title":"Generation of Spectral\u2013Temporal Response Surfaces by Combining Multispectral Satellite and Hyperspectral UAV Imagery for Precision Agriculture Applications","volume":"8","author":"Gevaert","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4566","DOI":"10.1109\/JSTARS.2014.2317876","article-title":"Remote Sensing With Simulated Unmanned Aircraft Imagery for Precision Agriculture Applications","volume":"7","author":"Hunt","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_4","first-page":"1850","article-title":"Assessment and Analysis of Migrations of Heavy Metal Lead and Zinc in Soil with Hyperspectral Inversion Model","volume":"38","author":"Tao","year":"2018","journal-title":"Spectrosc. Spectr. Anal."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/TGRS.2018.2849692","article-title":"GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","first-page":"92","article-title":"Robust Denoising Method based on Tensor Models Decomposition for Hyperspectral Imagery","volume":"15","year":"2019","journal-title":"WSEAS Trans. Signal Process."},{"key":"ref_7","first-page":"92","article-title":"A Mammographic Images Classification Technique via the Gaussian Radial Basis Kernel ELM and KPCA","volume":"2","author":"Sawssen","year":"2020","journal-title":"Int. J. Appl. Math. Comput. Sci. Syst. Eng."},{"key":"ref_8","first-page":"109","article-title":"A Comparative Study of Image Classification Models using NN and Similarity Distance","volume":"3","author":"Vetova","year":"2021","journal-title":"Int. J. Electr. Eng. Comput. Sci. (EEACS)"},{"key":"ref_9","first-page":"38","article-title":"Covid Image Classification using Wavelet Feature Vectors and NN","volume":"3","author":"Vetova","year":"2021","journal-title":"Eng. World"},{"key":"ref_10","first-page":"149","article-title":"Implementation of Discrete Wavelet Transform on Movement Images and Recognition by Artificial Neural Network Algorithm","volume":"15","year":"2019","journal-title":"WSEAS Trans. Signal Process."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhong, S., Chang, C.I., and Zhang, Y. (2018, January 7\u201310). Iterative Support Vector Machine for Hyperspectral Image Classification. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451145"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sun, S., Zhong, P., Xiao, H., Liu, F., and Wang, R. (2015, January 2\u20135). An active learning method based on SVM classifier for hyperspectral images classification. Proceedings of the 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), Tokyo, Japan.","DOI":"10.1109\/WHISPERS.2015.8075484"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TGRS.2004.831865","article-title":"Classification of hyperspectral remote sensing images with support vector machines","volume":"42","author":"Melgani","year":"2004","journal-title":"IEEE Trans. Geoence Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Song, W., Li, S., Kang, X., and Huang, K. (2016, January 10\u201315). Hyperspectral image classification based on KNN sparse representation. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.","DOI":"10.1109\/IGARSS.2016.7729622"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"18582","DOI":"10.1109\/ACCESS.2018.2820043","article-title":"Spectral\u2013Spatial HyperspectralImage Classification with K-Nearest Neighbor and Guided Filter","volume":"6","author":"Guo","year":"2018","journal-title":"IEEE Access"},{"key":"ref_16","unstructured":"Jia, X. (1997, January 3\u20138). Block-based maximum likelihood classification for hyperspectral remote sensing data. Proceedings of the IGARSS\u201997. 1997 IEEE International Geoscience and Remote Sensing Symposium Proceedings: Remote Sensing\u2014A Scientific Vision for Sustainable Development, Singapore."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2271","DOI":"10.1109\/TGRS.2009.2037898","article-title":"Semisupervised Neural Networks for Efficient Hyperspectral Image Classification","volume":"48","author":"Ratle","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/LGRS.2012.2205216","article-title":"Semisupervised Hyperspectral Image Classification Using Soft Sparse Multinomial Logistic Regression","volume":"10","author":"Li","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2105","DOI":"10.1109\/LGRS.2014.2320258","article-title":"A Subspace-Based Multinomial Logistic Regression for Hyperspectral Image Classification","volume":"11","author":"Khodadadzadeh","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TIT.1968.1054102","article-title":"On the mean accuracy of statistical pattern recognizers","volume":"14","author":"Hughes","year":"1968","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"4420","DOI":"10.1109\/TGRS.2018.2818945","article-title":"3-D Deep Learning Approach for Remote Sensing Image Classification","volume":"56","author":"Hamida","year":"2018","journal-title":"IEEE Trans. Geoence Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1882","DOI":"10.1109\/JSTARS.2019.2915259","article-title":"Deep Learning Ensemble for Hyperspectral Image Classification","volume":"12","author":"Chen","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/JSTARS.2014.2329330","article-title":"Deep Learning-Based Classification of Hyperspectral Data","volume":"7","author":"Chen","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2623","DOI":"10.1109\/TIP.2018.2809606","article-title":"Diverse Region-Based CNN for Hyperspectral Image Classification","volume":"27","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"844","DOI":"10.1109\/TGRS.2016.2616355","article-title":"Hyperspectral Image Classification Using Deep Pixel-Pair Features","volume":"55","author":"Li","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1109\/TGRS.2017.2756851","article-title":"Multisource Remote Sensing Data Classification Based on Convolutional Neural Network","volume":"56","author":"Xu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1109\/TCSVT.2020.2975566","article-title":"Multiscale Densely-Connected Fusion Networks for Hyperspectral Images Classification","volume":"31","author":"Xie","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"67","DOI":"10.3390\/rs9010067","article-title":"Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network","volume":"9","author":"Ying","year":"2017","journal-title":"Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4141","DOI":"10.1109\/JSTARS.2018.2844873","article-title":"Spatial Sequential Recurrent Neural Network for Hyperspectral Image Classification","volume":"11","author":"Zhang","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yang, J., Zhao, Y., Chan, J.C.W., and Yi, C. (2016, January 10\u201315). Hyperspectral image classification using two-channel deep convolutional neural network. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.","DOI":"10.1109\/IGARSS.2016.7730324"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative Adversarial Networks","volume":"63","author":"Goodfellow","year":"2020","journal-title":"Commun. ACM"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"7232","DOI":"10.1109\/TGRS.2019.2912468","article-title":"Caps-TripleGAN: GAN-Assisted CapsNet for Hyperspectral Image Classification","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"5329","DOI":"10.1109\/TGRS.2019.2899057","article-title":"Classification of Hyperspectral Images Based on Multiclass Spatial\u2013Spectral Generative Adversarial Networks","volume":"57","author":"Feng","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3318","DOI":"10.1109\/TCYB.2019.2915094","article-title":"Generative Adversarial Networks and Conditional Random Fields for Hyperspectral Image Classification","volume":"50","author":"Zhong","year":"2020","journal-title":"IEEE Trans. Cybern."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5046","DOI":"10.1109\/TGRS.2018.2805286","article-title":"Generative Adversarial Networks for Hyperspectral Image Classification","volume":"56","author":"Zhu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, H., Tao, C., Qi, J., Li, H., and Tang, Y. (August, January 28). Semi-Supervised Variational Generative Adversarial Networks for Hyperspectral Image Classification. Proceedings of the IGARSS 2019\u20142019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8900073"},{"key":"ref_38","unstructured":"Zhang, F., Bai, J., Zhang, J., Xiao, Z., and Pei, C. (2020). An Optimized Training Method for GAN-Based Hyperspectral Image Classification. IEEE Geosci. Remote Sens. Lett., 1\u20135."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1109\/LGRS.2020.2976482","article-title":"Generative Adversarial Capsule Network With ConvLSTM for Hyperspectral Image Classification","volume":"18","author":"Wang","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Yin, J., Li, W., and Han, B. (2019, January 22\u201325). Hyperspectral Image Classification Based on Generative Adversarial Network with Dropblock. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8802936"},{"key":"ref_41","first-page":"1929","article-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_42","unstructured":"Karras, T., Aila, T., Laine, S., and Lehtinen, J. (2017). Progressive growing of gans for improved quality, stability, and variation. arXiv."},{"key":"ref_43","unstructured":"Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, C.A. (2017, January 4\u20139). Improved Training of Wasserstein GANs. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_44","unstructured":"Sabour, S., Frosst, N., and Hinton, G.E. (2017). Dynamic Routing Between Capsules. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_46","unstructured":"Vaswani, A., Shazeer, N.M., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is All you Need. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Bao, J., Chen, D., Wen, F., Li, H., and Hua, G. (2017, January 22\u201329). CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.299"},{"key":"ref_48","unstructured":"Zhang, H., Goodfellow, I., Metaxas, D., and Odena, A. (2019, January 9\u201315). Self-attention generative adversarial networks. Proceedings of the International Conference on Machine Learning (PMLR 2019), Beach, CA, USA."},{"key":"ref_49","unstructured":"Kingma, D.P., and Welling, M. (2014). Auto-Encoding Variational Bayes. arXiv."},{"key":"ref_50","unstructured":"Mirza, M., and Osindero, S. (2014). Conditional Generative Adversarial Nets. arXiv."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3316\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:48:54Z","timestamp":1760165334000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3316"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,21]]},"references-count":50,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["rs13163316"],"URL":"https:\/\/doi.org\/10.3390\/rs13163316","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,21]]}}}