{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T15:28:03Z","timestamp":1772638083915,"version":"3.50.1"},"reference-count":58,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2021,4,26]],"date-time":"2021-04-26T00:00:00Z","timestamp":1619395200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["61805181"],"award-info":[{"award-number":["61805181"]}]},{"name":"National Natural Science Foundation of China","award":["61705170"],"award-info":[{"award-number":["61705170"]}]},{"name":"National Natural Science Foundation of China","award":["61903279"],"award-info":[{"award-number":["61903279"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>With the rapid developments of hyperspectral imaging, the cost of collecting hyperspectral data has been lower, while the demand for reliable and detailed hyperspectral annotations has been much more substantial. However, limited by the difficulties of labelling annotations, most existing hyperspectral image (HSI) classification methods are trained and evaluated on a single hyperspectral data cube. It brings two significant challenges. On the one hand, many algorithms have reached a nearly perfect classification accuracy, but their trained models are hard to generalize to other datasets. On the other hand, since different hyperspectral datasets are usually not collected in the same scene, different datasets will contain different classes. To address these issues, in this paper, we propose a new paradigm for HSI classification, which is training and evaluating separately across different hyperspectral datasets. It is of great help to labelling hyperspectral data. However, it has rarely been studied in the hyperspectral community. In this work, we utilize a three-phase scheme, including feature embedding, feature mapping, and label reasoning. More specifically, we select a pair of datasets acquired by the same hyperspectral sensor, and the classifier learns from one dataset and then evaluated it on the other. Inspired by the latest advances in zero-shot learning, we introduce label semantic representation to establish associations between seen categories in the training set and unseen categories in the testing set. Extensive experiments on two pairs of datasets with different comparative methods have shown the effectiveness and potential of zero-shot learning in HSI classification.<\/jats:p>","DOI":"10.3390\/rs13091672","type":"journal-article","created":{"date-parts":[[2021,4,26]],"date-time":"2021-04-26T22:21:57Z","timestamp":1619475717000},"page":"1672","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Hyperspectral Image Classification across Different Datasets: A Generalization to Unseen Categories"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6969-7104","authenticated-orcid":false,"given":"Erting","family":"Pan","sequence":"first","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"}]},{"given":"Yong","family":"Ma","sequence":"additional","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"},{"name":"Institute of Aerospace Science and Technology, Wuhan University, Wuhan 430072, China"}]},{"given":"Fan","family":"Fan","sequence":"additional","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"},{"name":"Institute of Aerospace Science and Technology, Wuhan University, Wuhan 430072, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0239-8580","authenticated-orcid":false,"given":"Xiaoguang","family":"Mei","sequence":"additional","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"},{"name":"Institute of Aerospace Science and Technology, Wuhan University, Wuhan 430072, China"}]},{"given":"Jun","family":"Huang","sequence":"additional","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"},{"name":"Institute of Aerospace Science and Technology, Wuhan University, Wuhan 430072, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"6690","DOI":"10.1109\/TGRS.2019.2907932","article-title":"Deep Learning for Hyperspectral Image Classification: An Overview","volume":"57","author":"Li","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Hu, J., Peng, J., Zhou, Y., Xu, D., Zhao, R., Jiang, Q., Fu, T., Wang, F., and Shi, Z. (2019). Quantitative Estimation of Soil Salinity Using UAV-Borne Hyperspectral and Satellite Multispectral Images. Remote Sens., 11.","DOI":"10.3390\/rs11070736"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Jin, X., Jie, L., Wang, S., Qi, H.J., and Li, S.W. (2018). Classifying Wheat Hyperspectral Pixels of Healthy Heads and Fusarium Head Blight Disease Using a Deep Neural Network in the Wild Field. Remote Sens., 10.","DOI":"10.3390\/rs10030395"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1109\/MGRS.2017.2762087","article-title":"Advances in hyperspectral image and signal processing: A comprehensive overview of the state of the art","volume":"5","author":"Ghamisi","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.inffus.2020.10.008","article-title":"Image retrieval from remote sensing big data: A survey","volume":"67","author":"Li","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"112045","DOI":"10.1016\/j.rse.2020.112045","article-title":"Accurate cloud detection in high-resolution remote sensing imagery by weakly supervised deep learning","volume":"250","author":"Li","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Paoletti, M.E., Haut, J.M., Plaza, J., and Plaza, A. (2018). Deep and Dense Convolutional Neural Network for Hyperspectral Image Classification. Remote Sens., 10.","DOI":"10.3390\/rs10091454"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4581","DOI":"10.1109\/TGRS.2018.2828029","article-title":"SuperPCA: A superpixelwise PCA approach for unsupervised feature extraction of hyperspectral imagery","volume":"56","author":"Jiang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","unstructured":"Chang, C.I. (2003). Hyperspectral Imaging: Techniques for Spectral Detection and Classification, Springer Science & Business Media."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep learning for remote sensing data: A technical tutorial on the state of the art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L., Li, K., and Feifei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.isprsjprs.2017.11.003","article-title":"MugNet: Deep learning for hyperspectral image classification using limited samples","volume":"145","author":"Pan","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1291","DOI":"10.1109\/TGRS.2018.2865953","article-title":"Hyperspectral Image Classification With Squeeze Multibias Network","volume":"57","author":"Fang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.neunet.2021.01.021","article-title":"Bilateral attention decoder: A lightweight decoder for real-time semantic segmentation","volume":"137","author":"Peng","year":"2021","journal-title":"Neural Netw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1109\/TMM.2019.2928491","article-title":"Multiscale superpixel-based hyperspectral image classification using recurrent neural networks with stacked autoencoders","volume":"22","author":"Shi","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"107498","DOI":"10.1016\/j.patcog.2020.107498","article-title":"Semantic segmentation using stride spatial pyramid pooling and dual attention decoder","volume":"107","author":"Peng","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Peng, C., Zhang, K., Ma, Y., and Ma, J. (2021). Cross Fusion Net: A Fast Semantic Segmentation Network for Small-Scale Semantic Information Capturing in Aerial Scenes. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2021.3053062"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"862","DOI":"10.1109\/TGRS.2016.2616489","article-title":"On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification","volume":"55","author":"Liang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"H\u00e4nsch, R., Ley, A., and Hellwich, O. (2017, January 23\u201328). Correct and still wrong: The relationship between sampling strategies and the estimation of the generalization error. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127795"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.isprsjprs.2019.09.006","article-title":"Deep learning classifiers for hyperspectral imaging: A review","volume":"158","author":"Paoletti","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_21","unstructured":"Baumgardner, M.F., Biehl, L.L., and Landgrebe, D.A. (2015). 220 Band AVIRIS Hyperspectral Image Data Set: June 12, 1992 Indian Pine Test Site 3, Purdue University Research Repository."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1109\/TGRS.2004.841417","article-title":"Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations","volume":"43","author":"Plaza","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lee, H., Eum, S., and Kwon, H. (2018, January 22\u201327). Cross-Domain CNN for Hyperspectral Image Classification. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519419"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Geng, J., Ma, X., Jiang, W., Hu, X., Wang, D., and Wang, H. (August, January 28). Cross-Scene Hyperspectral Image Classification Based on Deep Conditional Distribution Adaptation Networks. Proceedings of the IGARSS 2019\u20142019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8899197"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1109\/LGRS.2018.2799628","article-title":"Feature Adaptation and Augmentation for Cross-Scene Hyperspectral Image Classification","volume":"15","author":"Shen","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Changpinyo, S., Chao, W.L., and Sha, F. (2017, January 22\u201329). Predicting Visual Exemplars of Unseen Classes for Zero-Shot Learning. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.376"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1109\/MSP.2017.2763441","article-title":"Recent advances in zero-shot recognition: Toward data-efficient understanding of visual content","volume":"35","author":"Fu","year":"2018","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_28","unstructured":"Annadani, Y., and Biswas, S. (2018, January 18\u201322). Preserving Semantic Relations for Zero-Shot Learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2251","DOI":"10.1109\/TPAMI.2018.2857768","article-title":"Zero-Shot Learning\u2014A Comprehensive Evaluation of the Good, the Bad and the Ugly","volume":"41","author":"Xian","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lampert, C.H., Nickisch, H., and Harmeling, S. (2009, January 20\u201325). Learning to detect unseen object classes by between-class attribute transfer. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206594"},{"key":"ref_31","unstructured":"Romera-Paredes, B., and Torr, P. (2015, January 7\u20139). An embarrassingly simple approach to zero-shot learning. Proceedings of the 32nd International Conference on Machine Learning, Lille, France."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1145\/3293318","article-title":"A survey of zero-shot learning: Settings, methods, and applications","volume":"10","author":"Wang","year":"2019","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TPAMI.2013.140","article-title":"Attribute-based classification for zero-shot visual object categorization","volume":"36","author":"Lampert","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","unstructured":"Frome, A., Corrado, G.S., Shlens, J., Bengio, S., Dean, J., Ranzato, M., and Mikolov, T. (2013, January 5\u20138). Devise: A deep visual-semantic embedding model. Proceedings of the 26th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, W., Pu, Y., Verma, V.K., Fan, K., Zhang, Y., Chen, C., Rai, P., and Carin, L. (2017, January 2\u20137). Zero-shot learning via class-conditioned deep generative models. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11600"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1037\/0033-295X.114.2.211","article-title":"Topics in semantic representation","volume":"114","author":"Griffiths","year":"2007","journal-title":"Psychol. Rev."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Levy, O., and Goldberg, Y. (2014, January 23\u201324). Dependency-based word embeddings. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, Baltimore, MD, USA.","DOI":"10.3115\/v1\/P14-2050"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, J., Chen, X., Hovy, E., and Jurafsky, D. (2016, January 12\u201317). Visualizing and Understanding Neural Models in NLP. Proceedings of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.","DOI":"10.18653\/v1\/N16-1082"},{"key":"ref_39","unstructured":"Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Chung, Y.A., Wu, C.C., Shen, C.H., Lee, H.Y., and Lee, L.S. (2016). Audio word2vec: Unsupervised learning of audio segment representations using sequence-to-sequence autoencoder. arXiv.","DOI":"10.21437\/Interspeech.2016-82"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Luan, Y., Watanabe, S., and Harsham, B. (2015, January 6\u201310). Efficient learning for spoken language understanding tasks with word embedding based pre-training. Proceedings of the 16th Annual Conference of the International Speech Communication Association, Dresden, Germany.","DOI":"10.21437\/Interspeech.2015-56"},{"key":"ref_42","unstructured":"Zhang, X., Wei, F., and Zhou, M. (August, January 28). HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1109\/LGRS.2016.2532380","article-title":"Hyperspectral image classification with robust sparse representation","volume":"13","author":"Li","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Zhong, Z., Li, J., Ma, L., Jiang, H., and Zhao, H. (2017, January 23\u201328). Deep residual networks for hyperspectral image classification. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127330"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Mei, X., Pan, E., Ma, Y., Dai, X., Huang, J., Fan, F., Du, Q., Zheng, H., and Ma, J. (2019). Spectral-Spatial Attention Networks for Hyperspectral Image Classification. Remote Sens., 11.","DOI":"10.3390\/rs11080963"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.isprsjprs.2016.09.001","article-title":"Semisupervised classification for hyperspectral image based on multi-decision labeling and deep feature learning","volume":"120","author":"Ma","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"3639","DOI":"10.1109\/TGRS.2016.2636241","article-title":"Deep recurrent neural networks for hyperspectral image classification","volume":"55","author":"Mou","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","first-page":"5893","article-title":"Spectral-Spatial Unified Networks for Hyperspectral Image Classification","volume":"56","author":"Xu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.neucom.2020.01.029","article-title":"Spectral-spatial classification for hyperspectral image based on a single GRU","volume":"387","author":"Pan","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1109\/TPAMI.2015.2487986","article-title":"Label-Embedding for Image Classification","volume":"38","author":"Akata","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Kodirov, E., Xiang, T., and Gong, S. (2017, January 21\u201326). Semantic autoencoder for zero-shot learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.473"},{"key":"ref_53","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J. (2013, January 5\u20138). Distributed representations of words and phrases and their compositionality. Proceedings of the 26th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_54","unstructured":"Weston, J., Bengio, S., and Usunier, N. (2011, January 16\u201322). Wsabie: Scaling up to large vocabulary image annotation. Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, Barcelona, Catalonia, Spain."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Zhang, L., Xiang, T., and Gong, S. (2017, January 21\u201326). Learning a deep embedding model for zero-shot learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.321"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Sung, F., Yang, Y., Zhang, L., Xiang, T., Torr, P.H., and Hospedales, T.M. (2018, January 18\u201322). Learning to compare: Relation network for few-shot learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00131"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1109\/JPROC.2012.2197589","article-title":"Advances in Spectral-Spatial Classification of Hyperspectral Images","volume":"101","author":"Fauvel","year":"2012","journal-title":"Proc. IEEE"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"3804","DOI":"10.1109\/TGRS.2008.922034","article-title":"Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles","volume":"46","author":"Fauvel","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/9\/1672\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:52:46Z","timestamp":1760161966000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/9\/1672"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,26]]},"references-count":58,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["rs13091672"],"URL":"https:\/\/doi.org\/10.3390\/rs13091672","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,26]]}}}