{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T13:55:48Z","timestamp":1770990948083,"version":"3.50.1"},"reference-count":54,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,3,16]],"date-time":"2023-03-16T00:00:00Z","timestamp":1678924800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41971379"],"award-info":[{"award-number":["41971379"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Albeit hyperspectral image (HSI) classification methods based on deep learning have presented high accuracy in supervised classification, these traditional methods required quite a few labeled samples for parameter optimization. When processing HSIs, however, artificially labeled samples are always insufficient, and class imbalance in limited samples is inevitable. This study proposed a Transformer-based framework of spatial\u2013spectral\u2013associative contrastive learning classification methods to extract both spatial and spectral features of HSIs by the self-supervised method. Firstly, the label information required for contrastive learning is generated by a spatial\u2013spectral augmentation transform and image entropy. Then, the spatial and spectral Transformer modules are used to learn the high-level semantic features of the spatial domain and the spectral domain, respectively, from which the cross-domain features are fused by associative optimization. Finally, we design a classifier based on the Transformer. The invariant features distinguished from spatial\u2013spectral properties are used in the classification of satellite HSIs to further extract the discriminant features between different pixels, and the class intersection over union is imported into the loss function to avoid the classification collapse caused by class imbalance. Conducting experiments on two satellite HSI datasets, this study verified the classification performance of the model. The results showed that the self-supervised contrastive learning model can extract effective features for classification, and the classification generated from this model is more accurate compared with that of the supervised deep learning model, especially in the average accuracy of the various classifications.<\/jats:p>","DOI":"10.3390\/rs15061612","type":"journal-article","created":{"date-parts":[[2023,3,16]],"date-time":"2023-03-16T02:40:11Z","timestamp":1678934411000},"page":"1612","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Spatial-Spectral-Associative Contrastive Learning for Satellite Hyperspectral Image Classification with Transformers"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4773-0695","authenticated-orcid":false,"given":"Jinchun","family":"Qin","sequence":"first","affiliation":[{"name":"Department of Civil Engineering, Tsinghua University, Beijing 100084, China"},{"name":"State Key Laboratory of Geo-Information Engineering, Xi\u2019an 710054, China"}]},{"given":"Hongrui","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, Tsinghua University, Beijing 100084, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Transon, J., D\u2019Andrimont, R., Maugnard, A., and Defourny, P. (2018). Survey of Hyperspectral Earth Observation Applications from Space in the Sentinel-2 Context. Remote. Sens., 10.","DOI":"10.3390\/rs10020157"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1109\/TGRS.2003.815018","article-title":"Hyperion, a space-based imaging spectrometer","volume":"41","author":"Pearlman","year":"2003","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1007\/s11430-010-4139-0","article-title":"Chinese HJ-1A\/B satellites and data characteristics","volume":"53","author":"Wang","year":"2010","journal-title":"Sci. China Earth Sci."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Qin, Y., Zhang, X., Zhao, Z., Li, Z., Yang, C., and Huang, Q. (2022). Coupling Relationship Analysis of Gold Content Using Gaofen-5 (GF-5) Satellite Hyperspectral Remote Sensing Data: A Potential Method in Chahuazhai Gold Mining Area, Qiubei County, SW China. Remote Sens., 14.","DOI":"10.3390\/rs14010109"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Guo, Y., Mokany, K., Ong, C., Moghadam, P., Ferrier, S., and Levick, S. (2022, January 17\u201322). Quantitative Assessment of DESIS Hyperspectral Data for Plant Biodiversity Estimation in Australia. Proceedings of the IGARSS 2022\u20142022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia.","DOI":"10.1109\/IGARSS46834.2022.9883033"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Loizzo, R., Guarini, R., Longo, F., Scopa, T., Formaro, R., Facchinetti, C., and Varacalli, G. (2018, January 22\u201327). Prisma: The Italian Hyperspectral Mission. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8518512"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Qin, J., Zhao, H., and Liu, B. (2022). Self-Supervised Denoising for Real Satellite Hyperspectral Imagery. Remote Sens., 14.","DOI":"10.3390\/rs14133083"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3005","DOI":"10.1007\/s11042-021-11729-8","article-title":"Hyperspectral imagery applications for precision agriculture\u2014A systemic survey","volume":"81","author":"Sethy","year":"2022","journal-title":"Multimed. Tools Appl."},{"key":"ref_9","first-page":"014519","article-title":"Orbita hyperspectral satellite image for land cover classification using random forest classifier","volume":"15","author":"You","year":"2021","journal-title":"J. Appl. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.ins.2019.02.008","article-title":"Hyperspectral image unsupervised classification by robust manifold matrix factorization","volume":"485","author":"Zhang","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0034-4257(93)90013-N","article-title":"The spectral image processing system (SIPS)\u2014Interactive visualization and analysis of imaging spectrometer data","volume":"44","author":"Kruse","year":"1993","journal-title":"Remote Sens. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Richards, J., and Jia, X. (2006). Remote Sensing Digital Image Analysis, Springer.","DOI":"10.1007\/3-540-29711-1"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/978-94-007-7969-3_9","article-title":"A review of modern approaches to classification of remote sensing data","volume":"18","author":"Bruzzone","year":"2014","journal-title":"Land Use Land Cover. Mapp. Eur. Pract. Trends"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6223","DOI":"10.1109\/TGRS.2015.2436335","article-title":"Spectral and Spatial Classification of Hyperspectral Images Based on ICA and Reduced Morphological Attribute Profiles","volume":"53","author":"Falco","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4768","DOI":"10.1109\/TGRS.2015.2409195","article-title":"Random Subspace Ensembles for Hyperspectral Image Classification With Extended Morphological Attribute Profiles","volume":"53","author":"Xia","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cao, X., Xu, Z., and Meng, D. (2019). Spectral-Spatial Hyperspectral Image Classification via Robust Low-Rank Feature Extraction and Markov Random Field. Remote Sens., 11.","DOI":"10.3390\/rs11131565"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1109\/TGRS.2017.2755542","article-title":"Spectral\u2013spatial residual network for hyperspectral image classification: A 3-D deep learning framework","volume":"56","author":"Zhong","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/JSTARS.2014.2329330","article-title":"Deep Learning-Based Classification of Hyperspectral Data","volume":"7","author":"Chen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2381","DOI":"10.1109\/JSTARS.2015.2388577","article-title":"Spectral\u2013Spatial Classification of Hyperspectral Data Based on Deep Belief Network","volume":"8","author":"Chen","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"6690","DOI":"10.1109\/TGRS.2019.2907932","article-title":"Deep Learning for Hyperspectral Image Classification: An Overview","volume":"57","author":"Li","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"6712","DOI":"10.1109\/TGRS.2018.2841823","article-title":"Exploring Hierarchical Convolutional Features for Hyperspectral Image Classification","volume":"56","author":"Cheng","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4420","DOI":"10.1109\/TGRS.2018.2818945","article-title":"3-D Deep Learning Approach for Remote Sensing Image Classification","volume":"56","author":"Hamida","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Tang, G., M\u00fcller, M., Rios Gonzales, A., and Sennrich, R. (November, January 31). Why Self-Attention? A Targeted Evaluation of Neural Machine Translation Architectures. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1458"},{"key":"ref_25","unstructured":"Vaswani, A., Shazeer, N.M., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is All you Need. arXiv."},{"key":"ref_26","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021). An Image is Worth 16 \u00d7 16 Words: Transformers for Image Recognition at Scale. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"He, X., Chen, Y., and Lin, Z. (2021). Spatial-Spectral Transformer for Hyperspectral Image Classification. Remote Sens., 13.","DOI":"10.3390\/rs13030498"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Qing, Y., Liu, W., Feng, L., and Gao, W. (2021). Improved Transformer Net for Hyperspectral Image Classification. Remote Sens., 13.","DOI":"10.3390\/rs13112216"},{"key":"ref_29","first-page":"5528715","article-title":"Hyperspectral Image Transformer Classification Networks","volume":"60","author":"Yang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"5535416","DOI":"10.1109\/TGRS.2022.3196771","article-title":"LESSFormer: Local-Enhanced Spectral-Spatial Transformer for Hyperspectral Image Classification","volume":"60","author":"Zou","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"5536115","DOI":"10.1109\/TGRS.2022.3201145","article-title":"Local Semantic Feature Aggregation-Based Transformer for Hyperspectral Image Classification","volume":"60","author":"Tu","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, G., and Ren, P. (2020). Hyperspectral Image Classification with Feature-Oriented Adversarial Active Learning. Remote Sens., 12.","DOI":"10.3390\/rs12233879"},{"key":"ref_33","unstructured":"Oord, A.v.d., Li, Y., and Vinyals, O. (2018). Representation Learning with Contrastive Predictive Coding. arXiv."},{"key":"ref_34","unstructured":"Chen, T., Kornblith, S., Norouzi, M., and Hinton, G.E. (2020). A Simple Framework for Contrastive Learning of Visual Representations. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2628","DOI":"10.1109\/TGRS.2018.2875943","article-title":"Self-Supervised Feature Learning With CRF Embedding for Hyperspectral Image Classification","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3230829","article-title":"SC-EADNet: A Self-Supervised Contrastive Efficient Asymmetric Dilated Network for Hyperspectral Image Classification","volume":"60","author":"Zhu","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"7758","DOI":"10.1109\/TGRS.2020.3034133","article-title":"Deep Multiview Learning for Hyperspectral Image Classification","volume":"59","author":"Liu","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"5521213","DOI":"10.1109\/TGRS.2021.3139099","article-title":"Hyperspectral Imagery Classification Based on Contrastive Learning","volume":"60","author":"Hou","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"5528913","DOI":"10.1109\/TGRS.2022.3176637","article-title":"Cross-Domain Contrastive Learning for Hyperspectral Image Classification","volume":"60","author":"Guan","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Hu, X., Li, T., Zhou, T., Liu, Y., and Peng, Y. (2021). Contrastive Learning Based on Transformer for Hyperspectral Image Classification. Appl. Sci., 11.","DOI":"10.3390\/app11188670"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zhang, T., Qiu, C., Ke, W., S\u00fcsstrunk, S., and Salzmann, M. (2022, January 18\u201324). Leverage Your Local and Global Representations: A New Self-Supervised Learning Strategy. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, Louisiana.","DOI":"10.1109\/CVPR52688.2022.01608"},{"key":"ref_42","unstructured":"Karantzalos, K., Karakizi, C., Kandylakis, Z., and Antoniou, G. (2023, March 13). Hyrank Hyperspectral Satellite Dataset I. Available online: https:\/\/zenodo.org\/record\/1222202#.ZBKEwnYzaUk."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Bazi, Y., Bashmal, L., Rahhal, M.M.A., Dayil, R.A., and Ajlan, N.A. (2021). Vision Transformers for Remote Sensing Image Classification. Remote Sens., 13.","DOI":"10.3390\/rs13030516"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Xu, X., Feng, Z., Cao, C., Li, M., Wu, J., Wu, Z., Shang, Y., and Ye, S. (2021). An Improved Swin Transformer-Based Model for Remote Sensing Object Detection and Instance Segmentation. Remote Sens., 13.","DOI":"10.3390\/rs13234779"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Xu, Z., Zhang, W., Zhang, T., Yang, Z., and Li, J. (2021). Efficient Transformer for Remote Sensing Image Segmentation. Remote Sens., 13.","DOI":"10.3390\/rs13183585"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"5224713","DOI":"10.1109\/TGRS.2022.3221492","article-title":"SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection","volume":"60","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3172371","article-title":"SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers","volume":"60","author":"Hong","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"3948","DOI":"10.1080\/01431161.2019.1711242","article-title":"Unsupervised band selection based on weighted information entropy and 3D discrete cosine transform for hyperspectral image classification","volume":"41","author":"Sawant","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/j.ins.2012.07.049","article-title":"Local Shannon entropy measure with statistical tests for image randomness","volume":"222","author":"Wu","year":"2013","journal-title":"Inf. Sci."},{"key":"ref_50","first-page":"24261","article-title":"MLP-Mixer: An all-MLP Architecture for Vision","volume":"34","author":"Tolstikhin","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"5314","DOI":"10.1109\/TPAMI.2022.3206148","article-title":"ResMLP: Feedforward Networks for Image Classification With Data-Efficient Training","volume":"45","author":"Touvron","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/LGRS.2019.2918719","article-title":"HybridSN: Exploring 3-D\u20132-D CNN Feature Hierarchy for Hyperspectral Image Classification","volume":"17","author":"Roy","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"3232","DOI":"10.1109\/TGRS.2019.2951160","article-title":"Spectral\u2013Spatial Attention Network for Hyperspectral Image Classification","volume":"58","author":"Sun","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"535","DOI":"10.14358\/PERS.21-00089R3","article-title":"TPPI: A Novel Network Framework and Model for Efficient Hyperspectral Image Classification","volume":"88","author":"Chen","year":"2022","journal-title":"Photogramm. Eng. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/6\/1612\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:56:27Z","timestamp":1760122587000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/6\/1612"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,16]]},"references-count":54,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["rs15061612"],"URL":"https:\/\/doi.org\/10.3390\/rs15061612","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,16]]}}}