{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T14:07:08Z","timestamp":1760710028320,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2019,10,22]],"date-time":"2019-10-22T00:00:00Z","timestamp":1571702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61901198","61871306"],"award-info":[{"award-number":["61901198","61871306"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Doctoral Scientific Research Foundation of Jiangxi University of Science and Technology","award":["jxxjbs19006"],"award-info":[{"award-number":["jxxjbs19006"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Filter banks transferred from a pre-trained deep convolutional network exhibit significant performance in heightening the inter-class separability for hyperspectral image feature extraction, but weakening the intra-class consistency simultaneously. In this paper, we propose a new superpixel-based relational auto-encoder for cohesive spectral\u2013spatial feature learning. Firstly, multiscale local spatial information and global semantic features of hyperspectral images are extracted by filter banks transferred from the pre-trained VGG-16. Meanwhile, we utilize superpixel segmentation to construct the low-dimensional manifold embedded in the spectral domain. Then, representational consistency constraint among each superpixel is added in the objective function of sparse auto-encoder, which iteratively assist and supervisedly learn hidden representation of deep spatial feature with greater cohesiveness. Superpixel-based local consistency constraint in this work not only reduces the computational complexity, but builds the neighborhood relationships adaptively. The final feature extraction is accomplished by collaborative encoder of spectral\u2013spatial feature and weighting fusion of multiscale features. A large number of experimental results demonstrate that our proposed method achieves expected results in discriminant feature extraction and has certain advantages over some existing methods, especially on extremely limited sample conditions.<\/jats:p>","DOI":"10.3390\/rs11202454","type":"journal-article","created":{"date-parts":[[2019,10,23]],"date-time":"2019-10-23T11:46:59Z","timestamp":1571831219000},"page":"2454","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["A Superpixel-Based Relational Auto-Encoder for Feature Extraction of Hyperspectral Images"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4289-7114","authenticated-orcid":false,"given":"Miaomiao","family":"Liang","sequence":"first","affiliation":[{"name":"School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou 341000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Licheng","family":"Jiao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2364-2749","authenticated-orcid":false,"given":"Zhe","family":"Meng","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep learning for remote sensing data: A technical tutorial on the state of the art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_2","unstructured":"Jiao, L., Zhao, J., Yang, S., and Liu, F. (2017). Deep learning, Optimization and Recognition, Tsinghua University Press."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2015\/258619","article-title":"Deep convolutional neural networks for hyperspectral image classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep feature extraction and classification of hyperspectral images based on convolutional neural networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/JSTARS.2014.2329330","article-title":"Deep learning-based classification of hyperspectral data","volume":"7","author":"Chen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_6","first-page":"1","article-title":"Stacked denoise autoencoder based feature extraction and classification for hyperspectral images","volume":"2016","author":"Xing","year":"2016","journal-title":"J. Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2015.11.044","article-title":"Novel segmented stacked autoencoder for effective dimensionality reduction and feature extraction in hyperspectral imaging","volume":"185","author":"Zabalza","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/s00500-016-2246-3","article-title":"Spectral\u2013spatial multi-feature-based deep learning for hyperspectral remote sensing image classification","volume":"21","author":"Wang","year":"2017","journal-title":"Soft Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3273","DOI":"10.1109\/TIP.2016.2567069","article-title":"Wishart deep stacking network for fast POLSAR image classification","volume":"25","author":"Jiao","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2402","DOI":"10.1109\/TCYB.2017.2739338","article-title":"Fuzzy Sparse Autoencoder Framework for Single Image Per Person Face Recognition","volume":"48","author":"Guo","year":"2018","journal-title":"IEEE Trans. Cybern."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2381","DOI":"10.1109\/JSTARS.2015.2388577","article-title":"Spectral\u2013spatial classification of hyperspectral data based on deep belief network","volume":"8","author":"Chen","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3516","DOI":"10.1109\/TGRS.2017.2675902","article-title":"Learning to diversify deep belief networks for hyperspectral image classification","volume":"55","author":"Zhong","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3292","DOI":"10.1109\/TGRS.2016.2514504","article-title":"POL-SAR Image Classification Based on Wishart DBN and Local Spatial Information","volume":"54","author":"Liu","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1016\/j.patcog.2016.05.028","article-title":"Discriminant deep belief network for high-resolution SAR image classification","volume":"61","author":"Zhao","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1667","DOI":"10.1109\/TCYB.2015.2453359","article-title":"Learning Hierarchical Spectral-Spatial Features for Hyperspectral Image Classification","volume":"46","author":"Zhou","year":"2017","journal-title":"IEEE Trans. Cybern."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5046","DOI":"10.1109\/TGRS.2018.2805286","article-title":"Generative Adversarial Networks for Hyperspectral Image Classification","volume":"56","author":"Zhu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.isprsjprs.2017.11.003","article-title":"MugNet: Deep learning for hyperspectral image classification using limited samples","volume":"145","author":"Pan","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5293","DOI":"10.1109\/TGRS.2017.2705073","article-title":"BASS Net: Band-adaptive spectral\u2013spatial feature learning neural network for hyperspectral image classification","volume":"55","author":"Santara","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3173","DOI":"10.1109\/TGRS.2018.2794326","article-title":"Hyperspectral image classification with deep feature fusion network","volume":"56","author":"Song","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"5585","DOI":"10.1109\/TGRS.2017.2710079","article-title":"Deep fully convolutional network-based spatial distribution prediction for hyperspectral image classification","volume":"55","author":"Jiao","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"4520","DOI":"10.1109\/TGRS.2017.2693346","article-title":"Learning sensor-specific spatial\u2013spectral features of hyperspectral images via convolutional neural networks","volume":"55","author":"Mei","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","unstructured":"Lin, Z., Chen, Y., Zhao, X., and Wang, G. (2013, January 10\u201313). Spectral\u2013spatial classification of hyperspectral image using autoencoders. Proceedings of the International Conference on Information, Communications & Signal Processing (ICICS), Tainan, Taiwan."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1928","DOI":"10.1109\/LGRS.2017.2737823","article-title":"Recursive Autoencoders-Based Unsupervised Feature Learning for Hyperspectral Image Classification","volume":"14","author":"Zhang","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2354","DOI":"10.1109\/TIP.2018.2799324","article-title":"Hyperspectral image classification with Markov random fields and a convolutional neural network","volume":"27","author":"Cao","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4729","DOI":"10.1109\/TGRS.2017.2698503","article-title":"Learning and Transferring Deep Joint Spectral\u2013Spatial Features for Hyperspectral Classification","volume":"55","author":"Yang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"14680","DOI":"10.3390\/rs71114680","article-title":"Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery","volume":"7","author":"Hu","year":"2015","journal-title":"Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1007\/BF01272517","article-title":"On the power of small-depth threshold circuits","volume":"1","author":"Hastad","year":"1991","journal-title":"Comput. Complex."},{"key":"ref_28","unstructured":"Li, L., Zhang, T., Shan, C., and Liu, Z. (2018). Deep Learning: Mastering Convolutional Neural Networks from Beginner, China Machine Press."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Makantasis, K., Karantzalos, K., Doulamis, A., and Doulamis, N. (2015, January 26\u201331). Deep supervised learning for hyperspectral data classification through convolutional neural networks. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7326945"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1080\/2150704X.2015.1047045","article-title":"Spectral\u2014Spatial classification of hyperspectral images using deep convolutional neural networks","volume":"6","author":"Yue","year":"2015","journal-title":"Remote Sens. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Lee, H., and Kwon, H. (2016, January 10\u201315). Contextual deep CNN based hyperspectral classification. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.","DOI":"10.1109\/IGARSS.2016.7729859"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2911","DOI":"10.1109\/JSTARS.2018.2836671","article-title":"Deep Multiscale Spectral-Spatial Feature Fusion for Hyperspectral Images Classification","volume":"11","author":"Liang","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_33","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Maaten","year":"2008","journal-title":"J. Mach. Learn. Research"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2839","DOI":"10.1109\/TIP.2016.2605010","article-title":"Graph regularized auto-encoders for image representation","volume":"26","author":"Liao","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Liu, M.Y., Tuzel, O., Ramalingam, S., and Chellappa, R. (2011, January 20\u201325). Entropy rate superpixel segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995323"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TGRS.2004.831865","article-title":"Classification of hyperspectral remote sensing images with support vector machines","volume":"42","author":"Melgani","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3742","DOI":"10.1109\/TGRS.2013.2275613","article-title":"Feature extraction of hyperspectral images with image fusion and recursive filtering","volume":"52","author":"Kang","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2241","DOI":"10.1109\/TGRS.2014.2358615","article-title":"Intrinsic image decomposition for feature extraction of hyperspectral images","volume":"53","author":"Kang","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/20\/2454\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:28:25Z","timestamp":1760189305000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/20\/2454"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,22]]},"references-count":38,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["rs11202454"],"URL":"https:\/\/doi.org\/10.3390\/rs11202454","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2019,10,22]]}}}