{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,12]],"date-time":"2025-11-12T13:56:38Z","timestamp":1762955798081,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2017,11,25]],"date-time":"2017-11-25T00:00:00Z","timestamp":1511568000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Facilities Council (STFC)","award":["ST\/N006852\/1"],"award-info":[{"award-number":["ST\/N006852\/1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Hyperspectral images (HSI) provide rich information which may not be captured by other sensing technologies and therefore gradually find a wide range of applications. However, they also generate a large amount of irrelevant or redundant data for a specific task. This causes a number of issues including significantly increased computation time, complexity and scale of prediction models mapping the data to semantics (e.g., classification), and the need of a large amount of labelled data for training. Particularly, it is generally difficult and expensive for experts to acquire sufficient training samples in many applications. This paper addresses these issues by exploring a number of classical dimension reduction algorithms in machine learning communities for HSI classification. To reduce the size of training dataset, feature selection (e.g., mutual information, minimal redundancy maximal relevance) and feature extraction (e.g., Principal Component Analysis (PCA), Kernel PCA) are adopted to augment a baseline classification method, Support Vector Machine (SVM). The proposed algorithms are evaluated using a real HSI dataset. It is shown that PCA yields the most promising performance in reducing the number of features or spectral bands. It is observed that while significantly reducing the computational complexity, the proposed method can achieve better classification results over the classic SVM on a small training dataset, which makes it suitable for real-time applications or when only limited training data are available. Furthermore, it can also achieve performances similar to the classic SVM on large datasets but with much less computing time.<\/jats:p>","DOI":"10.3390\/s17122726","type":"journal-article","created":{"date-parts":[[2017,11,27]],"date-time":"2017-11-27T11:07:08Z","timestamp":1511780828000},"page":"2726","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["Dimension Reduction Aided Hyperspectral Image Classification with a Small-sized Training Dataset: Experimental Comparisons"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3121-7208","authenticated-orcid":false,"given":"Jinya","family":"Su","sequence":"first","affiliation":[{"name":"Department of Aeronautical and Automotive Engineering, Loughborough University, Loughborough LE11 3TU, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1702-9136","authenticated-orcid":false,"given":"Dewei","family":"Yi","sequence":"additional","affiliation":[{"name":"Department of Aeronautical and Automotive Engineering, Loughborough University, Loughborough LE11 3TU, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2829-9369","authenticated-orcid":false,"given":"Cunjia","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Aeronautical and Automotive Engineering, Loughborough University, Loughborough LE11 3TU, UK"}]},{"given":"Lei","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Automation, Beihang University, Beijing 100191, China"}]},{"given":"Wen-Hua","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Aeronautical and Automotive Engineering, Loughborough University, Loughborough LE11 3TU, UK"}]}],"member":"1968","published-online":{"date-parts":[[2017,11,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep feature extraction and classification of hyperspectral images based on convolutional neural networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jin, X., Kumar, L., Li, Z., Xu, X., Yang, G., and Wang, J. (2016). Estimation of Winter Wheat Biomass and Yield by Combining the AquaCrop Model and Field Hyperspectral Data. Remote Sens., 8.","DOI":"10.3390\/rs8120972"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"20078","DOI":"10.3390\/s141120078","article-title":"A review of imaging techniques for plant phenotyping","volume":"14","author":"Li","year":"2014","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yuan, H., Yang, G., Li, C., Wang, Y., Liu, J., Yu, H., Feng, H., Xu, B., Zhao, X., and Yang, X. (2017). Retrieving Soybean Leaf Area Index from Unmanned Aerial Vehicle Hyperspectral Remote Sensing: Analysis of RF, ANN, and SVM Regression Models. Remote Sens., 9.","DOI":"10.3390\/rs9040309"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Fu, Y., Zhao, C., Wang, J., Jia, X., Yang, G., Song, X., and Feng, H. (2017). An Improved Combination of Spectral and Spatial Features for Vegetation Classification in Hyperspectral Images. Remote Sens., 9.","DOI":"10.3390\/rs9030261"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Nevalainen, O., Honkavaara, E., Tuominen, S., Viljanen, N., Hakala, T., Yu, X., Hyypp\u00e4, J., Saari, H., P\u00f6l\u00f6nen, I., and Imai, N.N. (2017). Individual tree detection and classification with UAV-based photogrammetric point clouds and hyperspectral imaging. Remote Sens., 9.","DOI":"10.3390\/rs9030185"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ghamisi, P., Plaza, J., Chen, Y., Li, J., and Plaza, A. (2017). Advanced Supervised Spectral Classifiers for Hyperspectral Images: A Review. IEEE Geosci. Remote Sens. Mag., 8\u201332.","DOI":"10.1109\/MGRS.2016.2616418"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1109\/JPROC.2012.2197589","article-title":"Advances in spectral-spatial classification of hyperspectral images","volume":"101","author":"Fauvel","year":"2013","journal-title":"Proc. IEEE"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TIT.1968.1054102","article-title":"On the mean accuracy of statistical pattern recognizers","volume":"14","author":"Hughes","year":"1968","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1793","DOI":"10.1016\/j.asr.2008.02.012","article-title":"Classification of hyperspectral remote-sensing data with primal SVM for small-sized training dataset problem","volume":"41","author":"Chi","year":"2008","journal-title":"Adv. Space Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.isprsjprs.2010.11.001","article-title":"Support vector machines in remote sensing: A review","volume":"66","author":"Mountrakis","year":"2011","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1586","DOI":"10.1109\/TGRS.2005.863297","article-title":"Independent component analysis-based dimensionality reduction with applications in hyperspectral image analysis","volume":"44","author":"Wang","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1109\/JPROC.2012.2229082","article-title":"Feature mining for hyperspectral image classification","volume":"101","author":"Jia","year":"2013","journal-title":"Proc. IEEE"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1368","DOI":"10.1109\/36.934070","article-title":"Best-bases feature extraction algorithms for classification of hyperspectral data","volume":"39","author":"Kumar","year":"2001","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","first-page":"1157","article-title":"An introduction to variable and feature selection","volume":"3","author":"Guyon","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1109\/TGRS.2014.2326655","article-title":"Hyperspectral band selection by multitask sparsity pursuit","volume":"53","author":"Yuan","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.compeleceng.2013.11.024","article-title":"A survey on feature selection methods","volume":"40","author":"Chandrashekar","year":"2014","journal-title":"Comput. Electr. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Andrew, A.M., Zakaria, A., Mad Saad, S., and Md Shakaff, A.Y. (2016). Multi-stage feature selection based intelligent classifier for classification of incipient stage fire in building. Sensors, 16.","DOI":"10.3390\/s16010031"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Mather, P.M., and Koch, M. (2011). Computer Processing of Remotely-Sensed Images: An Introduction, John Wiley & Sons.","DOI":"10.1002\/9780470666517"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.engappai.2013.07.010","article-title":"A novel approach to hyperspectral band selection based on spectral shape similarity analysis and fast branch and bound search","volume":"27","author":"Li","year":"2014","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1023\/A:1012487302797","article-title":"Gene selection for cancer classification using support vector machines","volume":"46","author":"Guyon","year":"2002","journal-title":"Mach. Learn."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1109\/TGRS.2009.2039484","article-title":"Feature selection for classification of hyperspectral data by SVM","volume":"48","author":"Pal","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1080\/01431160600771561","article-title":"Comparison between several feature extraction\/classification methods for mapping complicated agricultural land use patches using airborne hyperspectral data","volume":"28","author":"Lu","year":"2007","journal-title":"Int. J. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"S110","DOI":"10.1016\/j.rse.2007.07.028","article-title":"Recent advances in techniques for hyperspectral image processing","volume":"113","author":"Plaza","year":"2009","journal-title":"Remote Sens. Environ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2666","DOI":"10.1109\/TGRS.2013.2264508","article-title":"Spectral\u2014Spatial hyperspectral image classification with edge-preserving filtering","volume":"52","author":"Kang","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Boser, B.E., Guyon, I.M., and Vapnik, V.N. (1992, January 27\u201329). A training algorithm for optimal margin classifiers. Proceedings of the Fifth Annual Workshop on Computational Learning Theory, Pittsburgh, PA, USA.","DOI":"10.1145\/130385.130401"},{"key":"ref_27","unstructured":"Vapnik, V. (1998). Statistical Learning Theory, Wiley."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gevaert, C.M., Persello, C., and Vosselman, G. (2016). Optimizing Multiple Kernel Learning for the Classification of UAV Data. Remote Sens., 8.","DOI":"10.3390\/rs8121025"},{"key":"ref_29","unstructured":"Rifkin, R. (2017, June 25). MIT\u2014Multiclass Classification. Available online: http:\/\/www.mit.edu\/~9.520\/spring09\/Classes\/multiclass.pdf."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/S0004-3702(97)00043-X","article-title":"Wrappers for feature subset selection","volume":"97","author":"Kohavi","year":"1997","journal-title":"Artif. Intell."},{"key":"ref_31","unstructured":"Koller, D., and Sahami, M. (1996). Toward Optimal Feature Selection, Stanford InfoLab. Technical Report."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1109\/TIT.1963.1057810","article-title":"On the effectiveness of receptors in recognition systems","volume":"9","author":"Marill","year":"1963","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_33","unstructured":"Roffo, G. (arXiv, 2016). Feature Selection Library (MATLAB Toolbox), arXiv."},{"key":"ref_34","unstructured":"Gu, Q., Li, Z., and Han, J. (arXiv, 2012). Generalized fisher score for feature selection, arXiv."},{"key":"ref_35","unstructured":"Cover, T.M., and Thomas, J.A. (2012). Elements of Information Theory, John Wiley & Sons."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.csl.2013.11.004","article-title":"Feature selection methods and their combinations in high-dimensional classification of speaker likability, intelligibility and personality traits","volume":"29","author":"Pohjalainen","year":"2015","journal-title":"Comput. Speech Lang."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1109\/TPAMI.2005.159","article-title":"Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy","volume":"27","author":"Peng","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sch\u00f6lkopf, B., Smola, A., and M\u00fcller, K.R. (1997, January 8\u201310). Kernel principal component analysis. Proceedings of the International Conference on Artificial Neural Networks, Lausanne, Switzerland.","DOI":"10.1007\/BFb0020217"},{"key":"ref_39","first-page":"1","article-title":"Pattern recognition","volume":"128","author":"Bishop","year":"2006","journal-title":"Mach. Learn."},{"key":"ref_40","unstructured":"Wang, Q. (arXiv, 2012). Kernel principal component analysis and its applications in face recognition and active shape models, arXiv."},{"key":"ref_41","first-page":"115","article-title":"Principal component analysis for hyperspectral image classification","volume":"62","author":"Rodarmel","year":"2002","journal-title":"Surv. Land Inf. Sci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/12\/2726\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:51:19Z","timestamp":1760208679000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/12\/2726"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,25]]},"references-count":41,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["s17122726"],"URL":"https:\/\/doi.org\/10.3390\/s17122726","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2017,11,25]]}}}