{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T07:44:59Z","timestamp":1768549499509,"version":"3.49.0"},"reference-count":50,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2017,12,2]],"date-time":"2017-12-02T00:00:00Z","timestamp":1512172800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Although sparse multinomial logistic regression (SMLR) has provided a useful tool for sparse classification, it suffers from inefficacy in dealing with high dimensional features and manually set initial regressor values. This has significantly constrained its applications for hyperspectral image (HSI) classification. In order to tackle these two drawbacks, an extreme sparse multinomial logistic regression (ESMLR) is proposed for effective classification of HSI. First, the HSI dataset is projected to a new feature space with randomly generated weight and bias. Second, an optimization model is established by the Lagrange multiplier method and the dual principle to automatically determine a good initial regressor for SMLR via minimizing the training error and the regressor value. Furthermore, the extended multi-attribute profiles (EMAPs) are utilized for extracting both the spectral and spatial features. A combinational linear multiple features learning (MFL) method is proposed to further enhance the features extracted by ESMLR and EMAPs. Finally, the logistic regression via the variable splitting and the augmented Lagrangian (LORSAL) is adopted in the proposed framework for reducing the computational time. Experiments are conducted on two well-known HSI datasets, namely the Indian Pines dataset and the Pavia University dataset, which have shown the fast and robust performance of the proposed ESMLR framework.<\/jats:p>","DOI":"10.3390\/rs9121255","type":"journal-article","created":{"date-parts":[[2017,12,4]],"date-time":"2017-12-04T11:16:38Z","timestamp":1512386198000},"page":"1255","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Extreme Sparse Multinomial Logistic Regression: A Fast and Robust Framework for Hyperspectral Image Classification"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0281-6092","authenticated-orcid":false,"given":"Faxian","family":"Cao","sequence":"first","affiliation":[{"name":"School of Information Engineering, Guangdong University of Technology, Guangzhou 510006, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8336-5109","authenticated-orcid":false,"given":"Zhijing","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Guangdong University of Technology, Guangzhou 510006, China"}]},{"given":"Jinchang","family":"Ren","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XW, UK"}]},{"given":"Wing-Kuen","family":"Ling","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Guangdong University of Technology, Guangzhou 510006, China"}]},{"given":"Huimin","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Computer Science, Guangdong Polytechnic Normal University, Guangzhou 510640, China"},{"name":"The Guangzhou Key Laboratory of Digital Content Processing and Security Technologies, Guangzhou 510665, China"}]},{"given":"Stephen","family":"Marshall","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XW, UK"}]}],"member":"1968","published-online":{"date-parts":[[2017,12,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"S110","DOI":"10.1016\/j.rse.2007.07.028","article-title":"Recent advances in techniques for hyperspectral image processing","volume":"113","author":"Plaza","year":"2009","journal-title":"Remote Sens. Environ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4816","DOI":"10.1109\/TGRS.2012.2230268","article-title":"Generalized composite kernel framework for hyperspectral image classification","volume":"51","author":"Li","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TIT.1968.1054102","article-title":"On the mean accuracy of statistical pattern recognizers","volume":"14","author":"Hughes","year":"1968","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yu, H., Gao, L., Li, J., Li, S.S., Zhang, B., and Benediktsson, J.A. (2016). Spectral-Spatial Hyperspectral Image Classification Using Subspace-Based Support Vector Machines and Adaptive Markov Random Fields. Remote Sens., 8.","DOI":"10.3390\/rs8040355"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6663","DOI":"10.1109\/TGRS.2015.2445767","article-title":"Classification of hyperspectral images by exploiting spectral-spatial information of superpixel via multiple kernels","volume":"53","author":"Fang","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1060","DOI":"10.1109\/JSTARS.2014.2301775","article-title":"Ensemble Extreme Learning Machines for Hyperspectral Image Classification","volume":"7","author":"Samat","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1592","DOI":"10.1109\/TGRS.2014.2345739","article-title":"Multiple feature learning for hyperspectral image classification","volume":"53","author":"Li","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1109\/TGRS.2011.2162649","article-title":"Spectral\u2013spatial hyperspectral image segmentation using subspace multinomial logistic regression and Markov random fields","volume":"50","author":"Li","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","first-page":"4085","article-title":"Semisupervised hyperspectral image segmentation using multinomial logistic regression with active learning","volume":"48","author":"Li","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Li, C., Ma, Y., Mei, X., Liu, C., and Ma, J. (2016). Hyperspectral Unmixing with Robust Collaborative Sparse Regression. Remote Sens., 8.","DOI":"10.3390\/rs8070588"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1109\/MSP.2014.2312071","article-title":"Effective feature extraction and data reduction with hyperspectral imaging in remote sensing","volume":"31","author":"Ren","year":"2014","journal-title":"IEEE Signal Proc. Mag."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3906","DOI":"10.1109\/TIP.2016.2570569","article-title":"Dimension Reduction with Extreme Learning Machine","volume":"25","author":"Kasun","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4440","DOI":"10.1364\/AO.53.004440","article-title":"Structured covaciance principle component analysis for real-time onsite feature extraction and dimensionality reduction in hyperspectral imaging","volume":"53","author":"Zabalza","year":"2014","journal-title":"Appl. Opt."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.isprsjprs.2014.04.006","article-title":"Novel Folded-PCA for Improved Feature Extraction and Data Reduction with Hyperspectral Imaging and SAR in Remote Sensing","volume":"93","author":"Zabalza","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1109\/LGRS.2010.2091253","article-title":"Classification of hyperspectral images by using extended morphological attribute profiles and independent component analysis","volume":"8","author":"Villa","year":"2011","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3747","DOI":"10.1109\/TGRS.2010.2048116","article-title":"Morphological attribute profiles for the analysis of very high resolution images","volume":"48","author":"Benediktsson","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"5975","DOI":"10.1080\/01431161.2010.512425","article-title":"Extended profiles with morphological attribute filters for the analysis of hyperspectral data","volume":"31","author":"Waske","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1109\/TGRS.2016.2598065","article-title":"Effective denoising and classification of hyperspectral images using curvelet transform and singular spectrum analysis","volume":"55","author":"Qiao","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4418","DOI":"10.1109\/TGRS.2015.2398468","article-title":"Novel two dimensional singular spectrum analysis for effective feature extraction and data classification in hyperspectral imaging","volume":"53","author":"Zabalza","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.compag.2015.05.007","article-title":"Singular spectrum analysis for improving hyperspectral imaging based beef eating quality evaluation","volume":"115","author":"Qiao","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2845","DOI":"10.1109\/JSTARS.2014.2375932","article-title":"Fast implementation of singular spectrum analysis for effective feature extraction in hyperspectral imaging","volume":"8","author":"Zabalza","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2015.11.044","article-title":"Novel segmented stacked autoencoder for effective dimensionality reduction and feature extraction in hyperspectral imaging","volume":"185","author":"Zabalza","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1109\/TPAMI.2005.127","article-title":"Sparse multinomi al logistic regression: Fast algorithms and generalization bounds","volume":"27","author":"Krishnapuram","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/BF00048682","article-title":"Multinomial logistic regression algorithm","volume":"44","author":"Bohning","year":"1992","journal-title":"Ann. Inst. Stat. Math."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1109\/TGRS.2010.2059706","article-title":"Modeling and classifying hyperspectral imagery by CRFs with sparse higher order potentials","volume":"49","author":"Zhong","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1490","DOI":"10.1109\/TGRS.2014.2344442","article-title":"Supervised spectral\u2013spatial hyperspectral image classification with weighted Markov random fields","volume":"53","author":"Sun","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1456","DOI":"10.1109\/LGRS.2015.2408433","article-title":"Real-Time Implementation of the Sparse Multinomial Logistic Regression for Hyperspectral Image Classification on GPUs","volume":"12","author":"Wu","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/0893-6080(88)90014-7","article-title":"Neocognitron: A hierarchical neural network capable of visual pattern recognition","volume":"1","author":"Fukushima","year":"1988","journal-title":"Neural Netw."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Makantasis, K., Karantzalos, K., Doulamis, A., and Doulamis, N. (2015, January 26\u201331). Deep supervised learning for hyperspectral data classification through convolutional neural networks. Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7326945"},{"key":"ref_30","unstructured":"Huang, G.B., Zhu, Q.Y., and Siew, C.K. (2004, January 25\u201329). Extreme learning machine: A new learning scheme of feedforward neural networks. Proceedings of the 2004 IEEE International Joint Conference on Neural Networks, Budapest, Hungary."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1109\/TSMCB.2011.2168604","article-title":"Extreme learning machine for regression and multiclass classification","volume":"42","author":"Huang","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/s13042-011-0019-y","article-title":"Extreme learning machines: A survey","volume":"2","author":"Huang","year":"2011","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1109\/18.661502","article-title":"The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network","volume":"44","author":"Bartlett","year":"1998","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2351","DOI":"10.1109\/JSTARS.2014.2359965","article-title":"Extreme learning machine with composite kernels for hyperspectral image classification","volume":"8","author":"Zhou","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Goodman, E., and Ventura, D. (2006, January 16\u201321). Spatiotemporal pattern recognition via liquid state machines. Proceedings of the 2006 IEEE International Joint Conference on Neural Networks, Vancouver, BC, Canada.","DOI":"10.1109\/IJCNN.2006.246880"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1109\/TNN.2010.2089641","article-title":"Minimum complexity echo state network","volume":"22","author":"Rodan","year":"2011","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1126\/science.1091277","article-title":"Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication","volume":"304","author":"Jaeger","year":"2004","journal-title":"Science"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1229","DOI":"10.1109\/TCYB.2015.2434841","article-title":"Inverse-free extreme learning machine with optimal information updating","volume":"46","author":"Li","year":"2016","journal-title":"IEEE Trans. Cybern."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"4768","DOI":"10.1109\/TGRS.2015.2409195","article-title":"Random subspace ensembles for hyperspectral image classification with extended morphological attribute profiles","volume":"53","author":"Xia","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1109\/TGRS.2004.842478","article-title":"Classification of hyperspectral data from urban areas based on extended morphological profiles","volume":"43","author":"Benediktsson","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"856","DOI":"10.1109\/JSTSP.2012.2208177","article-title":"Classification of remote sensing optical and LiDAR data using extended attribute profiles","volume":"6","author":"Pedergnana","year":"2012","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1109\/LGRS.2012.2203784","article-title":"Automatic generation of standard deviation attribute profiles for spectral\u2013spatial classification of remote sensing data","volume":"10","author":"Marpu","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1007\/BF00049423","article-title":"Monotonicity of quadratic-approximation algorithms","volume":"40","author":"Bohning","year":"1988","journal-title":"Ann. Inst. Stat. Math."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1220","DOI":"10.1109\/72.536316","article-title":"A rapid supervised learning neural network for function interpolation and approximation","volume":"7","author":"Chen","year":"1996","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_45","unstructured":"Bioucas-Dias, J., and Figueiredo, M. (2009). Logistic Regression via Variable Splitting and Augmented Lagrangian Tools, Instituto Superior Tecnico, TULisbon."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1961189.1961199","article-title":"LIBSVM: A library for support vector machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Trans. Intell. Syst. Technol. (TIST)"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"3639","DOI":"10.1109\/TGRS.2016.2636241","article-title":"Deep Recurrent Neural Networks for Hyperspectral Image Classification","volume":"55","author":"Mou","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_48","first-page":"171","article-title":"Critical values and probability levels for the Wilcoxon rank sum test and the Wilcoxon signed rank test","volume":"1","author":"Wilcoxon","year":"1970","journal-title":"Sel. Tables Math. Stat."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1563","DOI":"10.1109\/JSTARS.2016.2621416","article-title":"Ideal Regularized Composite Kernel for Hyperspectral Image Classification","volume":"10","author":"Peng","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_50","unstructured":"Grant, M., and Boyd, S. (2013). CVX: Matlab Software for Disciplined Convex Programming, version 2.0, CVX Research, Inc."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/12\/1255\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:52:23Z","timestamp":1760208743000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/12\/1255"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,2]]},"references-count":50,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["rs9121255"],"URL":"https:\/\/doi.org\/10.3390\/rs9121255","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,12,2]]}}}