{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:05:06Z","timestamp":1760241906842,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2018,10,10]],"date-time":"2018-10-10T00:00:00Z","timestamp":1539129600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["Grant 61503400, 61375050 and 91220301"],"award-info":[{"award-number":["Grant 61503400, 61375050 and 91220301"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Extreme learning machine (ELM), characterized by its fast learning efficiency and great generalization ability, has been applied to various object recognition tasks. When extended to the stacked autoencoder network, which is a typical symmetrical representation learning model architecture, ELM manages to realize hierarchical feature extraction and classification, which is what deep neural networks usually do, but with much less training time. Nevertheless, the input weights and biases of the hidden nodes in ELM are generated according to a random distribution and may lead to the occurrence of non-optimal and redundant parameters that deteriorate discriminative features, which will have a bad influence on the final classification effect. In this paper, a novel sparse autoencoder derived from ELM and differential evolution is proposed and integrated into a hierarchical hybrid autoencoder network to accomplish the end-to-end learning with raw visible light camera sensor images and applied to several typical object recognition problems. Experimental results show that the proposed method is able to obtain competitive or better performance than current relevant methods with acceptable or less time consumption.<\/jats:p>","DOI":"10.3390\/sym10100474","type":"journal-article","created":{"date-parts":[[2018,10,10]],"date-time":"2018-10-10T11:53:13Z","timestamp":1539172393000},"page":"474","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Evolutionary Hierarchical Sparse Extreme Learning Autoencoder Network for Object Recognition"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5765-684X","authenticated-orcid":false,"given":"Yujun","family":"Zeng","sequence":"first","affiliation":[{"name":"College of Intelligence Science, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lilin","family":"Qian","sequence":"additional","affiliation":[{"name":"College of Intelligence Science, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junkai","family":"Ren","sequence":"additional","affiliation":[{"name":"College of Intelligence Science, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,10,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000006","article-title":"Learning deep architectures for AI","volume":"2","author":"Bengio","year":"2009","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","article-title":"Representation learning: A review and new perspectives","volume":"35","author":"Bengio","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1109\/TASL.2011.2134090","article-title":"Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition","volume":"20","author":"Dahl","year":"2012","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Graves, A., Mohamed, A.R., and Hinton, G. (2013, January 26\u201331). Speech recognition with deep recurrent neural networks. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6638947"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Jarrett, K., Kavukcuoglu, K., and LeCun, Y. (October, January 29). What is the best multi-stage architecture for object recognition?. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan.","DOI":"10.1109\/ICCV.2009.5459469"},{"key":"ref_8","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the Neural Information and Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_9","first-page":"97","article-title":"Unsupervised and transfer learning challenge: A deep learning approach","volume":"7","author":"Mesnil","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_10","first-page":"17","article-title":"Deep learning of representations for unsupervised and transfer learning","volume":"27","author":"Bengio","year":"2012","journal-title":"J. Mach. Learn. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/j.neucom.2005.12.126","article-title":"Extreme learning machine: Theory and applications","volume":"70","author":"Huang","year":"2006","journal-title":"Neurocomputing"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1007\/s12559-014-9255-2","article-title":"An insight into extreme learning machines: Random neurons, random features and kernels","volume":"6","author":"Huang","year":"2014","journal-title":"Cognit. Comput."},{"key":"ref_13","unstructured":"Huang, G.B., Zhu, Q.Y., and Siew, C.K. (2004, January 25\u201329). Extreme learning machine: A new learning scheme of feedforward neural networks. Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN2004), Budapest, Hungary."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1109\/TSMCB.2011.2168604","article-title":"Extreme learning machine for regression and multiclass classification","volume":"42","author":"Huang","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. B"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"920","DOI":"10.1109\/TCYB.2016.2533424","article-title":"An Efficient Method for Traffic Sign Recognition Based on Extreme Learning Machine","volume":"47","author":"Huang","year":"2017","journal-title":"IEEE Trans. Cybern."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zeng, Y., Xu, X., Fang, Y., and Zhao, K. (2015, January 14\u201316). Traffic sign recognition using deep convolutional networks and extreme learning machine. Proceedings of the International Conference on Intelligent Science and Big Data Engineering, Suzhou, China.","DOI":"10.1007\/978-3-319-23989-7_28"},{"key":"ref_17","first-page":"1647","article-title":"Traffic sign recognition using kernel extreme learning machines with deep perceptual features","volume":"18","author":"Zeng","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_18","first-page":"194","article-title":"Deep object recognition across domains based on adaptive extreme learning machine","volume":"239","author":"Zhang","year":"2017","journal-title":"Neural Comput."},{"key":"ref_19","first-page":"31","article-title":"Representational learning with extreme learning machine for big data","volume":"28","author":"Kasun","year":"2013","journal-title":"IEEE Intell. Syst."},{"key":"ref_20","first-page":"42","article-title":"Deep extreme learning machines: Supervised autoencoding architecture for classification","volume":"174","author":"Tissera","year":"2016","journal-title":"Neural Comput."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1137\/080716542","article-title":"A fast iterative shrinkage-thresholding algorithm for linear inverse problems","volume":"2","author":"Beck","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1109\/TNNLS.2015.2424995","article-title":"Extreme learning machine for multilayer perceptron","volume":"27","author":"Tang","year":"2016","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-Based Learning Applied to Document Recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_24","unstructured":"LeCun, Y., Huang, F.J., and Bottou, L. (July, January 27). Learning Methods for Generic Object Recognition with Invariance to Pose and Lighting. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1023\/A:1008202821328","article-title":"Differential evolution\u2013A simple and efficient heuristic for global optimization over continuous spaces","volume":"11","author":"Storn","year":"1997","journal-title":"J. Glob. Optim."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1109\/TNN.2006.875977","article-title":"Universal approximation using incremental constructive feedforward networks with random hidden nodes","volume":"17","author":"Huang","year":"2006","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1759","DOI":"10.1016\/j.patcog.2005.03.028","article-title":"Evolutionary extreme learning machine","volume":"38","author":"Zhu","year":"2005","journal-title":"Pattern Recognit."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MCI.2015.2405316","article-title":"Local receptive fields based extreme learning machine","volume":"10","author":"Huang","year":"2015","journal-title":"IEEE Comput. Intell. Mag."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1109\/18.661502","article-title":"The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network","volume":"44","author":"Bartlett","year":"1998","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P.A. (2008, January 5\u20139). Extracting and Composing Robust Features with Denoising Autoencoders. Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland.","DOI":"10.1145\/1390156.1390294"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","article-title":"A fast learning algorithm for deep belief nets","volume":"18","author":"Hinton","year":"2006","journal-title":"Neural Comput."},{"key":"ref_32","unstructured":"Salakhutdinov, R., and Larochelle, H. (2009, January 16\u201318). Deep Boltzmann machines. Proceedings of the Twelfth International Conference on Artificial Intelligence and Statistics, Clearwater Beach, FL, USA."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/j.neunet.2012.02.016","article-title":"Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition","volume":"32","author":"Stallkamp","year":"2012","journal-title":"Neural Netw."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zaklouta, F., Stanciulescu, B., and Hamdoun, O. (August, January 31). Traffic sign classification using K-d trees and random forests. Proceedings of the 2011 International Joint Conference on Neural Networks, San Jose, CA, USA.","DOI":"10.1109\/IJCNN.2011.6033494"},{"key":"ref_35","first-page":"153","article-title":"Application of BW-ELM model on traffic sign recognition","volume":"29","author":"Sun","year":"2014","journal-title":"Neural Comput."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/10\/10\/474\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:24:47Z","timestamp":1760196287000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/10\/10\/474"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,10]]},"references-count":35,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2018,10]]}},"alternative-id":["sym10100474"],"URL":"https:\/\/doi.org\/10.3390\/sym10100474","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2018,10,10]]}}}