{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T11:32:10Z","timestamp":1777462330449,"version":"3.51.4"},"reference-count":55,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2020,11,9]],"date-time":"2020-11-09T00:00:00Z","timestamp":1604880000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper proposes a novel data classification framework, combining sparse auto-encoders (SAEs) and a post-processing system consisting of a linear system model relying on Particle Swarm Optimization (PSO) algorithm. All the sensitive and high-level features are extracted by using the first auto-encoder which is wired to the second auto-encoder, followed by a Softmax function layer to classify the extracted features obtained from the second layer. The two auto-encoders and the Softmax classifier are stacked in order to be trained in a supervised approach using the well-known backpropagation algorithm to enhance the performance of the neural network. Afterwards, the linear model transforms the calculated output of the deep stacked sparse auto-encoder to a value close to the anticipated output. This simple transformation increases the overall data classification performance of the stacked sparse auto-encoder architecture. The PSO algorithm allows the estimation of the parameters of the linear model in a metaheuristic policy. The proposed framework is validated by using three public datasets, which present promising results when compared with the current literature. Furthermore, the framework can be applied to any data classification problem by considering minor updates such as altering some parameters including input features, hidden neurons and output classes.<\/jats:p>","DOI":"10.3390\/s20216378","type":"journal-article","created":{"date-parts":[[2020,11,10]],"date-time":"2020-11-10T14:10:41Z","timestamp":1605017441000},"page":"6378","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["A Novel Framework Using Deep Auto-Encoders Based Linear Model for Data Classification"],"prefix":"10.3390","volume":"20","author":[{"given":"Ahmad M.","family":"Karim","sequence":"first","affiliation":[{"name":"Computer Engineering Department, AYBU, Ankara 06830, Turkey"}]},{"given":"Hilal","family":"Kaya","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, AYBU, Ankara 06830, Turkey"}]},{"given":"Mehmet Serdar","family":"G\u00fczel","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, Ankara University, Ankara 06830, Turkey"}]},{"given":"Mehmet R.","family":"Tolun","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, Konya Food and Agriculture University, Konya 42080, Turkey"}]},{"given":"Fatih V.","family":"\u00c7elebi","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, AYBU, Ankara 06830, Turkey"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1275-2050","authenticated-orcid":false,"given":"Alok","family":"Mishra","sequence":"additional","affiliation":[{"name":"Faculty of Logistics, Molde University College-Specialized University in Logistics, 6402 Molde, Norway"},{"name":"Software Engineering Department, Atilim University, Ankara 06830, Turkey"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,9]]},"reference":[{"key":"ref_1","first-page":"184","article-title":"The Differences and Similarities between Two-Sample t-test and Paired t-test","volume":"29","author":"Xu","year":"2017","journal-title":"Shanghai Arch. Psychiatry"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2295","DOI":"10.1109\/JPROC.2017.2761740","article-title":"Efficient Processing of Deep Neural Networks: A Tutorial and Survey","volume":"105","author":"Sze","year":"2017","journal-title":"Proc. IEEE"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Luckow, A., Cook, M., Ashcraft, N., Weill, E., Djerekarov, E., and Vorster, B. (2016, January 5\u20138). Deep learning in the automotive industry: Applications and tools. Proceedings of the 2016 IEEE International Conference on Big Data (Big Data), Washington, DC, USA.","DOI":"10.1109\/BigData.2016.7841045"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Memisevic, R. (2015, January 22\u201325). Deep learning: Architectures, algorithms, applications. Proceedings of the 2015 IEEE Hot Chips 27 Symposium (HCS), Cupertino, CA, USA.","DOI":"10.1109\/HOTCHIPS.2015.7477319"},{"key":"ref_5","first-page":"228","article-title":"Alzheimer\u2019s disease: Early diagnosis and treatment","volume":"18","author":"Chu","year":"2012","journal-title":"Hong Kong Med. J."},{"key":"ref_6","unstructured":"Pushkar, B., and Paul, M. (2016, January 21\u201322). Early Diagnosis of Alzheimer\u2019s Disease: A Multi\u2014Class Deep Learning Framework with Modified k- sparse Autoencoder Classification. Proceedings of the 2016 International Conference on Image and Vision Computing New Zealand (IVCNZ), Palmerston North, New Zealand."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.infsof.2017.11.008","article-title":"Software defect prediction using stacked denoising autoencoders and two-stage ensemble learning","volume":"96","author":"Tong","year":"2018","journal-title":"Inf. Softw. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kuo, J.Y., Pan, C.W., and Lei, B. (2017, January 11\u201313). Using stacked denoising autoencoder for the student droupout predication. Proceedings of the 2017 IEEE International Symposium on Multimedia (ISM), Taichung, Taiwan.","DOI":"10.1109\/ISM.2017.96"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.cageo.2015.10.006","article-title":"Recognition of geochemical anomalies using a deep autoencoder network","volume":"86","author":"Xiong","year":"2016","journal-title":"Comput. Geosci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Salaken, S.M., Khosravi, A., Khatami, A., Nahavandi, S., and Hosen, M.A. (May, January 30). Lung cancer classification using deep learned features on low population dataset. Proceedings of the 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE), Windsor, ON, Canada.","DOI":"10.1109\/CCECE.2017.7946700"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/LSENS.2017.2787651","article-title":"A Fingerprint Method for Indoor Localization Using Autoencoder Based Deep Extreme Learning Machine","volume":"2","author":"Khatab","year":"2017","journal-title":"IEEE Sens. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Khan, U.M., Kabir, Z., Hassan, S.A., and Ahmed, S.H. (2017, January 4\u20138). A Deep Learning Framework Using Passive Wi-Fi Sensing for Respiration Monitoring. Proceedings of the GLOBECOM 2017\u20142017 IEEE Global Communications Conference, Singapore.","DOI":"10.1109\/GLOCOM.2017.8255027"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.patrec.2017.05.025","article-title":"Using line segments to train multi-stream stacked autoencoders for image classification","volume":"94","author":"Tang","year":"2017","journal-title":"Pattern Recognit. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"21954","DOI":"10.1109\/ACCESS.2017.2762418","article-title":"A Deep Learning Approach for Intrusion Detection Using Recurrent Neural Networks","volume":"5","author":"Yin","year":"2017","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1109\/JBHI.2017.2705031","article-title":"A Deep Convolutional Neural Network-Based Framework for Automatic Fetal Facial Standard Plane Recognition","volume":"22","author":"Yu","year":"2017","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Srinivas, M., Bharath, R., Rajalakshmi, P., and Mohan, C.K. (2015, January 14\u201317). Multi-level classification: A generic classification method for medical datasets. Proceedings of the 2015 17th International Conference on E-health Networking, Application & Services (HealthCom), Boston, MA, USA.","DOI":"10.1109\/HealthCom.2015.7454509"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.cmpb.2004.10.009","article-title":"Classification of EEG signals using neural network and logistic regression","volume":"78","author":"Subasi","year":"2005","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1084","DOI":"10.1016\/j.eswa.2006.02.005","article-title":"EEG signal classification using wavelet feature extraction and a mixture of expert model","volume":"32","author":"Subasi","year":"2007","journal-title":"Expert Syst. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.cmpb.2005.06.012","article-title":"Entropies for detection of epilepsy in EEG","volume":"80","author":"Kannathal","year":"2005","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"80510","DOI":"10.1155\/2007\/80510","article-title":"Automatic Seizure Detection Based on Time-Frequency Analysis and Artificial Neural Networks","volume":"2007","author":"Tzallas","year":"2007","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1017","DOI":"10.1016\/j.amc.2006.09.022","article-title":"Classification of epileptiform EEG using a hybrid system based on decision tree classifier and fast Fourier transform","volume":"187","author":"Polat","year":"2007","journal-title":"Appl. Math. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"9072","DOI":"10.1016\/j.eswa.2012.02.040","article-title":"Use of principal component analysis for automatic classification of epileptic EEG activities in wavelet framework","volume":"39","author":"Acharya","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1250002","DOI":"10.1142\/S0129065712500025","article-title":"Application of non-linear and wavelet based features for the automated identification of epileptic EEG signals","volume":"22","author":"Acharya","year":"2012","journal-title":"Int. J. Neural Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1109\/JBHI.2014.2387795","article-title":"A Novel Method for Automated Diagnosis of Epilepsy Using Complex-Valued Classifiers","volume":"20","author":"Peker","year":"2015","journal-title":"IEEE J. Biomed. Heal. Inform."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3145947","DOI":"10.1155\/2018\/3145947","article-title":"A New Generalized Deep Learning Framework Combining Sparse Autoencoder and Taguchi Method for Novel Data Classification and Processing","volume":"2018","author":"Karim","year":"2018","journal-title":"Math. Probl. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.bbe.2018.11.004","article-title":"A new framework using deep auto-encoder and energy spectral density for medical waveform data classification and processing","volume":"39","author":"Karim","year":"2019","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Niazi, K.A.K., Khan, S.A., Shaukat, A., and Akhtar, M. (2015, January 28\u201330). Identifying best feature subset for cardiac arrhythmia classification. Proceedings of the 2015 Science and Information Conference (SAI), London, UK.","DOI":"10.1109\/SAI.2015.7237188"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Mustaqeem, A., Anwar, S.M., Majid, M., and Khan, A.R. (2017, January 11\u201315). Wrapper method for feature selection to classify cardiac arrhythmia. Proceedings of the 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Seogwipo, Korea.","DOI":"10.1109\/EMBC.2017.8037650"},{"key":"ref_29","first-page":"253","article-title":"Diagnosis of cardiac arrhythmia using kernel difference weighted KNN classifier","volume":"35","author":"Zuo","year":"2008","journal-title":"Comput. Cardiol."},{"key":"ref_30","unstructured":"Jadhav, S.M., Nalbalwar, S.L., and Ghatol, A.A. (December, January 30). ECG arrhythmia classification using modular neural network model. Proceedings of the IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), Kuala Lumpur, Malaysi."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Persada, A.G., Setiawan, N.A., and Nugroho, H. (2013, January 7\u20138). Comparative study of attribute reduction on arrhythmia classification dataset. Proceedings of the International Conference on Information Technology and Electrical Engineering (ICITEE), Yogyakarta, Indonesia.","DOI":"10.1109\/ICITEED.2013.6676213"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Jadhav, S.M., Nalbalwar, S.L., and Ghatol, A. (2010, January 1\u20133). Artificial Neural Network based cardiac arrhythmia classification using ECG signal data. Proceedings of the International Conference on Electronics and Information Engineering, Kyoto, Japan.","DOI":"10.1109\/ICEIE.2010.5559887"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Jadhav, S.M., Nalbalwar, S.L., and Ghatol, A.A. (2011, January 20\u201322). Artificial Neural Network Based Cardiac Arrhythmia Disease Diagnosis. Proceedings of the International Conference on Process. Automation, Control. and Computing, Coimbatore, India.","DOI":"10.1109\/PACC.2011.5979000"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kohli, N., Verma, N.K., and Roy, A. (2010, January 17\u201319). SVM based methods for arrhythmia classification in ECG. Proceedings of the International Conference on Computer and Communication Technology (ICCCT), Allahabad, India.","DOI":"10.1109\/ICCCT.2010.5640480"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.compbiomed.2011.03.001","article-title":"Random forests ensemble classifier trained with data resampling strategy to improve cardiac arrhythmia diagnosis","volume":"41","year":"2011","journal-title":"Comput. Biol. Med."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1007\/s10916-005-6133-1","article-title":"Artificial Neural Network Based Epileptic Detection Using Time-Domain and Frequency-Domain Features","volume":"29","author":"Srinivasan","year":"2005","journal-title":"J. Med. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wei, J., Yu, H., and Wang, J. (2013, January 23\u201325). The research of Bayesian method from small sample of high-dimensional dataset in poison identification. Proceedings of the IEEE 4th International Conference on Software Engineering and Service Science, Beijing, China.","DOI":"10.1109\/ICSESS.2013.6615404"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3343","DOI":"10.1016\/j.eswa.2013.11.025","article-title":"Density weighted support vector data description","volume":"41","author":"Cha","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1007\/s10115-012-0484-y","article-title":"SVDD-based outlier detection on uncertain data","volume":"34","author":"Liu","year":"2013","journal-title":"Knowl. Inf. Syst."},{"key":"ref_40","first-page":"172","article-title":"Improved kNearest Neighbors Transductive Confidence Machine for Pattern Recognition","volume":"3","author":"Cui","year":"2010","journal-title":"IEEE Int. Conf. Comput. Des. Appl."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1016\/j.ijar.2011.03.001","article-title":"Core-generating approximate minimum entropy discretization for rough set feature selection in pattern classification","volume":"52","author":"Tian","year":"2011","journal-title":"Int. J. Approx. Reason."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1016\/j.neucom.2017.08.043","article-title":"Facial expression recognition via learning deep sparse autoencoders","volume":"273","author":"Zeng","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_43","unstructured":"Kennedy, J., and Eberhart, R. (December, January 27). Particle swarm optimization. Proceedings of the IEEE International Conference on Neural Networks (ICNN\u201995), Perth, Australia."},{"key":"ref_44","unstructured":"Harman, R. (1995). A Very Brief Introduction to Particle Swarm Optimization, Department of Applied Mathematics and Statistics. Technical Report."},{"key":"ref_45","first-page":"1","article-title":"A new probabilistic particle swarm optimization algorithm for size optimization of spatial truss structures","volume":"12","author":"Kaveh","year":"2014","journal-title":"Int. J. Civ. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2744","DOI":"10.1109\/TCYB.2018.2834390","article-title":"Deep Neuro-Cognitive Co-Evolution for Fuzzy Attribute Reduction by Quantum Leaping PSO With Nearest-Neighbor Memeplexes","volume":"49","author":"Ding","year":"2018","journal-title":"IEEE Trans. Cybern."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1177\/1059712316685875","article-title":"An adaptive framework for mobile robot navigation","volume":"25","author":"Serdar","year":"2017","journal-title":"Adapt. Behav."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Rizvi, S.Z., Abbasi, F., and Velni, J.M. (2018, January 27). Model Reduction in Linear Parameter-Varying Models using Autoencoder Neural Networks. Proceedings of the Annual American Control Conference (ACC), Milwaukee, WI, USA.","DOI":"10.23919\/ACC.2018.8431912"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.eswa.2015.12.012","article-title":"A linear model based on Kalman filter for improving neural network classification performance","volume":"49","author":"Siswantoro","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jmp.2018.03.008","article-title":"Parameter estimation of the Linear Phase Correction model by hierarchical linear models","volume":"84","author":"Noy","year":"2018","journal-title":"J. Math. Psychol."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"061907","DOI":"10.1103\/PhysRevE.64.061907","article-title":"Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: Dependence on recording region and brain state","volume":"64","author":"Andrzejak","year":"2001","journal-title":"Phys. Rev. E"},{"key":"ref_52","unstructured":"Dua, D., and Karra, T. (2017). Machine Learning Repository, School of Information and Computer Sciences, University of California. Available online: http:\/\/archive.ics.uci.edu\/ml."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Xu, G., and Fang, W. (2016, January 16\u201318). Shape retrieval using deep autoencoder learning representation. Proceedings of the 13th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China.","DOI":"10.1109\/ICCWAMTIP.2016.8079843"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"540","DOI":"10.4097\/kjae.2015.68.6.540","article-title":"T test as a parametric statistic","volume":"68","author":"Kim","year":"2015","journal-title":"Korean J. Anesthesiol."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Kumar, R., Chen, T., Hardt, M., Beymer, D., Brannon, K., and Syeda-Mahmood, T. (2013, January 7). Multiple Kernel Completion and its application to cardiac disease discrimination. Proceedings of the IEEE 10th International Symposium on Biomedical Imaging, San Francisco, CA, USA.","DOI":"10.1109\/ISBI.2013.6556587"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/21\/6378\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:30:59Z","timestamp":1760178659000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/21\/6378"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,9]]},"references-count":55,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["s20216378"],"URL":"https:\/\/doi.org\/10.3390\/s20216378","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,9]]}}}