{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T16:25:35Z","timestamp":1780763135150,"version":"3.54.1"},"reference-count":28,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T00:00:00Z","timestamp":1599177600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61433012"],"award-info":[{"award-number":["61433012"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Innovation Environment Construction Special Project of Xinjiang Uygur 342 Autonomous Region","award":["PT1811"],"award-info":[{"award-number":["PT1811"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Due to the insidious characteristics of network intrusion behaviors, developing an efficient intrusion detection system is still a big challenge, especially in the era of big data where the number of traffic and the dimension of each traffic feature are high. Because of the shortcomings of traditional common machine learning algorithms in network intrusion detection, such as insufficient accuracy, a network intrusion detection system based on LightGBM and autoencoder (AE) is proposed. The LightGBM-AE model proposed in this paper includes three steps: data preprocessing, feature selection, and classification. The LightGBM-AE model adopts the LightGBM algorithm for feature selection, and then uses an autoencoder for training and detection. When a set of data containing network intrusion behaviors are inputted into an autoencoder, there is a large reconstruction error between the original input data and the reconstructed data obtained by the autoencoder, which provides a basis for intrusion detection. According to the reconstruction error, an appropriate threshold is set to distinguish symmetrically between normal behavior and attack behavior. The experiment is carried out on the NSL-KDD dataset and implemented using Pytorch. In addition to autoencoder, variational autoencoder (VAE) and denoising autoencoder (DAE) are also used for intrusion detection and are compared with existing machine learning algorithms such as Decision Tree, Random Forest, KNN, GBDT, and XGBoost. The evaluation is carried out through classification evaluation indexes such as accuracy, precision, recall, F1-score. The experimental results show that the method can efficiently separate the attack behavior from normal behavior according to the reconstruction error. Compared with other methods, the effectiveness and superiority of this method are verified.<\/jats:p>","DOI":"10.3390\/sym12091458","type":"journal-article","created":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T12:20:06Z","timestamp":1599222006000},"page":"1458","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":73,"title":["An Efficient Intrusion Detection Method Based on LightGBM and Autoencoder"],"prefix":"10.3390","volume":"12","author":[{"given":"Chaofei","family":"Tang","sequence":"first","affiliation":[{"name":"College of Software, Xinjiang University, Urumqi 830046, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nurbol","family":"Luktarhan","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830046, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuxin","family":"Zhao","sequence":"additional","affiliation":[{"name":"College of Software, Xinjiang University, Urumqi 830046, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.jnca.2015.11.016","article-title":"A survey of network anomaly detection techniques","volume":"60","author":"Ahmed","year":"2016","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"601","DOI":"10.2298\/CSIS130415035A","article-title":"Flow-based anomaly intrusion detection system using two neural network stages","volume":"11","author":"Abuadlla","year":"2014","journal-title":"Comput. Sci. Inf. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Liu, W., Ci, L., and Liu, L. (2020). A New Method of Fuzzy Support Vector Machine Algorithm for Intrusion Detection. Appl. Sci., 10.","DOI":"10.3390\/app10031065"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1111\/coin.12123","article-title":"Logistic regression in large rare events and imbalanced data: A performance comparison of prior correction and weighting methods","volume":"34","author":"Maalouf","year":"2018","journal-title":"Comput. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bhattacharya, S., Krishnan, S.S.R., Maddikunta, P.K.R., Kaluri, R., Singh, S., Gadekallu, T.R., Alazab, M., and Tariq, U. (2020). A Novel PCA-Firefly Based XGBoost Classification Model for Intrusion Detection in Networks Using GPU. Electronics, 9.","DOI":"10.3390\/electronics9020219"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, Z., Gurgel, H., Dessay, N., Hu, L., Xu, L., and Gong, P. (2020). Semi-Supervised Text Classification Framework: An Overview of Dengue Landscape Factors and Satellite Earth Observation. Int. J. Environ. Res. Public Health, 17.","DOI":"10.3390\/ijerph17124509"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Malowany, D., and Guterman, H. (2020). Biologically Inspired Visual System Architecture for Object Recognition in Autonomous Systems. Algorithms, 13.","DOI":"10.3390\/a13070167"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"e4887","DOI":"10.1002\/cpe.4887","article-title":"Optimal feature level fusion based ANFIS classifier for brain MRI image classification","volume":"32","author":"Shankar","year":"2020","journal-title":"Concur. Comput. Pract. Exp."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"102031","DOI":"10.1016\/j.simpat.2019.102031","article-title":"Deep recurrent neural network for IoT intrusion detection system","volume":"101","author":"Almiani","year":"2020","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3540","DOI":"10.1109\/TIFS.2020.2991876","article-title":"A Method of Few-Shot Network Intrusion Detection Based on Meta-Learning Framework","volume":"15","author":"Congyuan","year":"2020","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tavallaee, M., Bagheri, E., Lu, W., and Ghorbani, A.A. (2009, January 8\u201310). A detailed analysis of the KDD CUP 99 data set. Proceedings of the 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications, Ottawa, ON, Canada.","DOI":"10.1109\/CISDA.2009.5356528"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"52843","DOI":"10.1109\/ACCESS.2018.2869577","article-title":"Deep Learning Approach Combining Sparse Autoencoder With SVM for Network Intrusion Detection","volume":"6","author":"Alqatf","year":"2018","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Khraisat, A., Gondal, I., Vamplew, P., Kamruzzaman, J., and Alazab, A. (2020). Hybrid Intrusion Detection System Based on the Stacking Ensemble of C5 Decision Tree Classifier and One Class Support Vector Machine. Electronics, 9.","DOI":"10.3390\/electronics9010173"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"72458","DOI":"10.1109\/ACCESS.2018.2867345","article-title":"Multilayered Echo-State Machine: A Novel Architecture for Efficient Intrusion Detection","volume":"6","author":"Tchakoucht","year":"2018","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Dey, S.K., and Rahman, M.M. (2019). Effects of Machine Learning Approach in Flow-Based Anomaly Detection on Software-Defined Networking. Symmetry, 12.","DOI":"10.20944\/preprints201911.0113.v1"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yang, K., Liu, J., Zhang, C., and Fang, Y. (2018, January 29\u201331). Adversarial Examples Against the Deep Learning Based Network Intrusion Detection Systems. Proceedings of the 2018 IEEE Military Communications Conference (MILCOM), Los Angeles, CA, USA.","DOI":"10.1109\/MILCOM.2018.8599759"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"21954","DOI":"10.1109\/ACCESS.2017.2762418","article-title":"A Deep Learning Approach for Intrusion Detection Using Recurrent Neural Networks","volume":"5","author":"Yin","year":"2017","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1999","DOI":"10.1007\/s00500-019-04030-2","article-title":"Deep Packet: A Novel Approach For Encrypted Traffic Classification Using Deep Learning","volume":"24","author":"Lotfollahi","year":"2020","journal-title":"Soft Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"108346","DOI":"10.1109\/ACCESS.2020.3001350","article-title":"Anomaly-Based Intrusion Detection From Network Flow Features Using Variational Autoencoder","volume":"8","author":"Zavrak","year":"2020","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.neucom.2019.11.016","article-title":"A Novel Statistical Analysis and Autoencoder Driven Intelligent Intrusion Detection Approach","volume":"387","author":"Ieracitano","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"12499","DOI":"10.1007\/s00521-020-04708-x","article-title":"An efficient XGBoost\u2013DNN-based classification model for network intrusion detection system","volume":"32","author":"Devan","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_22","unstructured":"Ke, G., Meng, Q., Finley, T.W., Wang, T., Chen, W., Ma, W., Qiwei, Y., and Liu, T. (2017). LightGBM: A highly efficient gradient boosting decision tree. Neural Information Processing Systems, Neural Information Processing Systems Foundation."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_24","unstructured":"Doersch, C. (2016). Tutorial on Variational Autoencoders. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"105904","DOI":"10.1016\/j.asoc.2019.105904","article-title":"Dynamic dispatching system using a deep denoising autoencoder for semiconductor manufacturing","volume":"86","author":"Lee","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"173827","DOI":"10.1109\/ACCESS.2019.2956494","article-title":"Outlier Detection for Monitoring Data Using Stacked Autoencoder","volume":"7","author":"Wan","year":"2019","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Qin, R., Xu, H., Sadiq, S., and Yu, Y. (2018). A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea. Sensors, 18.","DOI":"10.3390\/s18082628"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2540","DOI":"10.1109\/TPDS.2018.2833074","article-title":"MPCA SGD\u2014A Method for Distributed Training of Deep Learning Models on Spark","volume":"29","author":"Langer","year":"2018","journal-title":"IEEE Trans. Parallel Distrib. Syst."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/9\/1458\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:07:00Z","timestamp":1760177220000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/9\/1458"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,4]]},"references-count":28,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["sym12091458"],"URL":"https:\/\/doi.org\/10.3390\/sym12091458","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,4]]}}}