{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:40:44Z","timestamp":1760211644851,"version":"build-2065373602"},"reference-count":21,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2016,2,15]],"date-time":"2016-02-15T00:00:00Z","timestamp":1455494400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Currently, with the rapid increasing of data scales in network traffic classifications, how to select traffic features efficiently is becoming a big challenge. Although a number of traditional feature selection methods using the Hadoop-MapReduce framework have been proposed, the execution time was still unsatisfactory with numeral iterative computations during the processing. To address this issue, an efficient feature selection method for network traffic based on a new parallel computing framework called Spark is proposed in this paper. In our approach, the complete feature set is firstly preprocessed based on Fisher score, and a sequential forward search strategy is employed for subsets. The optimal feature subset is then selected using the continuous iterations of the Spark computing framework. The implementation demonstrates that, on the precondition of keeping the classification accuracy, our method reduces the time cost of modeling and classification, and improves the execution efficiency of feature selection significantly.<\/jats:p>","DOI":"10.3390\/info7010006","type":"journal-article","created":{"date-parts":[[2016,2,15]],"date-time":"2016-02-15T06:23:07Z","timestamp":1455517387000},"page":"6","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["A Feature Selection Method for Large-Scale Network Traffic Classification Based on Spark"],"prefix":"10.3390","volume":"7","author":[{"given":"Yong","family":"Wang","sequence":"first","affiliation":[{"name":"Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin 541004, China"},{"name":"Guangxi Colleges and Universities Key Laboratory of Cloud Computing and Complex Systems, Guilin University of Electronic Technology, Guilin 541004, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenlong","family":"Ke","sequence":"additional","affiliation":[{"name":"Key Laboratory of Cognitive Radio and Information Processing, Guilin University of Electronic Technology, Guilin 541004, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6573-2291","authenticated-orcid":false,"given":"Xiaoling","family":"Tao","sequence":"additional","affiliation":[{"name":"Guangxi Colleges and Universities Key Laboratory of Cloud Computing and Complex Systems, Guilin University of Electronic Technology, Guilin 541004, China"},{"name":"Key Laboratory of Cognitive Radio and Information Processing, Guilin University of Electronic Technology, Guilin 541004, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,2,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1016\/j.peva.2010.01.001","article-title":"Machine learning algorithms for accurate flow-based network traffic classification: Evaluation and comparison","volume":"67","author":"Soysal","year":"2010","journal-title":"Perform. Eval."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2040","DOI":"10.1016\/j.comnet.2013.04.005","article-title":"Toward an efficient and scalable feature selection approach for internet traffic classification","volume":"57","author":"Fahad","year":"2013","journal-title":"Comput. Netw."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1923","DOI":"10.1016\/j.neucom.2010.01.017","article-title":"Feature selection for time series prediction\u2014A combined filter and wrapper approach for neural networks","volume":"73","author":"Crone","year":"2010","journal-title":"Neurocomputing"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/MNET.2014.6786614","article-title":"Traffic Identification Engine: An Open Platform for Traffic Classification","volume":"28","author":"Dainotti","year":"2014","journal-title":"IEEE Netw."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Xu, M., Zhu, W., Xu, J., and Zheng, N. (2015, January 19\u201321). Towards Selecting Optimal Features for Flow Statistical Based Network Traffic Classification. Proceedings of the 17th Asia-Pacific Network Operations and Management Symposium (APNOMS), Busan, Korea.","DOI":"10.1109\/APNOMS.2015.7275371"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Domingo-Pascual, J., and Shavitt, Y. (2011). Traffic Monitoring and Analysis, Springer.","DOI":"10.1007\/978-3-642-20305-3"},{"key":"ref_7","unstructured":"Jing, R., and Zhang, C. (2011, January 24\u201325). A Novel Feature Selection Method for the Conditional Information Entropy Model. Proceedings of the 3rd International Conference on Artificial Intelligence and Computational Intelligence(AICI 2011), Taiyuan, China."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1744","DOI":"10.1016\/j.csda.2010.02.006","article-title":"Fisher scoring: An interpolation family and its Monte Carlo implementations","volume":"54","author":"Wang","year":"2010","journal-title":"Computational Stat. Data Anal."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1080\/01969722.2013.762246","article-title":"Prediction based on Integration of Decisional DNA and a Feature Selection Algorithm relief-F","volume":"44","author":"Wang","year":"2013","journal-title":"Cybern. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2250","DOI":"10.1016\/j.eswa.2013.09.023","article-title":"A wrapper approach for feature selection based on bat algorithm and optimum-path forest","volume":"41","author":"Rodrigues","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1089\/cmb.2010.0064","article-title":"A hybrid BPSO-CGA approach for gene selection and classification of microarray data","volume":"19","author":"Chuang","year":"2012","journal-title":"J. Comput. Biol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.jbi.2009.07.008","article-title":"A novel feature selection approach for biomedical data classification","volume":"43","author":"Peng","year":"2010","journal-title":"J. Biomed. Inform."},{"key":"ref_13","first-page":"35","article-title":"Issues and Future Directions in Traffic Classification","volume":"25","author":"Dainotti","year":"2012","journal-title":"IEEE J. Mag."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Szab\u00f3, G., Veres, A., Malomsoky, S., G\u00f3dor, I., and Moln\u00e1r, S. (2010). Traffic Classification over Gbit Speed with Commodity Hardware. IEEE J. Commun. Softw. Syst., 5, Available online: http:\/\/hsnlab.tmit.bme.hu\/molnar\/files\/jcss2010.pdf.","DOI":"10.24138\/jcomss.v5i3.203"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sun, Z.Q., and Li, Z. (2014, January 6\u201311). Data intensive parallel feature selection method study. Proceedings of 2014 International Joint Conference on Neural Networks (IJCNN), Beijing, China.","DOI":"10.1109\/IJCNN.2014.6889409"},{"key":"ref_16","first-page":"3979","article-title":"An improved method of SVM-BPSO feature selection based on cloud model","volume":"12","author":"Li","year":"2014","journal-title":"IAES Telkomnika Indones. J. Electr. Eng."},{"key":"ref_17","unstructured":"Long, Y. (2015). Network Traffic Classification Method Research Based on Cloud Computing and Ensemble Learning. [Ph.D. Thesis, Guilin University of Electronic Technology]."},{"key":"ref_18","first-page":"91","article-title":"Scalability of parallel scientific applications on the cloud","volume":"19","author":"Srirama","year":"2011","journal-title":"Sci. Program."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.future.2011.05.025","article-title":"Adapting scientific computing problems to clouds using MapReduce","volume":"28","author":"Srirama","year":"2012","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_20","unstructured":"Apache Spark. Available online: http:\/\/spark.apache.org."},{"key":"ref_21","unstructured":"Moore, A., and Zuev, D. (2005). Discriminators for Use in Flow-based Classification, Queen Mary and Westfield College."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/7\/1\/6\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:19:07Z","timestamp":1760210347000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/7\/1\/6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,2,15]]},"references-count":21,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2016,3]]}},"alternative-id":["info7010006"],"URL":"https:\/\/doi.org\/10.3390\/info7010006","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2016,2,15]]}}}