{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T23:44:13Z","timestamp":1784936653334,"version":"3.55.0"},"reference-count":52,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2018,8,1]],"date-time":"2018-08-01T00:00:00Z","timestamp":1533081600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"published-print":{"date-parts":[[2018,12,24]]},"abstract":"<jats:p>The adoption of network flow in the domain of Network-based Intrusion Detection System (NIDS) has steadily risen in popularity. Typically, NIDS detects network intrusions by inspecting the contents of every packet. Flow-based approach, however, uses only features derived from aggregated packet headers. In this paper, all publicly accessible and labeled NIDS data sets are explored. Following the advances in deep learning techniques, the performances of Long Short-Term Memory (LSTM) are also presented and compared with various machine learning classifiers. Amongst the reviewed data sets, the models are trained and evaluated on CIDDS-001 flow-based data set.<\/jats:p>","DOI":"10.3233\/jifs-169836","type":"journal-article","created":{"date-parts":[[2018,8,5]],"date-time":"2018-08-05T06:38:05Z","timestamp":1533451085000},"page":"5947-5957","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":18,"title":["Study of long short-term memory in flow-based network intrusion detection system"],"prefix":"10.1177","volume":"35","author":[{"given":"Lee","family":"Nicholas","sequence":"first","affiliation":[{"name":"Faculty of Information Science and Technology, Multimedia University, Jalan Ayer Keroh Lama, Bukit Beruang, Melaka, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shih Yin","family":"Ooi","sequence":"additional","affiliation":[{"name":"Faculty of Information Science and Technology, Multimedia University, Jalan Ayer Keroh Lama, Bukit Beruang, Melaka, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying Han","family":"Pang","sequence":"additional","affiliation":[{"name":"Faculty of Information Science and Technology, Multimedia University, Jalan Ayer Keroh Lama, Bukit Beruang, Melaka, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seong Oun","family":"Hwang","sequence":"additional","affiliation":[{"name":"Department of Software and Communications Engineering, Hongik University, Sejong, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Syh-Yuan","family":"Tan","sequence":"additional","affiliation":[{"name":"Faculty of Information Science and Technology, Multimedia University, Jalan Ayer Keroh Lama, Bukit Beruang, Melaka, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2018,8]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/SURV.2010.032210.00054"},{"key":"e_1_3_2_3_2","doi-asserted-by":"crossref","unstructured":"QuittekJ. ZsebyT. ClaiseB. and ZanderS. Requirements for IP Flow Information Export (IPFIX) 2004.","DOI":"10.17487\/rfc3917"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2012.12.020"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2017.05.009"},{"key":"e_1_3_2_6_2","first-page":"191","article-title":"Towards multi-layered intrusion detection in high-speed networks","author":"Golling M.","year":"2014","unstructured":"GollingM., HofstedeR. and KochR., Towards multi-layered intrusion detection in high-speed networks, in International Conference on Cyber Conflict, CYCON, 2014, pp. 191\u2013206.","journal-title":"in International Conference on Cyber Conflict, CYCON"},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/DISCEX.2000.821506","volume-title":"in Proceedings - DARPA Information Survivability Conference and Exposition, DISCEX 2000","volume":"2","author":"Lippmann R.P.","year":"2000","unstructured":"LippmannR.P.et al., Evaluating intrusion detection systems: The DARPA off-line intrusion detection evaluation, in Proceedings - DARPA Information Survivability Conference and Exposition, DISCEX 2000, vol. 2, 2000, pp. 12\u201326."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1389-1286(00)00139-0"},{"key":"e_1_3_2_9_2","unstructured":"KendallK. A Database of Computer Attacks for the Evaluation of Intrusion Detection Systems 1999."},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1109\/DISCEX.2000.821515","volume-title":"in Proceedings - DARPA Information Survivability Conference and Exposition, DISCEX 2000","volume":"2","author":"Stolfo S.J.","year":"2000","unstructured":"StolfoS.J., FanW., LeeW., ProdromidisA. and ChanP.K., Cost-based modeling for fraud and intrusion detection: Results from the JAM project, in Proceedings - DARPA Information Survivability Conference and Exposition, DISCEX 2000, vol. 2, 2000, pp. 130\u2013144."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/382912.382923"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45248-5_13"},{"key":"e_1_3_2_13_2","first-page":"1","article-title":"A detailed analysis of the KDD CUP 99 data set","author":"Tavallaee M.","year":"2009","unstructured":"TavallaeeM., BagheriE., LuW. and GhorbaniA.A., A detailed analysis of the KDD CUP 99 data set, in IEEE Symposium on Computational Intelligence for Security and Defense Applications, CISDA 2009, 2009, pp. 1\u20136.","journal-title":"in IEEE Symposium on Computational Intelligence for Security and Defense Applications, CISDA 2009"},{"key":"e_1_3_2_14_2","unstructured":"PeronaI. GurrutxagaI. ArbelaitzO. Mart\u00ednJ.I. MuguerzaJ. and P\u00e9rezJ.M. Service-independent payload analysis to improve intrusion detection in network traffic."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/WISTDCS.2008.10"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04968-2_4"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2014.05.011"},{"key":"e_1_3_2_18_2","unstructured":"S. Garcia CTU-13-Extended. [Online]. Available: https:\/\/www.stratosphereips.org\/blog\/2015\/7\/17\/new-dataset-ctu-13-extended-now-includes-pcap-files-of-normal-traffic.[Accessed: 14-Feb-2018]."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2011.12.012"},{"key":"e_1_3_2_20_2","first-page":"1","article-title":"UNSW-NB15: A comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set)","author":"Moustafa N.","year":"2015","unstructured":"MoustafaN. and SlayJ., UNSW-NB15: A comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set), 2015 Mil Commun Inf Syst Conf, 2015, pp. 1\u20136.","journal-title":"2015 Mil Commun Inf Syst Conf"},{"key":"e_1_3_2_21_2","article-title":"Ugr\u201916: A new dataset for the evaluation of cyclostationarity-based network IDSs","author":"Fern\u00e1ndez G.M.","year":"2017","unstructured":"Fern\u00e1ndezG.M., CamachoJ., Mag\u00e1n-Carri\u00f3nR., Garc\u00eda-TeodoroP. and TheronR., Ugr\u201916: A new dataset for the evaluation of cyclostationarity-based network IDSs, Comput Secur (2017).","journal-title":"Comput Secur"},{"key":"e_1_3_2_22_2","first-page":"361","article-title":"Flow-based benchmark data sets for intrusion detection","author":"Ring M.","year":"2017","unstructured":"RingM., WunderlichS., Gr\u00fcdlD., LandesD. and HothoA., Flow-based benchmark data sets for intrusion detection, in European Conference on Information Warfare and Security, ECCWS, 2017, pp. 361\u2013369.","journal-title":"in European Conference on Information Warfare and Security, ECCWS"},{"key":"e_1_3_2_23_2","unstructured":"DARPA Intrusion Detection Data Sets MIT Lincoln Laboratory. [Online]. Available: https:\/\/www.ll.mit.edu\/ideval\/data\/. [Accessed: 20-Nov-2017]."},{"key":"e_1_3_2_24_2","volume-title":"Department of Information and Computer Science","author":"Hettich S.","year":"1999","unstructured":"HettichS., BayS.D., KDD Cup Data, Irvine, CA: University of California, Department of Information and Computer Science, 1999. [Online]. Available: https:\/\/kdd.ics.uci.edu\/ [Accessed: 16-Nov-2017]."},{"key":"e_1_3_2_25_2","unstructured":"PeronaI. ArbelaitzO. GurrutxagaI. Mart\u00ednJ.I. MuguerzaJ. and P\u00e9rezJ.M. Generation of the database gurekddcup 2016."},{"key":"e_1_3_2_26_2","unstructured":"University of New Brunswick Canadian Institute for Cybersecurity (CIC) Datasets. [Online]. Available: http:\/\/www.unb.ca\/cic\/datasets\/index.html. [Accessed: 20-Nov-2017]."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978672.1978676"},{"key":"e_1_3_2_28_2","unstructured":"A. Sperotto R. Sadre F. Van Vliet and A. Pras Labeled Dataset for Intrusion Detection. [Online]. Available: https:\/\/www.simpleweb.org\/wiki\/index.php\/Labeled_Dataset_for_Intrusion_Detection. [Accessed: 16-Nov-2017]."},{"key":"e_1_3_2_29_2","unstructured":"S. Garc\u00eda M. Grill J. Stiborek A. Zunino CTU-13 Dataset. [Online]. Available: https:\/\/www.stratosphereips.org\/datasets-ctu13\/. [Accessed: 14-Feb-2018]."},{"key":"e_1_3_2_30_2","unstructured":"N. Moustafa and J. Slay UNSW-NB15 data set. [Online]. Available: https:\/\/www.unsw.adfa.edu.au\/australian-centre-for-cyber-security\/cybersecurity\/ADFA-NB15-Datasets\/ [Accessed: 16-Nov-2017]."},{"key":"e_1_3_2_31_2","unstructured":"Fern\u00e1ndez G.M. Camacho J. Mag\u00e1n-Carri\u00f3n R. Garc\u00eda-Teodoro P. Theron R. UGR\u201916 Dataset. [Online]. Available: https:\/\/nesg.ugr.es\/nesg-ugr16\/ [Accessed: 14-Feb-2018]."},{"key":"e_1_3_2_32_2","unstructured":"RingM. WunderlichS. Gr\u00fcdlD. LandesD. and HothoA. CIDDS - Coburg Intrusion Detection Data Sets: Hochschule Coburg. [Online]. Available: https:\/\/www.hs-coburg.de\/forschung-kooperation\/forschungsprojekte-oeffentlich\/ingenieurwissenschaften\/cidds-coburg-intrusion-detection-data-sets.html. [Accessed: 20-Nov-2017]."},{"key":"e_1_3_2_33_2","first-page":"108","volume-title":"in Proceedings of the 4th International Conference on Information Systems Security and Privacy - Volume 1: ICISSP","author":"Sharafaldin I.","year":"2018","unstructured":"SharafaldinI., LashkariA.H. and GhorbaniA.A., Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization, no. Cic, in Proceedings of the 4th International Conference on Information Systems Security and Privacy - Volume 1: ICISSP, 2018, pp. 108\u2013116."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.13052\/jsn2445-9739.2017.009"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.5220\/0006105602530262"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2015.11.016"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2012.05.013"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/SURV.2013.052213.00046"},{"key":"e_1_3_2_39_2","volume-title":"Deep learning","author":"Goodfellow I.","year":"2016","unstructured":"GoodfellowI., BengioY., CourvilleA., Deep learning, MIT Press, Cambridge, 2016."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14539"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.7.1527"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33275-3_2"},{"key":"e_1_3_2_43_2","doi-asserted-by":"crossref","unstructured":"SalamaM.A. EidH.F. RamadanR.A. DarwishA. Hybrid Intelligent Intrusion Detection Scheme Springer Berlin Heidelb 2011 pp. 293\u2013303 .","DOI":"10.1007\/978-3-642-20505-7_26"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/CBD.2014.41"},{"key":"e_1_3_2_45_2","first-page":"195","article-title":"Toward an online anomaly intrusion detection system based on deep learning","author":"Alrawashdeh K.","year":"2017","unstructured":"AlrawashdehK. and PurdyC., Toward an online anomaly intrusion detection system based on deep learning, Proc - 2016 15th IEEE Int Conf Mach Learn Appl ICMLA 2016, 2017, pp. 195\u2013200.","journal-title":"Proc - 2016 15th IEEE Int Conf Mach Learn Appl ICMLA 2016"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-010-0487-0"},{"key":"e_1_3_2_47_2","first-page":"1","article-title":"A deep learning approach for intrusion detection using recurrent neural networks","volume":"5","author":"Chuan-long Y.","year":"2017","unstructured":"Chuan-longY., Yue-feiZ., Jin-LongF. and Xin-zhengH., A deep learning approach for intrusion detection using recurrent neural networks, IEEE Access5 (2017), 1\u20131.","journal-title":"IEEE Access"},{"key":"e_1_3_2_48_2","first-page":"357","article-title":"Applying recurrent neural network to intrusion detection with hessian free optimization","volume":"9503","author":"Kim J.","year":"2016","unstructured":"KimJ. and KimH., Applying recurrent neural network to intrusion detection with hessian free optimization, in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol.9503, 2016, pp. 357\u2013369.","journal-title":"in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1162\/089976600300015015"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2000.861302"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2016.2582924"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2010.25"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-169836","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/JIFS-169836","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-169836","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:41:37Z","timestamp":1777455697000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/JIFS-169836"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8]]},"references-count":52,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2018,12,24]]}},"alternative-id":["10.3233\/JIFS-169836"],"URL":"https:\/\/doi.org\/10.3233\/jifs-169836","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,8]]}}}