{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T16:37:56Z","timestamp":1781887076071,"version":"3.54.5"},"reference-count":52,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2019,4,7]],"date-time":"2019-04-07T00:00:00Z","timestamp":1554595200000},"content-version":"vor","delay-in-days":96,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100013410","name":"Instituto Nacional de Ciberseguridad","doi-asserted-by":"crossref","award":["LE078G18"],"award-info":[{"award-number":["LE078G18"]}],"id":[{"id":"10.13039\/501100013410","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100013410","name":"Instituto Nacional de Ciberseguridad","doi-asserted-by":"crossref","award":["UXXI2018\/000149"],"award-info":[{"award-number":["UXXI2018\/000149"]}],"id":[{"id":"10.13039\/501100013410","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100013410","name":"Instituto Nacional de Ciberseguridad","doi-asserted-by":"crossref","award":["U-220"],"award-info":[{"award-number":["U-220"]}],"id":[{"id":"10.13039\/501100013410","id-type":"DOI","asserted-by":"crossref"}]},{"name":"developed Research Institute of Applied Sciences in Cybersecurity","award":["LE078G18"],"award-info":[{"award-number":["LE078G18"]}]},{"name":"developed Research Institute of Applied Sciences in Cybersecurity","award":["UXXI2018\/000149"],"award-info":[{"award-number":["UXXI2018\/000149"]}]},{"name":"developed Research Institute of Applied Sciences in Cybersecurity","award":["U-220"],"award-info":[{"award-number":["U-220"]}]},{"name":"Junta de Castilla y Le\u00f3n, Consejer\u00eda de Educaci\u00f3n","award":["LE078G18"],"award-info":[{"award-number":["LE078G18"]}]},{"name":"Junta de Castilla y Le\u00f3n, Consejer\u00eda de Educaci\u00f3n","award":["UXXI2018\/000149"],"award-info":[{"award-number":["UXXI2018\/000149"]}]},{"name":"Junta de Castilla y Le\u00f3n, Consejer\u00eda de Educaci\u00f3n","award":["U-220"],"award-info":[{"award-number":["U-220"]}]},{"name":"Junta de Castilla y Le\u00f3n, Consejer\u00eda de Educaci\u00f3n","award":["LE078G18"],"award-info":[{"award-number":["LE078G18"]}]},{"name":"Junta de Castilla y Le\u00f3n, Consejer\u00eda de Educaci\u00f3n","award":["UXXI2018\/000149"],"award-info":[{"award-number":["UXXI2018\/000149"]}]},{"name":"Junta de Castilla y Le\u00f3n, Consejer\u00eda de Educaci\u00f3n","award":["U-220"],"award-info":[{"award-number":["U-220"]}]},{"name":"Junta de Castilla y Le\u00f3n, Consejer\u00eda de Educaci\u00f3n","award":["LE078G18"],"award-info":[{"award-number":["LE078G18"]}]},{"name":"Junta de Castilla y Le\u00f3n, Consejer\u00eda de Educaci\u00f3n","award":["UXXI2018\/000149"],"award-info":[{"award-number":["UXXI2018\/000149"]}]},{"name":"Junta de Castilla y Le\u00f3n, Consejer\u00eda de Educaci\u00f3n","award":["U-220"],"award-info":[{"award-number":["U-220"]}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Complexity"],"published-print":{"date-parts":[[2019,1]]},"abstract":"<jats:p>The large number of sensors and actuators that make up the Internet of Things obliges these systems to use diverse technologies and protocols. This means that IoT networks are more heterogeneous than traditional networks. This gives rise to new challenges in cybersecurity to protect these systems and devices which are characterized by being connected continuously to the Internet. Intrusion detection systems (IDS) are used to protect IoT systems from the various anomalies and attacks at the network level. Intrusion Detection Systems (IDS) can be improved through machine learning techniques. Our work focuses on creating classification models that can feed an IDS using a dataset containing frames under attacks of an IoT system that uses the MQTT protocol. We have addressed two types of method for classifying the attacks, ensemble methods and deep learning models, more specifically recurrent networks with very satisfactory results.<\/jats:p>","DOI":"10.1155\/2019\/6516253","type":"journal-article","created":{"date-parts":[[2019,4,7]],"date-time":"2019-04-07T23:31:14Z","timestamp":1554679874000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":118,"title":["Multiclass Classification Procedure for Detecting Attacks on MQTT\u2010IoT Protocol"],"prefix":"10.1155","volume":"2019","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6572-1261","authenticated-orcid":false,"given":"Hector","family":"Alaiz-Moreton","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5439-0997","authenticated-orcid":false,"given":"Jose","family":"Aveleira-Mata","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jorge","family":"Ondicol-Garcia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Angel Luis","family":"Mu\u00f1oz-Casta\u00f1eda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Isa\u00edas","family":"Garc\u00eda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carmen","family":"Benavides","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2019,4,7]]},"reference":[{"key":"e_1_2_10_1_2","first-page":"1","article-title":"The Internet of Things Reference Model","author":"Green J.","year":"2014","journal-title":"Internet of Things World Forum"},{"key":"e_1_2_10_2_2","article-title":"Security Issues in the Internet of Things (IoT): A Comprehensive Study","volume":"8","author":"Razzaq M. A.","year":"2017","journal-title":"International Journal of Advanced Computer Science and Applications"},{"key":"e_1_2_10_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cam.2016.08.012"},{"key":"e_1_2_10_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2017.201"},{"key":"e_1_2_10_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.01.039"},{"key":"e_1_2_10_6_2","doi-asserted-by":"crossref","unstructured":"PrabhaK.andSudhaS. A Survey on IPS Methods and Techniques 13 Proceedings of the International Journal of Computer Science Issues 13 (2 2016 38\u201343 http:\/\/ijcsi.org\/contents.php.","DOI":"10.20943\/01201602.3843"},{"key":"e_1_2_10_7_2","doi-asserted-by":"crossref","unstructured":"HamedT. ErnstJ. B. andKremerS. C. A Survey and Taxonomy of Classifiers of Intrusion Detection Systems 39 Proceedings of the URL 2018 Cham.","DOI":"10.1007\/978-3-319-58424-9_2"},{"key":"e_1_2_10_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2008.11.011"},{"key":"e_1_2_10_9_2","first-page":"683","article-title":"Towards generating real-life datasets for network intrusion detection","volume":"17","author":"Bhuyan M. H.","year":"2015","journal-title":"International Journal of Network Security"},{"key":"e_1_2_10_10_2","volume-title":"KDD cup","author":"Stolfo S. J.","year":"1999"},{"key":"e_1_2_10_11_2","doi-asserted-by":"crossref","unstructured":"TavallaeeM. BagheriE. LuW. andGhorbaniA. A. A detailed analysis of the KDD CUP 99 data set Proceedings of the 2nd IEEE Symposium on Computational Intelligence for Security and Defence Applications July 2009 IEEE 1\u20136 https:\/\/doi.org\/10.1109\/cisda.2009.5356528 2-s2.0-77950575061.","DOI":"10.1109\/CISDA.2009.5356528"},{"key":"e_1_2_10_12_2","doi-asserted-by":"publisher","DOI":"10.4236\/jilsa.2014.61005"},{"key":"e_1_2_10_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scitotenv.2012.04.068"},{"key":"e_1_2_10_14_2","doi-asserted-by":"publisher","DOI":"10.5120\/ijca2017913762"},{"key":"e_1_2_10_15_2","doi-asserted-by":"crossref","unstructured":"SeoJ.-h.andKimY.-h. Machine-Learning Approach to Optimize SMOTE Ratio in Class Imbalance Dataset for Intrusion Detection 2018.","DOI":"10.1155\/2018\/9704672"},{"key":"e_1_2_10_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2016.04.019"},{"key":"e_1_2_10_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.07.015"},{"key":"e_1_2_10_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-017-1117-8"},{"key":"e_1_2_10_19_2","doi-asserted-by":"publisher","DOI":"10.14257\/ijsia.2015.9.5.21"},{"key":"e_1_2_10_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.amc.2012.07.001"},{"key":"e_1_2_10_21_2","doi-asserted-by":"publisher","DOI":"10.3390\/info7020020"},{"key":"e_1_2_10_22_2","doi-asserted-by":"crossref","unstructured":"KimJ. ThuH. L. T. andKimH. Long Short Term Memory Recurrent Neural Network Classifier for Intrusion Detection Proceedings of the International Conference on Platform Technology and Service (PlatCon 2016) 2016 1\u20135 http:\/\/ieeexplore.ieee.org\/document\/7456805\/.","DOI":"10.1109\/PlatCon.2016.7456805"},{"key":"e_1_2_10_23_2","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/7472095"},{"key":"e_1_2_10_24_2","doi-asserted-by":"publisher","DOI":"10.3923\/jse.2014.225.238"},{"key":"e_1_2_10_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2017.02.009"},{"key":"e_1_2_10_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2015.2402161"},{"key":"e_1_2_10_27_2","doi-asserted-by":"crossref","unstructured":"AminantoM. E. TanuwidjajaH. C. YooP. D. andKimK. Wi-Fi intrusion detection using weighted-feature selection for neural networks classifier Proceedings of the 2017 International Workshop on Big Data and Information Security (IWBIS) September 2017 Jakarta 99\u2013104 https:\/\/doi.org\/10.1109\/IWBIS.2017.8275109.","DOI":"10.1109\/IWBIS.2017.8275109"},{"key":"e_1_2_10_28_2","unstructured":"ids-2017@www.unb.ca https:\/\/www.unb.ca\/cic\/datasets\/ids-2017.html 2017."},{"key":"e_1_2_10_29_2","doi-asserted-by":"crossref","unstructured":"QinZ.-Q. MaX.-K. andWangY.-J. ChengL. LeungA. C. S. andOzawaS. Attentional Payload Anomaly Detector for Web Applications Proceedings of the Neural Information Processing 2018 Cham Switzerland no. Springer 588\u2013599.","DOI":"10.1007\/978-3-030-04212-7_52"},{"key":"e_1_2_10_30_2","volume-title":"Internet of Things: Architectures, Protocols, and Applications","author":"Sethi P.","year":"2017"},{"key":"e_1_2_10_31_2","first-page":"1","article-title":"How to evaluate the defense against dos and ddos attacks in cloud computing: a survey and taxonomy","volume":"14","author":"Halabi T.","year":"2016","journal-title":"International Journal of Computer Science and Information Security (IJCSIS)"},{"key":"e_1_2_10_32_2","unstructured":"PalssonK. mqtt-malaria@github.com (2018).https:\/\/github.com\/remakeelectric\/mqtt-malaria."},{"key":"e_1_2_10_33_2","doi-asserted-by":"crossref","unstructured":"AndyS. RahardjoB. andHanindhitoB. Attack Scenarios and Security Analysis of MQTT Communication Protocol in IoT System Proceedings of the 4th International Conference on Electrical Engineering Computer Science and Informatics EECSI 2017 2017 Yogyakarta Indonesia IEEE 19\u201321 2-s2.0-85046447864.","DOI":"10.1109\/EECSI.2017.8239179"},{"key":"e_1_2_10_34_2","doi-asserted-by":"crossref","unstructured":"AhmadiM. UlyanovD. SemenovS. TrofimovM. andGiacintoG. Novel feature extraction selection and fusion for effective malware family classification Proceedings of the Sixth ACM Conference on Data and Application Security and Privacy CODASPY \u201916 2016 New York NY USA ACM 183\u2013194 http:\/\/doi.acm.org\/10.1145\/2857705.2857713.","DOI":"10.1145\/2857705.2857713"},{"key":"e_1_2_10_35_2","unstructured":"BarradasD. SantosN. andRodriguesL. Effective detection of multimedia protocol tunneling using machine learning Proceedings of the 27th USENIX Security Symposium (USENIX Security 18) 2018 Baltimore MD USA USENIX Association 169\u2013185 https:\/\/www.usenix.org\/conference\/usenixsecurity18\/presentation\/barradas."},{"key":"e_1_2_10_36_2","doi-asserted-by":"crossref","unstructured":"MeidanY. BohadanaM. ShabtaiA. GuarnizoJ. D. OchoaM. TippenhauerN. O. andEloviciY. Profiliot: A machine learning approach for iot device identification based on network traffic analysis Symposium on Applied Computing SAC \u203217 2017 New York NY USA ACM 506\u2013509 http:\/\/doi.acm.org\/10.1145\/3019612.doi:10.1145\/3019612.","DOI":"10.1145\/3019612.3019878"},{"key":"e_1_2_10_37_2","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1013203451"},{"key":"e_1_2_10_38_2","unstructured":"ChenT.andGuestrinC. XGBoost: A Scalable Tree Boosting System Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining KDD 2016 2016 785\u2013794 https:\/\/arxiv.org\/abs\/1603.02754 2-s2.0-84984950690."},{"key":"e_1_2_10_39_2","unstructured":"XGBoost library https:\/\/xgboost.readthedocs.io\/en\/latest\/tutorials\/index.html."},{"key":"e_1_2_10_40_2","unstructured":"PascanuR. MikolovT. andBengioY. On the difficulty of training Recurrent Neural Networks https:\/\/arxiv.org\/abs\/1211.5063 2012."},{"key":"e_1_2_10_41_2","first-page":"602","article-title":"Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures","volume":"18","author":"Munich T. U.","year":"2004","journal-title":"Neural Networks"},{"key":"e_1_2_10_42_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_10_43_2","unstructured":"CholletF.et al. Keras: The Python Deep Learning library https:\/\/keras.io Zbl1326.03074."},{"key":"e_1_2_10_44_2","doi-asserted-by":"crossref","unstructured":"ChoK. van MerrienboerB. GulcehreC. BahdanauD. BougaresF. SchwenkH. andBengioY. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation https:\/\/arxiv.org\/abs\/1406.1078 2014.","DOI":"10.3115\/v1\/D14-1179"},{"key":"e_1_2_10_45_2","unstructured":"ChungJ. GulcehreC. ChoK. andBengioY. Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling https:\/\/arxiv.org\/abs\/1412.3555 p. 1\u20139 2014."},{"key":"e_1_2_10_46_2","doi-asserted-by":"crossref","unstructured":"ChoK. van MerrienboerB. BahdanauD. andBengioY. On the Properties of Neural Machine Translation: Encoder\u2013Decoder Approaches https:\/\/arxiv.org\/abs\/1409.1259 2014.","DOI":"10.3115\/v1\/W14-4012"},{"key":"e_1_2_10_47_2","unstructured":"KingmaD. P.andBaJ. Adam: A Method for Stochastic Optimization https:\/\/arxiv.org\/abs\/1412.6980v8 p. 1-5 2015MR0407999."},{"key":"e_1_2_10_48_2","doi-asserted-by":"crossref","unstructured":"DahlG. E. SainathT. N. andHintonG. E. Improving deep neural networks for LVCSR using rectified linear units and dropout Proceedings of the 38th IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP \u203213) May 2013 8609\u20138613 https:\/\/doi.org\/10.1109\/icassp.2013.6639346 2-s2.0-84890527827.","DOI":"10.1109\/ICASSP.2013.6639346"},{"key":"e_1_2_10_49_2","volume-title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","author":"Ioffe S."},{"key":"e_1_2_10_50_2","doi-asserted-by":"publisher","DOI":"10.1214\/12-AOS1000"},{"key":"e_1_2_10_51_2","first-page":"2825","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa F.","year":"2011","journal-title":"Journal of Machine Learning Research (JMLR)"},{"key":"e_1_2_10_52_2","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.127"}],"container-title":["Complexity"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2019\/6516253.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2019\/6516253.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2019\/6516253","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T11:33:12Z","timestamp":1723030392000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2019\/6516253"}},"subtitle":[],"editor":[{"given":"Alicja","family":"Krzemie\u0144","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2019,1]]},"references-count":52,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,1]]}},"alternative-id":["10.1155\/2019\/6516253"],"URL":"https:\/\/doi.org\/10.1155\/2019\/6516253","archive":["Portico"],"relation":{},"ISSN":["1076-2787","1099-0526"],"issn-type":[{"value":"1076-2787","type":"print"},{"value":"1099-0526","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1]]},"assertion":[{"value":"2018-11-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-02-10","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-04-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"6516253"}}