{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T22:21:00Z","timestamp":1775082060322,"version":"3.50.1"},"reference-count":61,"publisher":"Springer Science and Business Media LLC","issue":"11","license":[{"start":{"date-parts":[[2021,1,3]],"date-time":"2021-01-03T00:00:00Z","timestamp":1609632000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,1,3]],"date-time":"2021-01-03T00:00:00Z","timestamp":1609632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100008993","name":"Sveu\u010dili\u0161te u Zagrebu","doi-asserted-by":"publisher","award":["555-1"],"award-info":[{"award-number":["555-1"]}],"id":[{"id":"10.13039\/100008993","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int. J. Mach. Learn. &amp; Cyber."],"published-print":{"date-parts":[[2021,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The emergence of the Internet of Things (IoT) concept as a new direction of technological development raises new problems such as valid and timely identification of such devices, security vulnerabilities that can be exploited for malicious activities, and management of such devices. The communication of IoT devices generates traffic that has specific features and differences with respect to conventional devices. This research seeks to analyze the possibilities of applying such features for classifying devices, regardless of their functionality or purpose. This kind of classification is necessary for a dynamic and heterogeneous environment, such as a smart home where the number and types of devices grow daily. This research uses a total of 41 IoT devices. The logistic regression method enhanced by the concept of supervised machine learning (logitboost) was used for developing a classification model. Multiclass classification model was developed using 13 network traffic features generated by IoT devices. Research has shown that it is possible to classify devices into four previously defined classes with high performances and accuracy (99.79%) based on the traffic flow features of such devices. Model performance measures such as precision, F-measure, True Positive Ratio, False Positive Ratio and Kappa coefficient all show high results (0.997\u20130.999, 0.997\u20130.999, 0.997\u20130.999, 0\u20130.001 and 0.9973, respectively). Such a developed model can have its application as a foundation for monitoring and managing solutions of large and heterogeneous IoT environments such as Industrial IoT, smart home, and similar.<\/jats:p>","DOI":"10.1007\/s13042-020-01241-0","type":"journal-article","created":{"date-parts":[[2021,1,2]],"date-time":"2021-01-02T20:02:37Z","timestamp":1609617757000},"page":"3179-3202","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":224,"title":["Ensemble machine learning approach for classification of IoT devices in smart home"],"prefix":"10.1007","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3728-6711","authenticated-orcid":false,"given":"Ivan","family":"Cviti\u0107","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0476-9373","authenticated-orcid":false,"given":"Dragan","family":"Perakovi\u0107","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1775-0735","authenticated-orcid":false,"given":"Marko","family":"Peri\u0161a","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4929-4698","authenticated-orcid":false,"given":"Brij","family":"Gupta","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,1,3]]},"reference":[{"key":"1241_CR1","unstructured":"DigiCert Inc (2018) State of IoT Security Survey 2018. https:\/\/www.digicert.com\/wp-content\/uploads\/2018\/11\/StateOfIoTSecurity_Report_11_02_18_F_am.pdf\nAccessed 18 Mar 2020"},{"key":"1241_CR2","unstructured":"Vodafone Business (2019) Your IoT-Driven Future [Internet] 2019. https:\/\/www.vodafone.com\/business\/news-and-insights\/whitepaper\/vodafone-iot-barometer-2019 Accessed 14 May 2020"},{"key":"1241_CR3","volume-title":"Smart buildings: how IoT technology aims to add value for real estate companies","author":"S Kejriwal","year":"2016","unstructured":"Kejriwal S, Mahajan S (2016) Smart buildings: how IoT technology aims to add value for real estate companies. Deloitte University Press, London"},{"key":"1241_CR4","unstructured":"HIS (2017) The Internet of Things\u202f: a movement, not a market Start revolutionizing the competitive landscape. IHS Markit. https:\/\/ihsmarkit.com\/Info\/1017\/internet-of-things.html Accessed 21 Mar 2020"},{"issue":"3","key":"1241_CR5","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1007\/s11235-017-0345-9","volume":"67","author":"V Adat","year":"2018","unstructured":"Adat V, Gupta BB (2018) Security in Internet of Things: issues, challenges, taxonomy, and architecture. Telecommunication Systems 67(3):423\u2013441","journal-title":"Telecommunication Systems"},{"key":"1241_CR6","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1016\/j.ins.2018.02.060","volume":"479","author":"D Li","year":"2019","unstructured":"Li D, Deng L et al (2019) A novel CNN based security guaranteed image watermarking generation scenario for smart city applications. Information Sciences 479:432\u2013447","journal-title":"Information Sciences"},{"key":"1241_CR7","doi-asserted-by":"publisher","first-page":"596","DOI":"10.1016\/j.future.2017.03.029","volume":"83","author":"MS Hossain","year":"2018","unstructured":"Hossain MS, Muhammad G, Abdul W, Song B et al (2018) Cloud-assisted secure video transmission and sharing framework for smart cities. Future Generation Computer Systems 83:596\u2013606","journal-title":"Future Generation Computer Systems"},{"key":"1241_CR8","doi-asserted-by":"publisher","first-page":"d4302","DOI":"10.1136\/bmj.d4302","volume":"343","author":"P Sedgwick","year":"2011","unstructured":"Sedgwick P (2011) Receiver operating characteristic curves. BMJ 343:d4302\u2013d4302. https:\/\/doi.org\/10.1136\/bmj.d4302","journal-title":"BMJ"},{"key":"1241_CR9","doi-asserted-by":"publisher","first-page":"909","DOI":"10.1016\/j.future.2018.04.027","volume":"108","author":"A Tewari","year":"2020","unstructured":"Tewari A, Gupta BB (2020) Security, privacy and trust of different layers in Internet-of-Things (IoTs) framework. Future generation computer systems 108:909\u2013920","journal-title":"Future generation computer systems"},{"key":"1241_CR10","unstructured":"Statista (2018) Internet of Things (IoT) connected devices installed base worldwide from 2015 to 2025 (in billions) [Internet]. https:\/\/www.statista.com\/statistics\/471264\/iot-number-of-connected-devices-worldwide\/. Accessed Jun 24 2018"},{"key":"1241_CR11","unstructured":"Statista (2018) The Internet of Things (IoT)* units installed base by category from 2014 to 2020 (in billions): https:\/\/www.statista.com\/statistics\/370350\/internet-of-things-installed-base-by-category\/. Accessed 24 Jun 2018"},{"key":"1241_CR12","doi-asserted-by":"crossref","unstructured":"Cviti\u0107 I, Vuji\u0107 M, Husnjak S (2016) Classification of security risks in the IoT environment. In: DAAAM International Symposium on Intelligent\u00a0Manufacturing and Automation, pp 0731\u201340","DOI":"10.2507\/26th.daaam.proceedings.102"},{"key":"1241_CR13","doi-asserted-by":"publisher","first-page":"817","DOI":"10.3390\/s18030817","volume":"18","author":"B Ali","year":"2018","unstructured":"Ali B, Awad A (2018) Cyber and physical security vulnerability assessment for IoT-based smart homes. Sensors 18:817","journal-title":"Sensors"},{"key":"1241_CR14","doi-asserted-by":"publisher","first-page":"352","DOI":"10.1109\/JIOT.2017.2785219","volume":"5","author":"BKJ Al-Shammari","year":"2018","unstructured":"Al-Shammari BKJ, Al-Aboody N, Al-Raweshidy HS (2018) IoT traffic management and integration in the QoS supported network. IEEE Internet Things J 5:352\u2013370","journal-title":"IEEE Internet Things J"},{"key":"1241_CR15","first-page":"1","volume":"13","author":"Y Meidan","year":"2018","unstructured":"Meidan Y, Bohadana M, Mathov Y, Mirsky Y, Breitenbacher D, Shabtai A et al (2018) N-BaIoT: network-based detection of IoT botnet attacks using deep autoencoders. IEEE Pervasive Comput 13:1\u20138","journal-title":"IEEE Pervasive Comput"},{"key":"1241_CR16","doi-asserted-by":"crossref","unstructured":"Sivanathan A, Sherratt D, Gharakheili HH, Radford A, Wijenayake C, Vishwanath A, et al (2017) Characterizing and classifying IoT traffic in smart cities and campuses. In: IEEE\u00a0International\u00a0Conference\u00a0on Pervasive\u00a0Computing\u00a0and\u00a0Communications Work (INFOCOM WKSHPS). IEEE, pp 559\u201364","DOI":"10.1109\/INFCOMW.2017.8116438"},{"key":"1241_CR17","doi-asserted-by":"publisher","first-page":"1745","DOI":"10.1109\/TMC.2018.2866249","volume":"18","author":"A Sivanathan","year":"2019","unstructured":"Sivanathan A, Gharakheili HH, Loi F, Radford A, Wijenayake C, Vishwanath A et al (2019) Classifying IoT devices in smart environments using network traffic characteristics. IEEE Trans Mob Comput 18:1745\u20131759","journal-title":"IEEE Trans Mob Comput"},{"key":"1241_CR18","doi-asserted-by":"publisher","first-page":"1960","DOI":"10.1109\/TNET.2013.2256431","volume":"21","author":"MZ Shafiq","year":"2013","unstructured":"Shafiq MZ, Ji L, Liu AX, Pang J, Wang J (2013) Large-scale measurement and characterization of cellular machine-to-machine traffic. IEEE\/ACM Trans Netw 21:1960\u20131973","journal-title":"IEEE\/ACM Trans Netw"},{"key":"1241_CR19","doi-asserted-by":"crossref","unstructured":"Bekerman D, Shapira B, Rokach L, Bar A (2015) Unknown malware detection using network traffic classification. In: 2015 IEEE Conference\u00a0on\u00a0Communications\u00a0and\u00a0Network Security. IEEE, pp 134\u201342","DOI":"10.1109\/CNS.2015.7346821"},{"key":"1241_CR20","first-page":"193","volume-title":"XXXVII Simp o novim Tehnol u po\u0161tanskom i Telekomun saobra\u0107aju\u2013PosTel 2019","author":"I Cviti\u0107","year":"2019","unstructured":"Cviti\u0107 I, Zori\u0107 P, Kuljani\u0107 TM, Musa M (2019) Analysis of network traffic features generated by IoT DEVICES. In: Radoji\u010di\u0107 V, Bojovi\u0107 N, Markovi\u0107 D, Markovi\u0107 G (eds) XXXVII Simp o novim Tehnol u po\u0161tanskom i Telekomun saobra\u0107aju\u2013PosTel 2019. Univerzitet u Beogradu-Saobra\u0107ajni fakultet, Beograd, pp 193\u2013200"},{"key":"1241_CR21","doi-asserted-by":"crossref","unstructured":"Trimananda R, Varmarken J, Markopoulou A, Demsky B (2020) Packet-level signatures for smart home devices. In: Proceedings 2020 Network\u00a0and\u00a0Distributed System Security Symposium. Reston, VA: Internet Society.","DOI":"10.14722\/ndss.2020.24097"},{"key":"1241_CR22","doi-asserted-by":"crossref","unstructured":"Charyyev B, Gunes MH (2020) IoT traffic flow identification using locality sensitive hashes. ICC 2020. IEEE International Conference on Communications [Internet]. IEEE, pp 1\u20136","DOI":"10.1109\/ICC40277.2020.9148743"},{"key":"1241_CR23","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-57805-3_8","author":"J Kotak","year":"2020","unstructured":"Kotak J, Elovici Y (2020) IoT device identification using deep learning. Adv Intell Syst Comput. https:\/\/doi.org\/10.1007\/978-3-030-57805-3_8","journal-title":"Adv Intell Syst Comput"},{"key":"1241_CR24","doi-asserted-by":"publisher","first-page":"9042","DOI":"10.1109\/JIOT.2019.2926365","volume":"6","author":"E Anthi","year":"2019","unstructured":"Anthi E, Williams L, Slowinska M, Theodorakopoulos G, Burnap P (2019) A supervised intrusion detection system for smart home IOT devices. IEEE Internet Things J 6:9042\u20139053","journal-title":"IEEE Internet Things J"},{"key":"1241_CR25","doi-asserted-by":"publisher","DOI":"10.1002\/ett.3743","author":"O Salman","year":"2019","unstructured":"Salman O, Elhajj IH, Chehab A, Kayssi A (2019) A machine learning based framework for IoT device identification and abnormal traffic detection. Trans Emerg Telecommun. https:\/\/doi.org\/10.1002\/ett.3743","journal-title":"Trans Emerg Telecommun"},{"key":"1241_CR26","doi-asserted-by":"crossref","unstructured":"Karimi AM, Niyaz Q, Weiqing Sun, Javaid AY, Devabhaktuni VK (2016) Distributed network traffic feature extraction for a real-time IDS. 2016 IEEE International Conference\u00a0on\u00a0Electro Information Technology. IEEE, pp. 0522\u20136","DOI":"10.1109\/EIT.2016.7535295"},{"key":"1241_CR27","unstructured":"Amar Y, Haddadi H, Mortier R, Brown A, Colley J, Crabtree A (2018) An Analysis of Home IoT Network Traffic and Behaviour. arXiv. http:\/\/arxiv.org\/abs\/1803.05368 Accessed 14 Mar 2020"},{"key":"1241_CR28","unstructured":"Meidan Y, Bohadana M, Shabtai A, Ochoa M, Tippenhauer NO, Guarnizo JD, et al. (2017) Detection of unauthorized IoT devices using machine learning techniques. arXiv. http:\/\/arxiv.org\/abs\/1709.04647 Accessed 23 Sep 2019"},{"key":"1241_CR29","first-page":"1","volume-title":"Definition of the IoT device classes based on network traffic flow features","author":"I Cvitic","year":"2020","unstructured":"Cvitic I, Perakovic D, Perisa M, Botica M (2020) Definition of the IoT device classes based on network traffic flow features. Springer, Cham, pp 1\u201317"},{"key":"1241_CR30","first-page":"8","volume-title":"Clear as MUD: generating, validating and applying iot behaviorial profiles. Proceedings of 2018 Work IoT Secur Priv - IoT S&P \u201918","author":"A Hamza","year":"2018","unstructured":"Hamza A, Ranathunga D, Gharakheili HH, Roughan M, Sivaraman V (2018) Clear as MUD: generating, validating and applying iot behaviorial profiles. Proceedings of 2018 Work IoT Secur Priv - IoT S&P \u201918. ACM Press, New York, pp 8\u201314"},{"key":"1241_CR31","first-page":"1","volume-title":"Combining MUD policies with SDN for IoT intrusion detection. Proceedings of 2018 work IoT Secur Priv - IoT S&P \u201918","author":"A Hamza","year":"2018","unstructured":"Hamza A, Gharakheili HH, Sivaraman V (2018) Combining MUD policies with SDN for IoT intrusion detection. Proceedings of 2018 work IoT Secur Priv - IoT S&P \u201918. ACM Press, New York, pp 1\u20137"},{"key":"1241_CR32","unstructured":"Iskon (2016) Iskon smarthome. https:\/\/smarthome.iskon.hr\/static\/pdf\/Upute_basic_paket_SH31_5_B.pdf. Accessed 30 Sep 2019"},{"key":"1241_CR33","unstructured":"Hrvatska A (2019) Smart home ure\u0111aji.. Available from: https:\/\/www.a1.hr\/privatni\/promocije\/smarthome\/uredaji. Accessed 30 Sep 2019"},{"key":"1241_CR34","unstructured":"Smart Home-worldwide (2019) Statista market forecast. https:\/\/www.statista.com\/outlook\/279\/100\/smart-home\/worldwide. Accessed 09 Mar 2019"},{"key":"1241_CR35","doi-asserted-by":"crossref","unstructured":"Aghaei-Foroushani V, Zincir-Heywood AN (2015) A proxy identifier based on patterns in traffic flows. In: 2015 IEEE 16th International Symposium on High Assurance Systems Engineering. IEEE, pp 118\u201325","DOI":"10.1109\/HASE.2015.26"},{"key":"1241_CR36","doi-asserted-by":"crossref","unstructured":"Habibi Lashkari A, Draper Gil G, Mamun MSI, Ghorbani AA (2017) Characterization of tor traffic using time based features. In: Proceedings 3rd International Conference on Information System Security and Privacy. SCITEPRESS-Science and Technology Publications, pp 253\u201362","DOI":"10.5220\/0006105602530262"},{"key":"1241_CR37","doi-asserted-by":"crossref","unstructured":"Bai L, Yao L, Kanhere SS, Wang X, Yang Z (2018) Automatic device classification from network traffic streams of internet of things. 2018 IEEE 43rd Conference on Local Computing Networks. IEEE, pp 1\u20139","DOI":"10.1109\/LCN.2018.8638232"},{"key":"1241_CR38","doi-asserted-by":"crossref","unstructured":"Doshi R, Apthorpe N, Feamster N (2018) Machine learning DDoS detection for consumer internet of things devices. 2018 IEEE Security and Privacy Work. IEEE, pp 29\u201335","DOI":"10.1109\/SPW.2018.00013"},{"key":"1241_CR39","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1590\/0103-8478cr20160946","volume":"47","author":"MAB Vaz","year":"2017","unstructured":"Vaz MAB, Pacheco PS, Seidel EJ, Ansuj AP (2017) Classification of the coefficient of variation to variables in beef cattle experiments. Ci\u00eancia Rural 47:9\u201312","journal-title":"Ci\u00eancia Rural"},{"key":"1241_CR40","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1590\/S0103-84782013000600003","volume":"43","author":"MF Couto","year":"2017","unstructured":"Couto MF, Peternelli LA, Barbosa MHP (2017) Classification of the coefficients of variation for sugarcane crops. Ci\u00eancia Rural 43:957\u2013961","journal-title":"Ci\u00eancia Rural"},{"key":"1241_CR41","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1590\/S1678-77572005000300008","volume":"13","author":"FL Romano","year":"2005","unstructured":"Romano FL, Ambrosano GMB, de Magnani MBB, Nouer DF (2005) Analysis of the coefficient of variation in shear and tensile bond strength tests. J Appl Oral Sci 13:243\u2013246","journal-title":"J Appl Oral Sci"},{"key":"1241_CR42","doi-asserted-by":"publisher","first-page":"565","DOI":"10.14295\/cs.v9i4.2619","volume":"9","author":"AASN de Ferreira","year":"2019","unstructured":"de Ferreira AASN, Dourado LRB, Biagiotti D, da Santos NP, Nascimento DCN, Sousa KRS (2019) Methods for classifying coefficients of variation in experimentation with poultrys. Comun Sci 9:565\u2013574","journal-title":"Comun Sci"},{"key":"1241_CR43","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1007\/s11408-017-0292-1","volume":"31","author":"PA Ernst","year":"2017","unstructured":"Ernst PA, Thompson JR, Miao Y (2017) Tukey\u2019s transformational ladder for portfolio management. Financ Mark Portf Manag 31:317\u2013355. https:\/\/doi.org\/10.1007\/s11408-017-0292-1","journal-title":"Financ Mark Portf Manag"},{"key":"1241_CR44","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1515\/bile-2015-0008","volume":"52","author":"Z Hanusz","year":"2015","unstructured":"Hanusz Z, Tarasi\u0144ska J (2015) Normalization of the Kolmogorov-Smirnov and Shapiro-Wilk tests of normality. Biometrical Lett 52:85\u201393","journal-title":"Biometrical Lett"},{"key":"1241_CR45","doi-asserted-by":"publisher","DOI":"10.1007\/0-387-25465-X_45","author":"L Rokach","year":"2006","unstructured":"Rokach L (2006) Ensemble methods for classifiers. Data Min Knowl Discov Handb. https:\/\/doi.org\/10.1007\/0-387-25465-X_45","journal-title":"Data Min Knowl Discov Handb"},{"key":"1241_CR46","doi-asserted-by":"crossref","unstructured":"Zhou SK, Park JH, Georgescu B, Comaniciu D, Simopoulos C, Otsuki J (2006) Image-Based multiclass boosting and echocardiographic view classification. IEEE Computer Society Conference\u00a0on\u00a0Computer\u00a0Vision and\u00a0Pattern Recognition. IEEE, pp 1559\u201365","DOI":"10.1109\/CVPR.2006.146"},{"key":"1241_CR47","doi-asserted-by":"publisher","first-page":"1616","DOI":"10.1109\/JIOT.2017.2787959","volume":"5","author":"S Egea","year":"2018","unstructured":"Egea S, Rego Manez A, Carro B, Sanchez-Esguevillas A, Lloret J (2018) Intelligent IoT traffic classification using novel search strategy for fast-based-correlation feature selection in industrial environments. IEEE Internet Things J 5:1616\u20131624","journal-title":"IEEE Internet Things J"},{"key":"1241_CR48","doi-asserted-by":"crossref","unstructured":"Zainal A, Maarof MA, Shamsuddin SM (2006) Feature selection using rough set in intrusion detection. TENCON 2006 IEEE Reg 10 Conference. IEEE, pp. 1\u20134","DOI":"10.1109\/TENCON.2006.344210"},{"key":"1241_CR49","first-page":"1289","volume":"3","author":"G Forman","year":"2003","unstructured":"Forman G (2003) An extensive empirical study of feature selection metrics for text classification. J Mach Learn Res 3:1289\u20131305","journal-title":"J Mach Learn Res"},{"key":"1241_CR50","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1016\/j.artmed.2004.01.007","volume":"31","author":"I Inza","year":"2004","unstructured":"Inza I, Larra\u00f1aga P, Blanco R, Cerrolaza AJ (2004) Filter versus wrapper gene selection approaches in DNA microarray domains. Artif Intell Med 31:91\u2013103","journal-title":"Artif Intell Med"},{"key":"1241_CR51","doi-asserted-by":"crossref","unstructured":"Jovic A, Brkic K, Bogunovic N (2015) A review of feature selection methods with applications. 2015 38th International\u00a0Conference on\u00a0Information\u00a0and\u00a0Communication Technology. IEEE, pp 1200\u20135","DOI":"10.1109\/MIPRO.2015.7160458"},{"key":"1241_CR52","unstructured":"Osanaiye O, Choo K-KR, Dlodlo M (2016) Analysing feature selection and classification techniques for DDoS detection in cloud. Southern Africa\u00a0Telecommunication Networks\u00a0and\u00a0Applications Conference, pp 198\u2013203"},{"key":"1241_CR53","unstructured":"Yu L, Liu H (2003) Feature selection for high-dimensional data: a fast correlation-based filter solution. Proceedings of the\u00a0Twenty-First\u00a0International Conference\u00a0on\u00a0Machine Learning, pp 856\u201363"},{"key":"1241_CR54","unstructured":"Cviti\u0107 I (2020) Network traffic anomaly detection based on traffic characteristics and device class affiliation. Doctoral thesis. University of Zagreb."},{"key":"1241_CR55","first-page":"256","volume":"24","author":"R Longadge","year":"2013","unstructured":"Longadge R, Dongre S (2013) Class imbalance problem in data mining review. Eur J Intern Med 24:256","journal-title":"Eur J Intern Med"},{"key":"1241_CR56","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1214\/aos\/1016218223","volume":"28","author":"J Friedman","year":"2000","unstructured":"Friedman J, Hastie T, Tibshirani R (2000) Additive logistic regression: a statistical view of boosting. Ann Stat 28:337\u2013407","journal-title":"Ann Stat"},{"key":"1241_CR57","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1007\/s10994-005-0466-3","volume":"59","author":"N Landwehr","year":"2005","unstructured":"Landwehr N, Hall M, Frank E (2005) Logistic Model Trees. Mach Learn 59:161\u2013205","journal-title":"Mach Learn"},{"key":"1241_CR58","unstructured":"Raschka S (2018) Model evaluation, model selection, and algorithm selection in machine learning. arXiv. http:\/\/arxiv.org\/abs\/1811.12808 Accessed 13 Nov 2020"},{"key":"1241_CR59","first-page":"01","volume":"5","author":"M Hossin","year":"2015","unstructured":"Hossin M, Sulaiman M (2015) A review on evaluation metrics for data classification evaluations. Int J Data Min Knowl Manag Process 5:01\u201311","journal-title":"Int J Data Min Knowl Manag Process"},{"key":"1241_CR60","first-page":"393","volume":"588","author":"A Seletkovi\u0107","year":"2008","unstructured":"Seletkovi\u0107 A, Pernar R, Jazbec A, An\u010di\u0107 M (2008) To\u010dnost klasifikacije satelitske snimke visoke prostorne rezolucije ikonos za potrebe \u0161umarstva. \u0160umarski List 588:393\u2013404","journal-title":"\u0160umarski List"},{"key":"1241_CR61","first-page":"1","volume":"1","author":"Y Sasaki","year":"2007","unstructured":"Sasaki Y (2007) The truth of the F-measure. Teach Tutor Mater 1:1\u20136","journal-title":"Teach Tutor Mater"}],"container-title":["International Journal of Machine Learning and Cybernetics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13042-020-01241-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13042-020-01241-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13042-020-01241-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,23]],"date-time":"2021-10-23T00:07:21Z","timestamp":1634947641000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s13042-020-01241-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,3]]},"references-count":61,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2021,11]]}},"alternative-id":["1241"],"URL":"https:\/\/doi.org\/10.1007\/s13042-020-01241-0","relation":{},"ISSN":["1868-8071","1868-808X"],"issn-type":[{"value":"1868-8071","type":"print"},{"value":"1868-808X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,3]]},"assertion":[{"value":"31 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 November 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 January 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}