{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T16:01:55Z","timestamp":1781107315877,"version":"3.54.1"},"reference-count":85,"publisher":"IGI Global Scientific Publishing","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,7]]},"abstract":"<jats:p>The emerging area of the internet of things (IoT) generates a large amount of data from IoT applications such as health care, smart cities, etc. This data needs to be analyzed in order to derive useful inferences. Machine learning (ML) plays a significant role in analyzing such data. It becomes difficult to select optimal algorithm from the available set of algorithms\/classifiers to obtain best results. The performance of algorithms differs when applied to datasets from different application domains. In learning, it is difficult to understand if the difference in performance is real or due to random variation in test data, training data, or internal randomness of the learning algorithms. This study takes into account these issues during a comparison of ML algorithms for binary and multivariate classification. It helps in providing guidelines for statistical validation of results. The results obtained show that the performance measure of accuracy for one algorithm differs by critical difference (CD) than others over binary and multivariate datasets obtained from different application domains.<\/jats:p>","DOI":"10.4018\/ijaci.2020070105","type":"journal-article","created":{"date-parts":[[2020,7,1]],"date-time":"2020-07-01T08:20:26Z","timestamp":1593591626000},"page":"80-105","source":"Crossref","is-referenced-by-count":17,"title":["Statistical Study of Machine Learning Algorithms Using Parametric and Non-Parametric Tests"],"prefix":"10.4018","volume":"11","author":[{"given":"Vijay M.","family":"Khadse","sequence":"first","affiliation":[{"name":"College of Engineering Pune, (CoEP), Pune, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Parikshit Narendra","family":"Mahalle","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence and Data Science, Bansilal Ramnath Agarwal Charitable Trust's, Vishwakarma Institute of Information Technology, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6623-8722","authenticated-orcid":true,"given":"Gitanjali R.","family":"Shinde","sequence":"additional","affiliation":[{"name":"Smt. Kashibai Navale College of Engineering, Pune, India"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"IJACI.2020070105-0","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2016.09.068"},{"key":"IJACI.2020070105-1","unstructured":"Asuncion, A. & Newman, D. (2007). UCI machine learning repository."},{"key":"IJACI.2020070105-2","doi-asserted-by":"publisher","DOI":"10.1887\/0852742622"},{"issue":"September","key":"IJACI.2020070105-3","first-page":"1089","article-title":"No unbiased estimator of the variance of k-fold cross-validation.","volume":"5","author":"Y.Bengio","year":"2004","journal-title":"Journal of Machine Learning Research"},{"key":"IJACI.2020070105-4","doi-asserted-by":"publisher","DOI":"10.1145\/380995.380999"},{"key":"IJACI.2020070105-5","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"IJACI.2020070105-6","doi-asserted-by":"publisher","DOI":"10.1201\/9781315139470"},{"key":"IJACI.2020070105-7","doi-asserted-by":"publisher","DOI":"10.1016\/j.rse.2008.09.005"},{"key":"IJACI.2020070105-8","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009715923555"},{"key":"IJACI.2020070105-9","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143865"},{"key":"IJACI.2020070105-10","doi-asserted-by":"publisher","DOI":"10.1155\/2015\/431047"},{"key":"IJACI.2020070105-11","doi-asserted-by":"publisher","DOI":"10.1007\/BF00993481"},{"key":"IJACI.2020070105-12","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1967.1053964"},{"key":"IJACI.2020070105-13","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511801389"},{"issue":"Jan","key":"IJACI.2020070105-14","first-page":"1","article-title":"Statistical comparisons of classifiers over multiple data sets.","volume":"7","author":"J.Dem\u0161ar","year":"2006","journal-title":"Journal of Machine Learning Research"},{"key":"IJACI.2020070105-15","doi-asserted-by":"crossref","unstructured":"Derguech, W., Bruke, E., & Curry, E. (2014). An autonomic approach to real-time predictive analytics using open data and internet of things. In Proceedings of the 2014 IEEE 11th Intl Conf on Ubiquitous Intelligence and Computing and 2014 IEEE 11th Intl Conf on Autonomic and Trusted Computing and 2014 IEEE 14th Intl Conf on Scalable Computing and Communications and Its Associated Workshops (pp. 204-211). IEEE Press.","DOI":"10.1109\/UIC-ATC-ScalCom.2014.137"},{"key":"IJACI.2020070105-16","doi-asserted-by":"publisher","DOI":"10.4018\/978-1-5225-0140-4"},{"key":"IJACI.2020070105-17","doi-asserted-by":"publisher","DOI":"10.1201\/9780429440953"},{"key":"IJACI.2020070105-18","doi-asserted-by":"publisher","DOI":"10.1162\/089976698300017197"},{"key":"IJACI.2020070105-19","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007413511361"},{"key":"IJACI.2020070105-20","unstructured":"Duda, R. O., & Hart, P. E. (1973). Pattern recognition and scene analysis."},{"key":"IJACI.2020070105-21","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1976.5408784"},{"key":"IJACI.2020070105-22","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1961.10482090"},{"key":"IJACI.2020070105-23","doi-asserted-by":"publisher","DOI":"10.1016\/j.rse.2011.11.020"},{"key":"IJACI.2020070105-24","first-page":"771","article-title":"A short introduction to boosting.","volume":"14","author":"Y.Freund","year":"1999","journal-title":"Jink\u014d Chin\u014d Gakkaishi"},{"key":"IJACI.2020070105-25","unstructured":"Freund, Y., & Schapire, R. E. (1996, July). Experiments with a new boosting algorithm. In ICML (Vol. 96, pp. 148-156)."},{"key":"IJACI.2020070105-26","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1997.1504"},{"key":"IJACI.2020070105-27","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1013203451"},{"key":"IJACI.2020070105-28","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-9473(01)00065-2"},{"key":"IJACI.2020070105-29","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1937.10503522"},{"key":"IJACI.2020070105-30","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177731944"},{"issue":"December","key":"IJACI.2020070105-31","first-page":"2677","article-title":"An extension on \u201cstatistical comparisons of classifiers over multiple data sets\u201d for all pairwise comparisons.","volume":"9","author":"S.Garcia","year":"2008","journal-title":"Journal of Machine Learning Research"},{"key":"IJACI.2020070105-32","doi-asserted-by":"publisher","DOI":"10.14569\/IJACSA.2013.040406"},{"key":"IJACI.2020070105-33","doi-asserted-by":"publisher","DOI":"10.1504\/IJAIP.2019.098578"},{"key":"IJACI.2020070105-34","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2005.08.011"},{"key":"IJACI.2020070105-35","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2018.1700304"},{"key":"IJACI.2020070105-36","author":"S. S.Haykin","year":"2009","journal-title":"Neural networks and learning machines\/Simon Haykin"},{"key":"IJACI.2020070105-37","doi-asserted-by":"publisher","DOI":"10.1109\/5254.708428"},{"key":"IJACI.2020070105-38","doi-asserted-by":"publisher","DOI":"10.1201\/9781420075779"},{"key":"IJACI.2020070105-39","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/75.4.800"},{"key":"IJACI.2020070105-40","first-page":"65","article-title":"A simple sequentially rejective multiple test procedure.","author":"S.Holm","year":"1979","journal-title":"Scandinavian Journal of Statistics"},{"key":"IJACI.2020070105-41","doi-asserted-by":"publisher","DOI":"10.1002\/9781118548387"},{"key":"IJACI.2020070105-42","doi-asserted-by":"publisher","DOI":"10.1080\/01431160110040323"},{"key":"IJACI.2020070105-43","doi-asserted-by":"publisher","DOI":"10.1080\/03610928008827904"},{"key":"IJACI.2020070105-44","doi-asserted-by":"publisher","DOI":"10.1145\/1071610.1071612"},{"key":"IJACI.2020070105-45","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1985.6313426"},{"key":"IJACI.2020070105-46","doi-asserted-by":"publisher","DOI":"10.1016\/j.csda.2009.04.009"},{"key":"IJACI.2020070105-47","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2006.12.017"},{"issue":"2","key":"IJACI.2020070105-48","first-page":"1137","article-title":"A study of cross-validation and bootstrap for accuracy estimation and model selection.","volume":"14","author":"R.Kohavi","year":"1995","journal-title":"IJCAI (United States)"},{"key":"IJACI.2020070105-49","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2017.49"},{"key":"IJACI.2020070105-50","doi-asserted-by":"publisher","DOI":"10.1109\/IGARSS.2006.1006"},{"key":"IJACI.2020070105-51","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0026666"},{"key":"IJACI.2020070105-52","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2015.2495229"},{"key":"IJACI.2020070105-53","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2005.07.041"},{"key":"IJACI.2020070105-54","doi-asserted-by":"publisher","DOI":"10.1155\/2014\/240217"},{"key":"IJACI.2020070105-55","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.03.042"},{"key":"IJACI.2020070105-56","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2008.11.041"},{"key":"IJACI.2020070105-57","unstructured":"Mason, L., Baxter, J., Bartlett, P. L., & Frean, M. R. (2000). Boosting algorithms as gradient descent. In Advances in neural information processing systems (pp. 512-518). Academic Press."},{"key":"IJACI.2020070105-58","doi-asserted-by":"publisher","DOI":"10.1023\/A:1024068626366"},{"key":"IJACI.2020070105-59","doi-asserted-by":"publisher","DOI":"10.3389\/fnbot.2013.00021"},{"key":"IJACI.2020070105-60","doi-asserted-by":"publisher","DOI":"10.1016\/j.jag.2009.11.002"},{"key":"IJACI.2020070105-61","doi-asserted-by":"publisher","DOI":"10.1080\/01431160412331269698"},{"key":"IJACI.2020070105-62","doi-asserted-by":"publisher","DOI":"10.1109\/72.159058"},{"key":"IJACI.2020070105-63","doi-asserted-by":"publisher","DOI":"10.1080\/00220670209598786"},{"key":"IJACI.2020070105-64","doi-asserted-by":"publisher","DOI":"10.1007\/BF00116251"},{"key":"IJACI.2020070105-65","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-934613-41-5.50007-6"},{"key":"IJACI.2020070105-66","author":"J. R.Quinlan","year":"2014","journal-title":"C4. 5: programs for machine learning"},{"key":"IJACI.2020070105-67","unstructured":"Rish, I. (2001, August). An empirical study of the naive Bayes classifier. In IJCAI 2001 workshop on empirical methods in artificial intelligence (Vol. 3, No. 22, pp. 41-46). Academic Press."},{"key":"IJACI.2020070105-68","author":"R.Rojas","year":"2013","journal-title":"Neural networks: a systematic introduction"},{"key":"IJACI.2020070105-69","doi-asserted-by":"publisher","DOI":"10.1109\/21.97458"},{"key":"IJACI.2020070105-70","doi-asserted-by":"publisher","DOI":"10.1201\/9781420036268"},{"key":"IJACI.2020070105-71","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995316"},{"key":"IJACI.2020070105-72","doi-asserted-by":"publisher","DOI":"10.1109\/ISIT.2006.261976"},{"issue":"June","key":"IJACI.2020070105-73","first-page":"1277","article-title":"Bayesian quadratic discriminant analysis.","volume":"8","author":"S.Srivastava","year":"2007","journal-title":"Journal of Machine Learning Research"},{"key":"IJACI.2020070105-74","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018628609742"},{"key":"IJACI.2020070105-75","author":"P. N.Tan","year":"2016","journal-title":"Introduction to data mining"},{"key":"IJACI.2020070105-76","doi-asserted-by":"publisher","DOI":"10.1016\/j.enbuild.2017.11.039"},{"key":"IJACI.2020070105-77","doi-asserted-by":"publisher","DOI":"10.2478\/v10006-012-0064-z"},{"key":"IJACI.2020070105-78","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273614"},{"key":"IJACI.2020070105-79","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-4625-2"},{"key":"IJACI.2020070105-80","doi-asserted-by":"publisher","DOI":"10.2307\/2532694"},{"key":"IJACI.2020070105-81","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2007.02.026"},{"key":"IJACI.2020070105-82","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-007-0114-2"},{"key":"IJACI.2020070105-83","doi-asserted-by":"crossref","first-page":"2061","DOI":"10.1145\/1645953.1646301","article-title":"Stochastic gradient boosted distributed decision trees.","author":"J.Ye","year":"2009","journal-title":"Proceedings of the 18th ACM conference on Information and knowledge management"},{"key":"IJACI.2020070105-84","doi-asserted-by":"publisher","DOI":"10.1109\/ITI.2005.1491151"}],"container-title":["International Journal of Ambient Computing and Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=258073","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T02:02:46Z","timestamp":1651802566000},"score":1,"resource":{"primary":{"URL":"http:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/IJACI.2020070105"}},"subtitle":["A Comparative Analysis and Recommendations"],"short-title":[],"issued":{"date-parts":[[2020,7]]},"references-count":85,"journal-issue":{"issue":"3"},"URL":"https:\/\/doi.org\/10.4018\/ijaci.2020070105","relation":{},"ISSN":["1941-6237","1941-6245"],"issn-type":[{"value":"1941-6237","type":"print"},{"value":"1941-6245","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7]]}}}