{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:34:26Z","timestamp":1760236466328,"version":"build-2065373602"},"reference-count":70,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,11,29]],"date-time":"2021-11-29T00:00:00Z","timestamp":1638144000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Typical applications of wireless sensor networks (WSN), such as in Industry 4.0 and smart cities, involves acquiring and processing large amounts of data in federated systems. Important challenges arise for machine learning algorithms in this scenario, such as reducing energy consumption and minimizing data exchange between devices in different zones. This paper introduces a novel method for accelerated training of parallel Support Vector Machines (pSVMs), based on ensembles, tailored to these kinds of problems. To achieve this, the training set is split into several Voronoi regions. These regions are small enough to permit faster parallel training of SVMs, reducing computational payload. Results from experiments comparing the proposed method with a single SVM and a standard ensemble of SVMs demonstrate that this approach can provide comparable performance while limiting the number of regions required to solve classification tasks. These advantages facilitate the development of energy-efficient policies in WSN.<\/jats:p>","DOI":"10.3390\/e23121605","type":"journal-article","created":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T04:48:37Z","timestamp":1638247717000},"page":"1605","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Toward Accelerated Training of Parallel Support Vector Machines Based on Voronoi Diagrams"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9146-4067","authenticated-orcid":false,"given":"Cesar","family":"Alfaro","sequence":"first","affiliation":[{"name":"Department of Computer Science, University Rey Juan Carlos, 28933 M\u00f3stoles, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6434-7263","authenticated-orcid":false,"given":"Javier","family":"Gomez","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University Rey Juan Carlos, 28933 M\u00f3stoles, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1415-1961","authenticated-orcid":false,"given":"Javier M.","family":"Moguerza","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University Rey Juan Carlos, 28933 M\u00f3stoles, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2651-745X","authenticated-orcid":false,"given":"Javier","family":"Castillo","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University Rey Juan Carlos, 28933 M\u00f3stoles, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5261-5352","authenticated-orcid":false,"given":"Jose I.","family":"Martinez","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University Rey Juan Carlos, 28933 M\u00f3stoles, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation Applied to Handwritten Zip Code Recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sch\u00f6lkopf, B., and Smola, A.J. (2002). Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, MIT Press.","DOI":"10.7551\/mitpress\/4175.001.0001"},{"key":"ref_4","unstructured":"Clarkson, K.L. (1985). Algorithms for Closest-Point Problems (Computational Geometry). [Ph.D. Thesis, Stanford University]."},{"key":"ref_5","unstructured":"Graf, H.P., Cosatto, E., Bottou, L., Durdanovic, I., and Vapnik, V. (2004, January 13\u201318). Parallel Support Vector Machines: The Cascade SVM. Proceedings of the Advances in Neural Information Processing Systems 17 [Neural Information Processing Systems, NIPS 2004, Vancouver, BC, Canada."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Chang, E.Y. (2011). PSVM: Parallelizing Support Vector Machines on Distributed Computers. Foundations of Large-Scale Multimedia Information Management and Retrieval: Mathematics of Perception, Springer.","DOI":"10.1007\/978-3-642-20429-6_10"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Caruana, G., Li, M., and Qi, M. (2011, January 26\u201328). A MapReduce based parallel SVM for large scale spam filtering. Proceedings of the 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), Shanghai, China.","DOI":"10.1109\/FSKD.2011.6020074"},{"key":"ref_8","unstructured":"Arampatzis, T., Lygeros, J., and Manesis, S. (2005, January 27\u201329). A Survey of Applications of Wireless Sensors and Wireless Sensor Networks. Proceedings of the 2005 IEEE International Symposium on, Mediterrean Conference on Control and Automation Intelligent Control, Limassol, Cyprus."},{"key":"ref_9","unstructured":"Boukerche, A., and de Araujo, R.B. (2005, January 13). Decentralized intrusion detection in wireless sensor networks. Proceedings of the Q2SWinet\u201905\u2014Proceedings of the First ACM Workshop on Q2S and Security for Wireless and Mobile Networks, Montreal, QC, Canada."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Han, Z., Gao, R.X., and Fan, Z. (2012, January 13\u201316). Occupancy and indoor environment quality sensing for smart buildings. Proceedings of the 2012 IEEE International Instrumentation and Measurement Technology Conference Proceedings, Graz, Austria.","DOI":"10.1109\/I2MTC.2012.6229557"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"11:1","DOI":"10.1145\/1814539.1814550","article-title":"MEDiSN: Medical emergency detection in sensor networks","volume":"10","author":"Ko","year":"2010","journal-title":"ACM Trans. Embed. Comput. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1016\/j.future.2018.08.007","article-title":"Multi-dimensional data indexing and range query processing via Voronoi diagram for internet of things","volume":"91","author":"Wan","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1515\/crll.1908.134.198","article-title":"Nouvelles applications des param\u00e8tres continus \u00e0 la th\u00e9orie des formes quadratiques. Deuxi\u00e8me m\u00e9moire. Recherches sur les parall\u00e9llo\u00e8dres primitifs","volume":"1908","author":"Voronoi","year":"1908","journal-title":"J. Reine Angew. Math. (Crelles J.)"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1961189.1961199","article-title":"LIBSVM: A library for Support Vector Machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Trans. Intell. Syst. Technol. (TIST)"},{"key":"ref_15","unstructured":"Breiman, L. (2021, November 29). Some Infinity Theory for Predictor Ensembles. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.87.5037&rep=rep1&type=pdf."},{"key":"ref_16","unstructured":"Hu, Z., Cai, Y., Li, Y., and Xu, X. (2005, January 8\u201310). Support vector machine based ensemble classifier. Proceedings of the 2005 American Control Conference, Portland, OR, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.inffus.2018.09.013","article-title":"Machine learning algorithms for wireless sensor networks: A survey","volume":"49","author":"Donta","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.disopt.2015.03.002","article-title":"Fast training of Support Vector Machines with Gaussian kernel","volume":"22","author":"Fischetti","year":"2016","journal-title":"Discret. Optim."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1214\/088342306000000493","article-title":"Support Vector Machines with applications","volume":"21","author":"Moguerza","year":"2006","journal-title":"Stat. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1476","DOI":"10.1016\/j.eswa.2013.08.044","article-title":"Breast cancer diagnosis based on feature extraction using a hybrid of K-means and support vector machine algorithms","volume":"41","author":"Zheng","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/s10479-013-1449-6","article-title":"A multi-stage method for content classification and opinion mining on weblog comments","volume":"236","author":"Alfaro","year":"2016","journal-title":"Ann. Oper. Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-017-17864-3","article-title":"Detection of American football head impacts using biomechanical features and support vector machine classification","volume":"8","author":"Wu","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1109\/JSEN.2017.2771226","article-title":"Fault detection in wireless sensor networks through SVM classifier","volume":"18","author":"Zidi","year":"2017","journal-title":"IEEE Sensors J."},{"key":"ref_25","unstructured":"Osuna, E., Freund, R., and Girosi, F. (1997, January 24\u201326). An improved training algorithm for Support Vector Machines. Proceedings of the Neural networks for signal processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop, Amelia Island, FL, USA."},{"key":"ref_26","unstructured":"Joachims, T. (2021, November 29). Making Large-Scale SVM Learning Practical. Available online: https:\/\/www.cs.cornell.edu\/people\/tj\/publications\/joachims_99a.pdf."},{"key":"ref_27","unstructured":"Kearns, M.J., Solla, S.A., and Cohn, D.A. (1998). Using Analytic QP and Sparseness to Speed Training of Support Vector Machines. Advances in Neural Information Processing Systems 11, NIPS Conference, Denver, CO, USA, 30 November\u20135 December 1998, The MIT Press."},{"key":"ref_28","first-page":"59","article-title":"Fast SVM training using approximate extreme points","volume":"15","author":"Nandan","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_29","unstructured":"Kuncheva, L.I. (2021, November 29). Combining Pattern Classifiers: Methods and Algorithms, 2nd ed. Available online: https:\/\/www.wiley.com\/en-in\/Combining+Pattern+Classifiers%3A+Methods+and+Algorithms%2C+2nd+Edition-p-9781118315231."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/BF00116037","article-title":"The strength of weak learnability","volume":"5","author":"Schapire","year":"1990","journal-title":"Mach. Learn."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.eswa.2017.07.019","article-title":"Opinion mining using ensemble text hidden Markov models for text classification","volume":"94","author":"Kang","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_33","unstructured":"Deng, L., and Platt, J. (2021, November 29). Ensemble deep learning for speech recognition. Available online: https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/02\/EnsembleDL_submitted.pdf."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zvarevashe, K., and Olugbara, O. (2020). Ensemble learning of hybrid acoustic features for speech emotion recognition. Algorithms, 13.","DOI":"10.3390\/a13030070"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.eswa.2017.02.002","article-title":"Enhancing deep learning sentiment analysis with ensemble techniques in social applications","volume":"77","author":"Araque","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1733","DOI":"10.1093\/bib\/bbz098","article-title":"DeepSVM-fold: Protein fold recognition by combining Support Vector Machines and pairwise sequence similarity scores generated by deep learning networks","volume":"21","author":"Liu","year":"2020","journal-title":"Briefings Bioinform."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3053","DOI":"10.1007\/s00521-020-05172-3","article-title":"Super ensemble learning for daily streamflow forecasting: Large-scale demonstration and comparison with multiple machine learning algorithms","volume":"33","author":"Tyralis","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"9835","DOI":"10.1007\/s00500-019-04499-x","article-title":"An ensemble based on neural networks with random weights for online data stream regression","volume":"24","author":"Goh","year":"2020","journal-title":"Soft Comput."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"El Hindi, K., AlSalman, H., Qasem, S., and Al Ahmadi, S. (2018). Building an ensemble of fine-tuned naive Bayesian classifiers for text classification. Entropy, 20.","DOI":"10.3390\/e20110857"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.inffus.2010.11.004","article-title":"Random feature weights for decision tree ensemble construction","volume":"13","author":"Maudes","year":"2012","journal-title":"Inf. Fusion"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.cose.2019.05.022","article-title":"A novel approach to intrusion detection using SVM ensemble with feature augmentation","volume":"86","author":"Gu","year":"2019","journal-title":"Comput. Secur."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Huang, M.W., Chen, C.W., Lin, W.C., Ke, S.W., and Tsai, C.F. (2017). SVM and SVM ensembles in breast cancer prediction. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0161501"},{"key":"ref_43","first-page":"503","article-title":"Spatial tessellations","volume":"1","author":"Boots","year":"1999","journal-title":"Geogr. Inf. Syst."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1137\/S0036144599352836","article-title":"Centroidal Voronoi tessellations: Applications and algorithms","volume":"41","author":"Du","year":"1999","journal-title":"SIAM Rev."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1007\/s10207-013-0203-z","article-title":"Understanding the spread of malicious mobile-phone programs and their damage potential","volume":"12","author":"Wang","year":"2013","journal-title":"Int. J. Inf. Secur."},{"key":"ref_46","unstructured":"Hartigan, J.A. (1975). Clustering Algorithms, John Wiley & Sons, Inc."},{"key":"ref_47","unstructured":"Jain, A.K., and Dubes, R.C. (1988). Algorithms for Clustering Data, Pearson Education, Inc.. Prentice Hall."},{"key":"ref_48","unstructured":"Preparata, F.P., and Shamos, M.I. (2012). Computational Geometry: An Introduction, Springer Science & Business Media."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1142\/S0218195998000187","article-title":"Voronoi diagrams of moving points","volume":"8","author":"Albers","year":"1998","journal-title":"Int. J. Comput. Geom. Appl."},{"key":"ref_50","unstructured":"Berchtold, S., Ertl, B., Keim, D.A., Kriegel, H.P., and Seidl, T. (1998, January 23\u201327). Fast nearest neighbor search in high-dimensional space. Proceedings of the 14th International Conference on Data Engineering, Orlando, FL, USA."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"101301","DOI":"10.1016\/j.jocs.2021.101301","article-title":"Voronoi diagram and Monte-Carlo simulation based finite element optimization for cost-effective 3D printing","volume":"50","author":"Zheng","year":"2021","journal-title":"J. Comput. Sci."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1109\/2945.856998","article-title":"Conformal surface parameterization for texture mapping","volume":"6","author":"Haker","year":"2000","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"123","DOI":"10.4321\/S1578-84232015000100012","article-title":"Using voronoi diagrams to describe tactical behaviour in invasive team sports: An application in basketball","volume":"15","author":"Lopes","year":"2015","journal-title":"Cuad. Psicol. Deporte"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"86026","DOI":"10.1109\/ACCESS.2019.2925623","article-title":"Mobile robot path planning in dynamic environment using Voronoi diagram and computation geometry technique","volume":"7","author":"Ayawli","year":"2019","journal-title":"IEEE Access"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1007\/s00521-014-1780-0","article-title":"Using Voronoi diagrams to improve classification performances when modeling imbalanced datasets","volume":"26","author":"Young","year":"2015","journal-title":"Neural Comput. Appl."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Silva, E.J., and Zanchettin, C. (2016, January 9\u201312). A voronoi diagram based classifier for multiclass imbalanced data sets. Proceedings of the 2016 5th Brazilian Conference on Intelligent Systems (BRACIS), Recife, Brazil.","DOI":"10.1109\/BRACIS.2016.030"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"de Carvalho, A.M., and Prati, R.C. (2020). DTO-SMOTE: Delaunay Tessellation Oversampling for Imbalanced Data Sets. Information, 11.","DOI":"10.3390\/info11120557"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least squares quantization in PCM","volume":"28","author":"Lloyd","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/BF02294245","article-title":"An examination of procedures for determining the number of clusters in a data set","volume":"50","author":"Milligan","year":"1985","journal-title":"Psychometrika"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1111\/1467-9868.00293","article-title":"Estimating the number of clusters in a data set via the gap statistic","volume":"63","author":"Tibshirani","year":"2001","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1198\/016214503000000666","article-title":"Finding the number of clusters in a dataset: An information-theoretic approach","volume":"98","author":"Sugar","year":"2003","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.ins.2018.07.034","article-title":"I-nice: A new approach for identifying the number of clusters and initial cluster centres","volume":"466","author":"Masud","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1080\/01621459.1926.10502161","article-title":"The choice of a class interval","volume":"21","author":"Sturges","year":"1926","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest neighbor pattern classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_66","unstructured":"Krebel, U.G. (2021, November 29). Pairwise classification and Support Vector Machines. Available online: https:\/\/dl.acm.org\/doi\/10.5555\/299094.299108."},{"key":"ref_67","first-page":"1579","article-title":"Fast kernel classifiers with online and active learning","volume":"6","author":"Bordes","year":"2005","journal-title":"J. Mach. Learn. Res."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s10994-009-5103-0","article-title":"NP-hardness of Euclidean sum-of-squares clustering","volume":"75","author":"Aloise","year":"2009","journal-title":"Mach. Learn."},{"key":"ref_69","unstructured":"R Core Team (2021). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"2757","DOI":"10.1016\/S0031-3203(03)00175-4","article-title":"Constructing support vector machine ensemble","volume":"36","author":"Kim","year":"2003","journal-title":"Pattern Recognit."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/12\/1605\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:37:32Z","timestamp":1760168252000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/12\/1605"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,29]]},"references-count":70,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["e23121605"],"URL":"https:\/\/doi.org\/10.3390\/e23121605","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2021,11,29]]}}}