{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T15:56:31Z","timestamp":1762271791983,"version":"build-2065373602"},"reference-count":40,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2014,2,13]],"date-time":"2014-02-13T00:00:00Z","timestamp":1392249600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Feature or variable selection still remains an unsolved problem, due to the infeasible evaluation of all the solution space. Several algorithms based on heuristics have been proposed so far with successful results. However, these algorithms were not designed for considering very large datasets, making their execution impossible, due to the memory and time limitations. This paper presents an implementation of a genetic algorithm that has been parallelized using the classical island approach, but also considering graphic processing units to speed up the computation of the fitness function. Special attention has been paid to the population evaluation, as well as to the migration operator in the parallel genetic algorithm (GA), which is not usually considered too significant; although, as the experiments will show, it is crucial in order to obtain robust results.<\/jats:p>","DOI":"10.3390\/e16020854","type":"journal-article","created":{"date-parts":[[2014,2,13]],"date-time":"2014-02-13T11:20:15Z","timestamp":1392290415000},"page":"854-869","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Fast Feature Selection in a GPU Cluster Using the Delta Test"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9918-3238","authenticated-orcid":false,"given":"Alberto","family":"Guill\u00e9n","sequence":"first","affiliation":[{"name":"Department of Computer Architecture and Computer Technology, Universidad de Granada, Granada 18071, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"M.","family":"Garc\u00eda Arenas","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture and Computer Technology, Universidad de Granada, Granada 18071, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Van Heeswijk","sequence":"additional","affiliation":[{"name":"Department of Information and Computer Science, Aalto University School of Science, Espoo 02150, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dusan","family":"Sovilj","sequence":"additional","affiliation":[{"name":"Department of Information and Computer Science, Aalto University School of Science, Espoo 02150, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amaury","family":"Lendasse","sequence":"additional","affiliation":[{"name":"Department of Information and Computer Science, Aalto University School of Science, Espoo 02150, Finland"},{"name":"IKERBASQUE, Basque Foundation for Science, Bilbao 48011, Spain"},{"name":"Arcada University of Applied Sciences, 00550 Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luis","family":"Herrera","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture and Computer Technology, Universidad de Granada, Granada 18071, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"H\u00e9ctor","family":"Pomares","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture and Computer Technology, Universidad de Granada, Granada 18071, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ignacio","family":"Rojas","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture and Computer Technology, Universidad de Granada, Granada 18071, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2014,2,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bellman, R (1961). Adaptive Control Processes\u2014A Guided Tour, Princeton University Press.","DOI":"10.1515\/9781400874668"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Herrera, L., Pomares, H., Rojas, I., Verleysen, M., and Guill\u00e9n, A (2006, January 10\u201314). Effective Input Variable Selection for Function Approximation. Artificial Neural Networks\u2014ICANN 2006, Athens, Greece. Part I.","DOI":"10.1007\/11840817_5"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/s11063-011-9188-7","article-title":"On the curse of dimensionality in supervised learning of smooth regression functions","volume":"34","author":"Corona","year":"2011","journal-title":"Neural Process. Lett"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1162\/neco.1994.6.3.509","article-title":"Finding the embedding dimension and variable dependencies in time series","volume":"6","author":"Pi","year":"1994","journal-title":"Neural Comput"},{"key":"ref_6","unstructured":"Eirola, E., Liiti\u00e4inen, E., Lendasse, A., Corona, F., and Verleysen, M (2008, January 23\u201325). Using the Delta Test for Variable Selection. Bruges, Belgium."},{"key":"ref_7","unstructured":"Eirola, E (Variable Selection with the Delta Test in Theory and Practice, 2009). Variable Selection with the Delta Test in Theory and Practice, Master\u2019s Thesis, Helsinki University of Technology, Espoo, Finland."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5439","DOI":"10.1016\/j.eswa.2013.03.010","article-title":"Analysing user trust in electronic banking using data mining methods","volume":"40","author":"Nogueras","year":"2013","journal-title":"Expert Syst. Appl"},{"key":"ref_9","unstructured":"Del Moral, R.G., Guill\u00e9n, A., Herrera, L.J., Ca\u00f1as, A., and Rojas, I (2013, January 12\u201314). Parametric and Non-Parametric Feature Selection for Kidney Transplants. Tenerife, Spain."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3692","DOI":"10.1016\/j.neucom.2009.07.004","article-title":"Residual variance estimation in machine learning","volume":"72","author":"Verleysen","year":"2009","journal-title":"Neurocomputing"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s10287-003-0006-1","article-title":"New tools in non-linear modeling and prediction","volume":"1","author":"Jones","year":"2004","journal-title":"Comput. Manag. Sci"},{"key":"ref_12","unstructured":"Garcia, V., Debreuve, E., and Barlaud, M (2008, January 23\u201328). Anchorage, AK, USA."},{"key":"ref_13","unstructured":"Source code for computing KNN using GPU. Available online: http:\/\/www.i3s.unice.fr\/~creative\/KNN\/."},{"key":"ref_14","unstructured":"David, M Mount and Sunil Arya ANN: A Library for Approximate Nearest Neighbor Searching. Available online: http:\/\/www.cs.umd.edu\/mount\/ANN\/."},{"key":"ref_15","first-page":"1427","article-title":"Comparing performance of genetic algorithm with varying crossover in solving examination timetabling problem","volume":"3","author":"Obaid","year":"2012","journal-title":"J. Emerg. Trends Comput. Inf. Sci"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1145\/175247.175259","article-title":"Genetic and evolutionary algorithms come of age","volume":"37","author":"Goldberg","year":"1994","journal-title":"Commun. ACM"},{"key":"ref_17","unstructured":"Jong, K.A.D. (2006). Evolutionary Computation\u2014A Unified Approach, MIT Press."},{"key":"ref_18","unstructured":"Wang, L., and Kazmierski, T (2005, January 22\u201323). VHDL-AMS Based Genetic Optimization of a Fuzzy Logic Controller for Automotive Active Suspension Systems. San Jose, CA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhang, J., Li, S., and Shen, S (2006, January 4\u20138). Extracting Minimum Unsatisfiable Cores with a Greedy Genetic Algorithm. AI 2006: Advances in Artificial Intelligence, Hobart, Australia.","DOI":"10.1007\/11941439_89"},{"key":"ref_20","unstructured":"Maximum wait time for group policy scripts. Available online: http:\/\/technet.microsoft.com\/enus\/library\/cc940027.aspx."},{"key":"ref_21","unstructured":"Minimum acceptable timeout value. Available online: https:\/\/developer.apple.com\/library\/ios\/DOCUMENTATION\/UIKit\/Reference\/UIApplicationClass\/Reference\/Reference.html."},{"key":"ref_22","unstructured":"Maximum time an item in the search\/bind cache remains valid. Available online: http:\/\/httpd.apache.org\/docs\/current\/mod\/mod_ldap.html."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1109\/TEVC.2002.800880","article-title":"Parallelism and evolutionary algorithms","volume":"6","author":"Alba","year":"2002","journal-title":"IEEE Trans. Evol. Comput"},{"key":"ref_24","unstructured":"Guill\u00e9n, A., Rojas, I., Gonz\u00e1lez, J., Pomares, H., Herrera, L., and Paechter, B (2007, January 11\u201314). Boosting the Performance of a Multiobjective Algorithm to Design RBFNNs through Parallelization. Adaptive and Natural Computing Algorithms, Warsaw, Poland."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3541","DOI":"10.1016\/j.neucom.2008.12.037","article-title":"Parallel multiobjective memetic RBFNNs design and feature selection for function approximation problems","volume":"72","author":"Pomares","year":"2009","journal-title":"Neurocomputing"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Guill\u00e9n, A., Rojas, I., Gonz\u00e1lez, J., Pomares, H., Herrera, L., and Paechter, B (2006, January 4\u20138). Improving the Performance of Multi-Objective Genetic Algorithm for Function Approximation through Parallel Islands Specialisation. AI 2006: Advances in Artificial Intelligence, Hobart, Australia.","DOI":"10.1007\/11941439_135"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Cant\u00fa-Paz, E (2000). Efficient and Accurate Parallel Genetic Algorithms, Kluwer Academic Publishers.","DOI":"10.1007\/978-1-4615-4369-5"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/4235.843494","article-title":"Gradual distributed real-coded genetic algorithms","volume":"4","author":"Herrera","year":"2000","journal-title":"IEEE Trans. Evol. Comput"},{"key":"ref_29","unstructured":"Chiwiacowsky, L., de Velho, H., Preto, A., and Stephany, S (2003, January 29\u201331). Identifying Initial Conduction in Heat Conduction Transfer by a Genetic Algorithm: A Parallel Approach. Ouro Preto, Brazil."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1023\/A:1008358805991","article-title":"Influence of the migration policy in parallel distributed GAs with structured and panmictic populations","volume":"12","author":"Alba","year":"2000","journal-title":"Appl. Intell"},{"key":"ref_31","unstructured":"Cant\u00fa-Paz, E (1999, January 13\u201317). Migration Policies and Takeover Times in Parallel Genetic Algorithms. Orlando, FL, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1109\/TEVC.2010.2064322","article-title":"Diversity through multiculturality: Assessing migrant choice policies in an island model","volume":"15","author":"Araujo","year":"2011","journal-title":"IEEE Trans. Evol. Comput"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-S\u00e1nchez, P., Eiben, A.E., Haasdijk, E., Weel, B., and Guerv\u00f3s, J.J.M. (2012, January 11\u201313). Testing Diversity-Enhancing Migration Policies for Hybrid On-Line Evolution of Robot Controllers. M\u00e1laga, Spain.","DOI":"10.1007\/978-3-642-29178-4_6"},{"key":"ref_34","unstructured":"Miki, T.H.M., and Negami, M (1999, January 12\u201315). Distributed Genetic Algorithms with Randomized Migration Rate. Tokyo, Japan."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1006\/jpdc.2002.1851","article-title":"Heterogeneous computing and parallel genetic algorithms","volume":"62","author":"Alba","year":"2002","journal-title":"J. Parallel Distrib. Comput"},{"key":"ref_36","unstructured":"Guill\u00e9n, A., Arenas, M.G., Herrera, L., Pomares, H., and Rojas, I (2011, January 18\u201321). GPU Cluster with MATLAB. Las Vegas, NV, USA."},{"key":"ref_37","first-page":"269","article-title":"Minimising the delta test for variable selection in regression problems","volume":"1","author":"Sovilj","year":"2008","journal-title":"Int. J. High Perform. Syst. Archit"},{"key":"ref_38","unstructured":"StatLib: Data, Software and News from the Statistics Community. Available online: http:\/\/lib.stat.cmu.edu\/datasets\/tecator."},{"key":"ref_39","unstructured":"Environmental and Industrial Machine Learning Group. Anthropometric study of US Children Carried Out in 1977. Available online: http:\/\/research.ics.tkk.fi\/eiml\/datasets.shtml."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Guill\u00e9n, A., Gonz\u00e1lez, J., Rojas, I., Pomares, H., Herrera, L., Valenzuela, O., and Prieto, A (2007). Improving clustering technique for functional approximation problem using fuzzy logic: ICFA algorithm. Neurocomputing.","DOI":"10.1016\/j.neucom.2006.06.017"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/2\/854\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:08:08Z","timestamp":1760216888000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/2\/854"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,2,13]]},"references-count":40,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2014,2]]}},"alternative-id":["e16020854"],"URL":"https:\/\/doi.org\/10.3390\/e16020854","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2014,2,13]]}}}