Fast feature selection in a GPU cluster using the delta test

Entropy

Volumn 16, Issue 2, 2014, Pages 854-869

  Guillén, Alberto ^a   Arenas, M Isabel García ^a   van Heeswijk, Mark ^b   Sovilj, Dusan ^b   Lendasse, Amaury ^b,c,d   Herrera, Luis Javier ^a   Pomares, Héctor ^a   Rojas, Ignacio ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b AALTO UNIVERSITY   (Finland)

^c BASQUE FOUNDATION FOR SCIENCE   (Spain)

^d ARCADA UNIVERSITY OF APPLIED SCIENCES   (Finland)

Author keywords

Big data; Feature selection; General purpose computing on graphics processing units (GPGPU); Variable selection

Indexed keywords

EID: 84894521091     PISSN: None     EISSN: 10994300     Source Type: Journal    
DOI: 10.3390/e16020854     Document Type: Article

References (40)

1. Bellman, R. Adaptive Control Processes-A Guided Tour; Princeton University Press: Princeton, NJ, USA, 1961.
2. Herrera, L.; Pomares, H.; Rojas, I.; Verleysen, M.; Guillén, A. Effective Input Variable Selection for Function Approximation. In Artificial Neural Networks-ICANN 2006, Proceedings of 16th International Conference, Athens, Greece, 10-14 September 2006; Part I, pp. 41-50.
3. Liitiäinen, E.; Corona, F.; Lendasse, A. On the curse of dimensionality in supervised learning of smooth regression functions. Neural Process. Lett. 2011, 34, 133-154.
4. Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379-423.
5. Pi, H.; Peterson, C. Finding the embedding dimension and variable dependencies in time series. Neural Comput. 1994, 6, 509-520.
6. Eirola, E.; Liitiäinen, E.; Lendasse, A.; Corona, F.; Verleysen, M. Using the Delta Test for Variable Selection. In Proceedings of the ESANN 2008, European Symposium on Artificial Neural Networks, Bruges, Belgium, 23-25 April 2008; pp. 25-30.
7. Eirola, E. Variable Selection with the Delta Test in Theory and Practice. Master's Thesis, Helsinki University of Technology, Espoo, Finland, 2009.
8. Liébana-Cabanillas, F.J.; Nogueras, R.; Herrera, L.J.; Guillén, A. Analysing user trust in electronic banking using data mining methods. Expert Syst. Appl. 2013, 40, 5439-5447.
9. Del Moral, R.G.; Guillén, A.; Herrera, L.J.; Cañas, A.; Rojas, I. Parametric and Non-Parametric Feature Selection for Kidney Transplants. In Proceedings of The International Work-Conference on Artificial Neural Networks (IWANN), Tenerife, Spain, 12-14 June 2013; pp. 72-79.
10. Liitiäinen, E.; Verleysen, M.; Corona, F.; Lendasse, A. Residual variance estimation in machine learning. Neurocomputing 2009, 72, 3692-3703.
11. Jones, A.J. New tools in non-linear modeling and prediction. Comput. Manag. Sci. 2004, 1, 109-149.
12. Garcia, V.; Debreuve, E.; Barlaud, M. Fast k Nearest Neighbor Search Using GPU. In Proceedings of the CVPR Workshop on Computer Vision on GPU, Anchorage, AK, USA, 23-28 June 2008.
13. Source code for computing KNN using GPU. Available online: http://www.i3s.unice.fr/~creative/KNN/(accessed on 13 October 2013).
14. David M. Mount and Sunil Arya ANN: A Library for Approximate Nearest Neighbor Searching.Available online: http://www.cs.umd.edu/mõunt/ANN/(accessed on 13 October 2013).
15. Obaid, O.I.; Ahmad, M.; Mostafa, S.A.; Mohammed, M.A. Comparing performance of genetic algorithm with varying crossover in solving examination timetabling problem. J. Emerg. Trends Comput. Inf. Sci. 2012, 3, 1427-1434.
16. Goldberg, D.E. Genetic and evolutionary algorithms come of age. Commun. ACM 1994, 37, 113-119.
17. Jong, K.A.D. Evolutionary Computation-A Unified Approach; MIT Press: Cambridge, MA, USA, 2006; pp. I-IX, 1-256.
18. Wang, L.; Kazmierski, T. VHDL-AMS Based Genetic Optimization of a Fuzzy Logic Controller for Automotive Active Suspension Systems. In Proceedings of the 2005 IEEE International Behavioral Modeling and Simulation Workshop, San Jose, CA, USA, 22-23 September 2005; pp. 124-127.
19. Zhang, J.; Li, S.; Shen, S. Extracting Minimum Unsatisfiable Cores with a Greedy Genetic Algorithm. In AI 2006: Advances in Artificial Intelligence, Proceedings of 19th Australian Joint Conference on Artificial Intelligence, Hobart, Australia, 4-8 December 2006; pp. 847-856.
20. Maximum wait time for group policy scripts. Available online: http://technet.microsoft.com/enus/library/cc940027.aspx (accessed on 1 December 2013).
21. Minimum acceptable timeout value. Available online: https://developer.apple.com/library/ios/DOCUMENTATION/UIKit/Reference/UIApplication Class/Reference/Reference.html (accessed on 1 December 2013).
22. Maximum time an item in the search/bind cache remains valid. Available online: http://httpd.apache.org/docs/current/mod/mod ldap.html (accessed on 1 December 2013).
23. Alba, E.; Tomassini, M. Parallelism and evolutionary algorithms. IEEE Trans. Evol. Comput. 2002, 6, 443-462.
24. Guillén, A.; Rojas, I.; González, J.; Pomares, H.; Herrera, L.; Paechter, B. Boosting the Performance of a Multiobjective Algorithm to Design RBFNNs through Parallelization. In Adaptive and Natural Computing Algorithms, Proceedings of 8th International Conference, Warsaw, Poland, 11-14 April 2007; pp. 85-92.
25. Guillén, A.; Pomares, H.; González, J.; Rojas, I.; Valenzuela, O.; Prieto, B. Parallel multiobjective memetic RBFNNs design and feature selection for function approximation problems. Neurocomputing 2009, 72, 3541-3555.
26. Guillén, A.; Rojas, I.; González, J.; Pomares, H.; Herrera, L.; Paechter, B. Improving the Performance of Multi-Objective Genetic Algorithm for Function Approximation through Parallel Islands Specialisation. In AI 2006: Advances in Artificial Intelligence, Proceedings of 19th Australian Joint Conference on Artificial Intelligence, Hobart, Australia, 4-8 December 2006; pp. 1127-1132.
27. Cantú-Paz, E. Efficient and Accurate Parallel Genetic Algorithms; Kluwer Academic Publishers: Norwell, MA, USA, 2000.
28. Herrera, F.; Lozano, M. Gradual distributed real-coded genetic algorithms. IEEE Trans. Evol. Comput. 2000, 4, 43-63.
29. Chiwiacowsky, L.; de Velho, H.; Preto, A.; Stephany, S. Identifying Initial Conduction in Heat Conduction Transfer by a Genetic Algorithm: A Parallel Approach. In Proceedings of the XXIV iberian Latin-American Congress on Computacional Methods in Engineering, Ouro Preto, Brazil, 29-31 October. 2003; pp. 180-195.
30. Alba, E.; Troya, J.M. Influence of the migration policy in parallel distributed GAs with structured and panmictic populations. Appl. Intell. 2000, 12, 163-181.
31. Cantú-Paz, E. Migration Policies and Takeover Times in Parallel Genetic Algorithms. In Proceedings of Genetic and Evolutionary Computation Conference, Orlando, FL, USA, 13-17 July 1999.
32. Araujo, L.; Guervós, J.J.M. Diversity through multiculturality: Assessing migrant choice policies in an island model. IEEE Trans. Evol. Comput. 2011, 15, 456-469.
33. García-Sánchez, P.; Eiben, A.E.; Haasdijk, E.; Weel, B.; Guervós, J.J.M. Testing Diversity-Enhancing Migration Policies for Hybrid On-Line Evolution of Robot Controllers. In Proceedings of the EvoApplications, Málaga, Spain, 11-13 April 2012; pp. 52-62.
34. Miki, T.H.M.; Negami, M. Distributed Genetic Algorithms with Randomized Migration Rate. In Proceedings of the IEEE Conference Systems, Man and Cybernetics, Tokyo, Japan, 12-15 October 1999; pp. 689-694.
35. Alba, E.; Nebro, A.J.; Troya, J.M. Heterogeneous computing and parallel genetic algorithms. J. Parallel Distrib. Comput. 2002, 62, 1362-1385.
36. Guillén, A.; Arenas, M.G.; Herrera, L.; Pomares, H.; Rojas, I. GPU Cluster with MATLAB. In Proceedings of the The 2011 International Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, NV, USA, 18-21 July 2011; pp. 379-384.
37. Guillén, A.; Sovilj, D.; Lendasse, A.; Mateo, F.; Rojas, I. Minimising the delta test for variable selection in regression problems. Int. J. High Perform. Syst. Archit. 2008, 1, 269-281.
38. StatLib: Data, Software and News from the Statistics Community. Available online: http://lib.stat.cmu.edu/datasets/tecator (accessed on 8 February 2014).
39. Environmental and Industrial Machine Learning Group. Anthropometric study of US Children Carried Out in 1977. Available online: http://research.ics.tkk.fi/eiml/datasets.shtml (accessed on 8 February 2014).
40. Guillén, A.; González, J.; Rojas, I.; Pomares, H.; Herrera, L.; Valenzuela, O.; Prieto, A. Improving clustering technique for functional approximation problem using fuzzy logic: ICFA algorithm. Neurocomputing 2007, doi:10.1016/j.neucom.2006.06.017.