Combined projection and kernel basis functions for classification in evolutionary neural networks

Neurocomputing

Volumn 72, Issue 13-15, 2009, Pages 2731-2742

  Gutierrez P A ^a   Hervas C ^a   Carbonero, M ^b   Fernandez J C ^a  

^a UNIVERSITY OF CÓRDOBA   (Spain)

^b UNIVERSIDAD LOYOLA ANDALUCÍA   (Spain)

Author keywords

Classification; Evolutionary neural networks; Kernel basis functions; Projection basis functions

Indexed keywords

CLASSIFICATION (OF INFORMATION); FUNCTIONS; LEARNING SYSTEMS; MULTILAYER NEURAL NETWORKS; NEURAL NETWORKS;

BENCHMARK CLASSIFICATION; EVOLUTIONARY NEURAL NETWORK; HYBRID NEURAL NETWORKS; KERNEL BASIS FUNCTIONS; MACHINE LEARNING PROBLEM; MULTI LAYER PERCEPTRON; PRODUCT UNIT NEURAL NETWORK; PROJECTION BASIS FUNCTIONS;

RADIAL BASIS FUNCTION NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION; DATA BASE; EVOLUTIONARY ALGORITHM; INTERMETHOD COMPARISON; KERNEL METHOD; MACHINE LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MOLECULAR EVOLUTION; PRIORITY JOURNAL; STATISTICAL MODEL;

EID: 71649107625     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.09.020     Document Type: Article

References (56)

1. J. Alcalá-Fdez, L Sánchez, S. García, M.J. del Jesús, S. Ventura, J.M. Garrell, J. Otero, C. Romero, J. Bacardit, V.M. Rivas, J.C. Fernández, F. Herrera, KEEL: a software tool to assess evolutionary algorithms for data mining problems, Soft Computing 13 (3) (2007) 307-318.
2. P.J. Angeline, G.M. Saunders, J.B. Pollack, An evolutionary algorithm that constructs recurrent neural networks, IEEE Transactions on Neural Networks 5(1) (1994) 54-65.
3. A. Asuncion, D.J. Newman, UCI Maching Learning Repository, /http:// www.ics.uci.edu/~mlearn/MLRepository.html>, Irvine, CA: University of California, School of Information and Computer Science, 2007.
4. A.S. Atukorale, T. Downs, P.N. Suganthan, Boosting HONG networks, Neurocomputing 51 (2003) 75-86.
5. S.A. Billings, G.L Zheng, Radial basis function network configuration using genetic algorithms, Neural Networks 8 (1995) 877-890.
6. C.M. Bishop, Improving the generalization properties of radial basis function neural networks, Neural Computation 3 (4) (1991) 579-581.
7. C.M. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, 1995.
8. L.N. Castro, E.R. Hruschka, R.J.G.B. Campello, An evolutionary clustering technique with local search to design RBF neural network classifiers, in: Proceedings of the IEEE International Joint Conference on Neural Networks, 2004, pp. 2083-2088.
9. S. Chen, S.A. Billings, C.F.N. Cowan, P.W. Grant, Practical identification of NARMAX models using radial basis functions, International Journal of Control 52 (1990) 1327-1350.
10. S. Coen, N. Intrator, Global optimization of RBF networks, Technical Report, S.o.C Science, Tel-Aviv University.
11. S. Cohen, N. Intrator, A hybrid projection-based and radial basis function architecture: initial values and global optimization, Pattern Analysis and Applications 5 (2002) 113-120.
12. C. Darken, J. Moody, Fast adaptive K-means clustering: some empirical results, in: Proceedings of the IEEE INNS International Joint Conference on Neural Networks, 1990, pp. 233-238.
13. D. Donoho, Projection based in approximation and a duality with kernel methods, The Annals of Statistics 17 (1989) 58-106.
14. W. Duch, R. Adamczak, G.H.F. Diercksen, Constructive density estimation network based on several different separable transfer functions, in: Proceedings of the 9th European Symposium on Artificial Neural Networks, Bruges, Belgium, 2001, pp. 107-112.
15. W. Duch, N. Jankowski, Transfer functions hidden possibilities for better neural networks, in: Proceedings of the 9th European Symposium on Artificial Neural Networks, Bruges, Belgium, 2001, pp. 81-94.
16. R. Durbin, D. Rumelhart, Products units: a computationally powerful and biologically plausible extension to backpropagation networks, Neural Computation 1 (1989) 133-142.
17. D.B. Fogel, A.J. Owens, M.J. Wals, Artificial Intelligence Through Simulated Evolution, Wiley, New York, 1966.
18. J.A.S. Freeman, D. Saad, Learning and generalization in radial basis function networks, Neural Computation 7 (5) (1995) 1000-1020.
19. J. Friedman, Multivariate adaptive regression splines (with discussion), The Annals of Statistics 19 (1991) 1-141.
20. J.H. Friedman, W. Stuetzle, Projection pursuit regression, Journal of the American Statistical Association 76 (1981) 817-823.
21. K.J. Hunt, D. Sbarbaro, R. Zbikowski, P.J. Gawthrop, Neural networks for control system-a survey, Automatica 28 (1992) 1083-1112.
22. A. Ismail, A.P. Engelbrecht, Global optimization algorithms for training product units neural networks, in: Proceedings of the International Joint Conference on Neural Networks IJCNN'2000, Italy, 2000, pp. 132-137.
23. B.C. Iulian, Hybrid feedforward neural networks for solving classification problems, Neural Processing Letters 16 (1) (2002) 81-91.
24. N. Jankowski, W. Duch, Optimal transfer function neural networks, in: Procedings of the 9th European Symposium on Artificial Neural Networks, Bruges, Belgium, 2001, pp. 101-106.
25. D.J. Janson, J.F. Frenzel, Training product unit neural networks with genetic algorithms, IEEE Expert 8 (5) (1993) 26-33.
26. N. Landwehr, M. Hall, Logistic model trees, Machine Learning 59 (2005) 161-205.
27. L.R. Leerink, Learning with products units, Advances in Neural Networks Processing Systems 7 (1995) 537-544.
28. M. Lehtokangas, J. Saarinen, Centroid based Multilayer Perceptron Networks, Neural Processing Letters 7 (1998) 101-106.
29. F.H.F. Leung, H.K. Lam, S.H. Ling, P.K.S. Tam, Tuning of the structure and parameters of a neural network using an improved genetic algorithm, IEEE Transactions on Neural Networks 14 (1) (2003) 79-88.
30. H. Levene, In Contributions to Probability and Statistics, Stanford University Press, 1960.
31. R.P. Lippmann, Pattern classification using neural networks, IEEE Communications Magazine 27 (1989) 47-64.
32. A.C Martínez-Estudillo, C Hervás-Martínez, F.J. Martínez-Estudillo, N. García, Hybridation of evolutionary algorithms and local search by means of a clustering method, IEEE Transaction on Systems, Man and Cybernetics, Part. B: Cybernetics 36 (3) (2006) 534-546.
33. A.C. Martínez-Estudillo, F.J. Martínez-Estudillo, C Hervás-Martínez, N. García, Evolutionary product unit based neural networks for regression, Neural Networks 19 (4) (2006) 477-486.
34. F.J. Martínez-Estudillo, C Hervás-Martínez, P.A. Gutiérrez, A.C. Martínez-Estudillo, Evolutionary product-unit neural networks classifiers, Neurocomputing 72 (1-3) (2008) 548-561.
35. R.G. Miller, Beyond ANOVA, Basics of Applied Statistics, Chapman & Hall, London, 1996.
36. M.T. Musavi, W. Ahmed, K.H. Chan, K.B. Farms, D.M. Hummels, On the training of radial basis function classifiers, Neural Networks 5 (1992) 595-603.
37. M.J.L Orr, Regularisation in the selection of radial basis function centres, Neural Computation 7 (3) (1995) 606-623.
38. C Panchapakesan, M. Palaniswami, D. Ralph, C Manzie, Effects of moving the centers in an RBF network, IEEE Transactions on Neural Networks 13 (6) (2002) 1299-1307.
39. Y.H. Pao, Y. Takefuji, Functional-link net computing: theory, system architecture, and functionalities, IEEE Computer 25 (5) (1992) 76-79.
40. J. Park, I.W. Sandberg, Universal approximation using radial basis function networks, Neural Computation 3 (2) (1991) 246-257.
41. R. Reed, Pruning algorithms. A survey, IEEE Transactions on Neural Networks 4 (1993) 740-747.
42. D.E. Rumelhart, G.E. Hinton, R.J. Williams, Learning representations by backpropagating errors, Nature 323 (1986) 533-536.
43. A. Sakurai, Tighter bounds of the VC-dimension of three layer networks, in: Proceedings of the World Congress on Neural Networks, Erlbaum, Hillsdale, New Jersey, 1993, pp. 540-543.
44. M. Schmitt, On the complexity of computing and learning with multiplicative neural networks, Neural Computation 14 (2001) 241-301.
45. M. Schmitt, Radial basis function neural networks have superlinear VC dimension, in: Proceedings of the COLT/EuroCOLT2001, Lecture Notes in Artificial Intelligence, vol. 2111, 2001, pp. 14-30.
46. D.F. Specht, A general regression neural network, IEEE Transactions on Neural Networks 2 (6) (1991) 568-576.
47. J.A.K. Suykens, J.P.L Vandewalle, B.L.R.D. Moor, Artificial Neural Networks for Modelling and Control of Non-linear Systems, Kluwer Academic Publishers, USA, 1996.
48. A.C. Tamhane, D.D. Dunlop, Statistics and Data Analysis, Prentice Hall, Englewood Cliffs, NJ, 2000.
49. E.K. Tang, P.N. Suganthan, X. Yao, An analysis of diversity measures, Machine Learning 65 (2006) 247-271.
50. V.N. Vapnik, The Nature of Statistical Learning Theory, Springer, Berlin, 1999.
51. S. Ventura, C. Romero, A. Zafra, J.A. Delgado, C. Hervas-Martinez, JCLEC: a JAVA framework for evolutionary computation, Soft Computing 12 (4) (2007) 381-392.
52. D. Wedge, D. Ingram, D. McLean, C. Mingham, Z. Bandar, On global-local artificial neural networks for function approximation, IEEE Transactions on Neural Networks 17 (4) (2006) 942-952.
53. X. Yao, Evolving artificial neural networks, Proceedings of the IEEE 87 (9) (1999) 1423-1447.
54. X. Yao, Y. Liu, A new evolutionary system for evolving artificial neural networks, IEEE Transactions on Neural Networks 8 (3) (1997) 694-713.
55. Z.Q Zhao, D.S. Huang, A mended hybrid learning algorithm for radial basis function neural networks to improve generalization capability, Applied Mathematical Modelling 31 (2007) 1271-1281.
56. Q Zhu, Y. Cai, L Liu, A global learning algorithm for a RBF network, Neural Networks 12 (1999) 527-540.