CO2RBFN: An evolutionary cooperative-competitive RBFN design algorithm for classification problems

Soft Computing

Volumn 14, Issue 9, 2010, Pages 953-971

  Perez Godoy, María D ^a   Rivera, Antonio J ^a   Berlanga, Francisco J ^a   Del Jesus, María José ^a  

^a UNIVERSITY OF JAÉN   (Spain)

Author keywords

Classification; Cooperative Competitive Evolutionary Design; Evolutionary Algorithms; Fuzzy Rule Base Systems; Radial Basis Function Networks

Indexed keywords

CLASSIFICATION; COMPETITIVE ALGORITHMS; COMPETITIVE ENVIRONMENT; CREDIT ASSIGNMENT; DISTANCE MEASURE; EVOLUTIONARY DESIGN; FUZZY RULE BASE; FUZZY RULE BASED SYSTEMS; LOCAL ERROR; NOMINAL FEATURE; RADIAL BASIS FUNCTIONS; SOFT COMPUTING METHODS;

ATTITUDE CONTROL; CLASSIFICATION (OF INFORMATION); DESIGN; EVOLUTIONARY ALGORITHMS; FUZZY RULES; MATHEMATICAL OPERATORS; PROBABILITY DENSITY FUNCTION; SOFT COMPUTING; STATISTICAL TESTS;

RADIAL BASIS FUNCTION NETWORKS;

EID: 77951795476     PISSN: 14327643     EISSN: 14337479     Source Type: Journal    
DOI: 10.1007/s00500-009-0488-z     Document Type: Article

References (82)

1. Alcalá-Fdez J, Sánchez L, García S, Del Jesus MJ, Ventura S, Garrell JM, Otero J, Romero C, Bacardit J, Rivas VM, Fernández JC, Herrera F (2009) KEEL: a software tool to assess evolutionary algorithms to data mining problems. Soft Comput 13(3): 307-318.
2. Ampazis N, Perantonis SJ (2002) Two highly efficient second-order algorithms for training feedforwards networks. IEEE Trans Neural Netw 13(3): 1064-1074.
3. Asuncion A, Newman DJ (2007) UCI machine learning repository. School of Information and Computer Science, University of California, Irvine, CA. http://www. ics. uci. edu/~mlearn/MLRepository. html.
4. Bäck T, Hammel U, Schwefel H (1997) Evolutionary computation: comments on the history and current state. IEEE Trans Evol Comput 1(1): 3-17.
5. Balakrishnan K, Honavar V (1995) Evolutionary design of neural architecture-a preliminary taxonomy and guide to literature. Technical report, AI Research Group, CS-TR 95-01.
6. Billings SA, Zheng GL (1995) Radial basis function network configuration using genetic algorithms. Neural Netw 8(6): 877-890.
7. Broomhead D, Lowe D (1988) Multivariable functional interpolation and adaptive networks. Complex Syst 2: 321-355.
8. Buchtala O, Klimek M, Sick B (2005) Evolutionary optimization of radial basis function classifiers for data mining applications. IEEE Trans Syst Man Cybern B 35(5): 928-947.
9. Burdsall B, Giraud-Carrier C (1997) GA-RBF: a self optimising RBF network. In: Proceedings of conference on artificial neural networks and genetic algorithms. Springer, Berlin.
10. Chaiyaratana N, Zalzala AMS (1998) Evolving hybrid RBF-MLP networks using combined genetic/unsupervised/supervised learning. In: Proceedings of UKACC international conference on control, Swansea, UK.
11. Chen S, Billings SA, Cowan CFN, Grant PW (1990) Practical identification of narmax models using radial basis functions. Int J Control 52(6): 1327-1350.
12. Chen S, Cowan C, Grant P (1991) Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans Neural Netw 2: 302-309.
13. Chen S, Wu Y, Luk BL (1999) Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans Neural Netw 10(5): 1239-1243.
14. Cheng V, Li CH, Kwok JT, Li CK (2004) Dissimilarity learning for nominal data. Pattern Recogn 37: 1471-1477.
15. Dawson CW, Wilby RL, Harpham C, Brown MR, Cranston, E, Darby EJ (2000) Modelling Ranunculus presence in the Rivers test and Itchen using artificial neural networks. In: Proceedings of international conference on geocomputation, Greenwich, UK.
16. Deb K (2001) Multi-objective optimization using evolutionary algorithms, 1st edn. Wiley, New York.
17. Demšar J (2006) Statistical Comparisons of Classifiers over Multiple Data Sets. J Mach Learn Res 7: 1-30.
18. Du H, Zhang N (2008) Time series prediction using evolving radial basis function networks with new enconding scheme. Neurocomputing 71: 1388-1400.
19. Er MJ, Chen W, Wu S (2005) High-speed face recognition base on discrete cosine transform and RBF neural networks. IEEE Trans Neural Netw 16(3): 679-691.
20. Esposito F, Malerba D, Tamma V, Bock HH (2000a) Classical resemblance measures. In: Bock H-H, Diday E (eds) Analysis of symbolic data. Exploratory methods for extracting statistical information from complex data, Series: studies in classification, data analysis, and knowledge organization, vol 15. Springer, Berlin, pp 139-152.
21. Esposito A, Marinaro M, Oricchio D, Scarpetta S (2000b) Approximation of continuous and discontinuous mappings by a growing neural RBF-based algorithm. Neural Netw 13(6): 651-665.
22. Ferreira PM, Ruano AE, Fonseca CM (2003) Genetic assisted selection of RBF model structures for greenhouse inside air temperature prediction. IEEE Control Appl 1: 576-581.
23. Fogel LJ, Owens AJ, Walsh MJ (1966) Artificial Intelligence through simulation evolution. Wiley, New York.
24. Fu X, Wang L (2002) A GA-based novel RBF classifier with class-dependent features. Proc Congr Evol Comput 2: 1964-1969.
25. Fu X, Wang L (2003) Data dimensionality reduction with application to simplifying RBF network structure and improving classification performance. IEEE Trans Syst Man Cybern B 33(3): 399-409.
26. Goldberg D (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, Reading.
27. Goldberg D, Richardson J (1987) Genetic algorithms with sharing for multimodal function optimization. In: Grefenstette (ed) Proceedings of second international conference on genetic algorithms. Lawrence Erlbaum Associates, pp 41-49.
28. Golub G, van Loan C (1996) Matrix computations, 3rd edn. J. Hopkins University Press, Baltimore.
29. González J, Rojas I, Ortega J, Pomares H, Fernández FJ, Díaz AF (2003) Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation. IEEE Trans Neural Netw 14(6): 1478-1495.
30. Guillén A, Pomares H, Rojas I, González J, Herrera LJ, Rojas F, Valenzuela O (2007) Output value-based initialization for radial basis function neural networks. Neural Process Lett. doi: 10. 1007/s11063-007-9039-8.
31. Harpham C, Dawson C, Brown M (2004) A review of genetic algorithms applied to training radial basis function networks. Neural Comput Appl 13: 193-201.
32. Holcomb T, Morari M (1991) Local training for radial basis function networks: towards solving the hidden unit problem. In: Proceedings of American control conference, Boston.
33. Holland JH (1975) Adaptation in natural and artificial systems. The University of Michigan Press.
34. Huang SN, Tan KK, Lee TH (2008) Adaptive neural network algorithm for control design of rigid-link electrically driven robots. Neurocomputing 71(4-6): 885-894.
35. Jang JSR, Sun CT (1993) Functional equivalence between radial basis functions and fuzzy inference systems. IEEE Trans Neural Netw 4: 156-158.
36. Jiang N, Zhao ZY, Ren LQ (2003) Design of structural modular neural networks with genetic algorithm. Adv Eng Soft 1: 17-24.
37. Jin Y, Sendhoff B (2003) Extracting interpretable fuzzy rules from RBF networks. Neural Process Lett 17(2): 149-164.
38. Lacerda E, Carvalho A, Braga A, Ludermir T (2005) Evolutionary radial functions for credit assessment. Appl Intell 22: 167-181.
39. Lee S, Kil RM (1991) A Gaussian potential function network with hierarchically seft-organising learning. Neural Netw 4: 207-224.
40. Leung H, Dubash N, Xie N (2002) Detection of small objects in clutter using a GA-RBF neural network. IEEE Trans Aero Electr Sys 38(1): 98-118.
41. Li M, Tian J, Chen F (2008) Improving multiclass pattern recognition with a co-evolutionary RBFNN. Pattern Recogn Lett 29(4): 392-406.
42. Maglogiannis I, Sarimveis H, Kiranoudis CT, Chatziioannou AA, Oikonomou N, Aidinis V (2008) Radial basis function neural networks classification for the recognition of idiopathic pulmonary fibrosis in microscopic images. IEEE Trans Inf Technol B 12(1): 42-54.
43. Mandani E, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7(1): 1-13.
44. Marcos JV, Hornero R, Álvarez D, Del Campo F, López M, Zamarrón C (2008) Radial basis function classifiers to help in the diagnosis of the obstructive sleep apnoea syndrome from nocturnal oximetry. Med Biol Eng Comput 46: 323-332.
45. Moechtar M, Farag AS, Hu L, Cheng TC (1999) Combined genetic algorithms and neural network approach for power system transient stability evaluation. Europ Trans Elect Power 9(2): 115-122.
46. Moody J, Darken CJ (1989) Fast learning in networks of locally-tuned processing units. Neural Comput 1: 281-294.
47. Musavi MT, Ahmed W, Chan KH, Faris KB, Hummels DM (1992) On the training of radial basis function classifiers. Neural Netw 5: 595-603.
48. Neruda R, Kudová P (2005) Learning methods for radial basis function networks. Future Gener Comp Sy 21(7): 1131-1142.
49. Orr MJL (1995) Regularization on the selection of radial basis function centers. Neural Comput 7: 606-623.
50. Park J, Sandberg I (1991) Universal approximation using radial-basis function networks. Neural Comput 3: 246-257.
51. Park J, Sandberg I (1993) Universal approximation and radial basis function network. Neural Comput 5(2): 305-316.
52. Pedrycz W (1998) Conditional fuzzy clustering in the design of radial basis function neural networks. IEEE Trans Neural Netw 9(4): 601-612.
53. Peng JX, Li K, Huang DS (2006) A hybrid forward algorithm for RBF neural network construction. IEEE Trans Neural Netw 17(6): 1439-1451.
54. Pérez-Godoy MD, Rivera AJ, del Jesus MJ, Rojas I (2007) CoEvRBFN: an approach to solving the classification problem with a hybrid cooperative-coevolutive algorithm. In: Proceedings of international workshop on artificial neural networks, pp 324-332.
55. Pérez-Godoy MD, Aguilera JJ, Berlanga FJ, Rivas VM, Rivera AJ (2008) A preliminary study of the effect of feature selection in evolutionary RBFN design. In: Proceedings of information processing and management of uncertainty in knowledge-based system, pp 1151-1158.
56. Plat J (1991) A resource allocating network for function interpolation. Neural Comput 3(2): 213-225.
57. Potter M, De Jong K (2000) Cooperative coevolution: an architecture for evolving coadapted subcomponents. Evol Comput 8(1): 1-29.
58. Powell M (1985) Radial basis functions for multivariable interpolation: a review. In: IMA Proceedings of conference on algorithms for the approximation of functions and data, pp 143-167.
59. Quinlan JR (1993) C4. 5: programs for machine learning. Morgan Kauffman, Menlo Park.
60. Rivas VM, Merelo JJ, Castillo PA, Arenas MG, Castellanos JG (2004) Evolving RBF neural networks for time-series forecasting with EvRBF. Inf Sci 165(3-4): 207-220.
61. Rivera AJ, Ortega J, Prieto A (2001) Design of RBF networks by cooperative/competitive evolution of units. In: Proceedings of international conference on artificial neural networks and genetic algorithms (ICANNGA 2001), pp 375-378.
62. Rivera AJ, Rojas I, Ortega J, del Jesus MJ (2007) A new hybrid methodology for cooperative-coevolutionary optimization of radial basis function networks. Soft Comput. doi: 10. 1007/s00500-006-0128-9.
63. Rojas R, Feldman J (1996) Neural networks: a systematic introduction. Springer, Berlin.
64. Rojas I, Valenzuela O, Prieto A (1997) Statisctical analysis of the main parameters in the definition of radial basis function networks. Lect Notes Comput Sci 1240: 882-891.
65. Sanchez VD (2002) A searching for a solution to the automatic RBF network design problem. Neurocomputing 42: 147-170.
66. Schaffer JD, Whitley D, Eschleman LJ (1992) Combinations of genetic algorithms and neural networks: a survey of the state of the art. In: Proceedings of international workshop on combinations of genetic algorithms and neural networks.
67. Sergeev SA, Mahotilo KV, Voronovsky GK, Petrashev SN (1998) Genetic algorithm for training dynamical object emulator based on RBF neural network. Int J Appl Electro Mech 9(1): 65-74.
68. Sheta AF, De Jong K (2001) Time-series forecasting using GA-tuned radial basis functions. Info Sci 133(3-4): 221-228.
69. Stanfill C, Waltz D (1986) Towards memory-based reasoning, Commun. ACM 29(12): 1213-1228.
70. Sumathi S, Sivanandam SN, Ravindran R (2001) Design of a soft computing hybrid model classifier for data mining applications. Engin Intell Sys Electr Engin Comm 9(1): 33-56.
71. Sun YF, Liang YC, Zhang WL, Lee HP, Lin WZ, Cao LJ (2005) Optimal partition algorithm of the RBF neural network and its application to financial time series forecasting. Neural Comput Appl 14(1): 36-44.
72. Sundararajan N, Saratchandran P, Yingwei L (1999) Radial basis function neural network with sequential learning: MRAN and its application. World Scientifics, New York.
73. Teixeira CA, Ruano MG, Ruano AE, Pereira WCA (2008) A soft-computing methodology for noninvasive time-spatial temperature estimation. IEEE Trans Bio Med Eng 55(2): 572-580.
74. Topchy A, Lebedko O, Miagkikh V, Kasabov N (1997) Adaptive training of radial basis function networks based on co-operative evolution and evolutionary programming. In: Proceedings of international conference neural information processing (ICONIP), pp 253-258.
75. Vesin JM, Gruter R (1999) Model selection using a simplex reproduction genetic algorithm. Sig Process 78: 321-327.
76. Whitehead B, Choate T (1996) Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction. IEEE Trans Neural Netw 7(4): 869-880.
77. Widrow B, Lehr MA (1990) 30 Years of adaptive neural networks: perceptron, madaline and backpropagation. Proc IEEE 78(9): 1415-1442.
78. Wilson DR, Martinez TR (1997) Improved heterogeneous distance functions. J Artif Intell Res 6(1): 1-34.
79. Xue Y, Watton J (1998) Dynamics modelling of fluid power systems applying a global error descent algorithm to a selforganising radial basis function network. Mechatronics 8(7): 727-745.
80. Yao X (1993) A review of evolutionary artificial neural networks. Int J Intell Syst 8(4): 539-567.
81. Yao X (1999) Evolving artificial neural networks. Proc IEEE 87(9): 1423-1447.
82. Yen GG (2006) Multi-Objective evolutionary algorithm for radial basis function neural network design. Stud Comput Intell 16: 221-239.