Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation

IEEE Transactions on Neural Networks

Volumn 14, Issue 6, 2003, Pages 1478-1495

  González, Jesús ^a   Rojas, Ignacio ^a   Ortega, Julio ^a   Pomares, Héctor ^a   Fernández, Javier ^a   Fco, Antonio ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

Evolutionary computation; Heuristics; Neural networks; Orthogonal transformations; Radial basis functions (RBFs)

Indexed keywords

APPROXIMATION THEORY; COMPUTER SIMULATION; EVOLUTIONARY ALGORITHMS; FUNCTION EVALUATION; FUZZY SETS; HEURISTIC METHODS; MATHEMATICAL TRANSFORMATIONS; MATRIX ALGEBRA; OPTIMIZATION; PARAMETER ESTIMATION; PARETO PRINCIPLE; REGRESSION ANALYSIS;

FUNCTION APPROXIMATION; HEURISTICS; MULTIOBJECTIVE EVOLUTIONARY OPTIMIZATION; ORTHOGONAL LEAST SQUARES; ORTHOGONAL TRANSFORMATIONS; SINGULAR VALUE DECOMPOSITION;

RADIAL BASIS FUNCTION NETWORKS;

EID: 0742321288     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2003.820657     Document Type: Article

References (60)

1. T. Bäck, Ed., Proc. Seventh Int. Conf. Genetic Algorithms. San Francisco, CA: Morgan Kaufmann, 1997.
2. Handbook of Evolutionary Computation. T. Bäck, D. B. Fogel, and Z. Michalewicz, Eds., Instit. Physics Publishing and Oxford University Press, Bristol, New York, MA, NY, 1997.
3. H. Bersini, A. Duchateau, and N. Bradshaw, "Using incremental learning algorithms in the search for minimal and effective fuzzy models," in Proc. 6th IEEE Int. Conf. Fuzzy Syst., Barcelona, Spain, July 1997, pp. 1417-1422.
4. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms. New York: Plenum, 1981.
5. C. M. Bishop, Neural Networks for Pattern Recognition, Oxford: Clarendon, 1995.
6. R. Brent and F. Luk, "The solution of singular value and symmetric eigenvalue problems on multiprocessor arrays," SIAM J. Sci. Stat. Comput., vol. 6, pp. 69-84, 1985.
7. R. Brent, F. Luk, and C. Van Loan, "Computation of the singular value decomposition using mesh-connected processors," J. VLSI Comput. Syst., vol. 1, pp. 242-270, 1984.
8. D. S. Broomhead and D. Lowe, "Multivariate functional interpolation and adaptive networks," Complex Syst., vol. 2, pp. 321-355, 1988.
9. L. Bruzzone and D. F. Prieto, "A technique for the selection of kernel-function parameters in RBF neural networks for classification of remote-sensing images," IEEE Trans. Geosci. Remote Sensing, vol. 37, no. 2, pp. 1179-1184, 1999.
10. P. A. Castillo, "Optimización de perceptrones multicapa medicine algoritmos evolutivos," Ph.D. dissertation, Univ. Granada, Spain, Apr. 2000.
11. P. A. Castillo, M. G. Arenas, J. G. Castellano, M. Cillero, J. J. Merelo, A. Prieto, V. Rivas, and G. Romero, "Function approximation with evolved multilayer perceptrons," in 2001 WSES Int. Conf. Neural Networks and Applications (NNA'01), N. E. Mastorakis, Ed., Puerto De La Cruz, Tenerife, Canary Islands, 2001, pp. 195-200.
12. V. Chankong and Y. Y. Haimes, Multiobjective Decision Making Theory and Methodology. New York: North-Holland, 1983.
13. J. P. Charlier, M. Vanbegin, and P. V. Dooren, "On efficient implementations of kogbetliantz's algorithm for computing the singular value decomposition," Numer. Math., vol. 52, pp. 279-300, 1988.
14. C. L. Hwang and A. S. M. Masud, Multiple Objective Decision Making - Methods and Applications, Volume 164 of Lecture Notes in Economics and Mathematical Systems, Berlin: Springer-Verlag, 1979.
15. Proc. 5th IEEE Int. Conf. Fuzzy Syst., Sept. 1996. IEEE Neural Networks Council, Ed.
16. H. Ishibuchi and T. Murata, "Multi-objective genetic local search algorithm," Proc. Third IEEE Int. Conf. Evolutionary Computation, ICEC'96, pp. 119-124, 1996.
17. J. S. R. Jang, "ANFIS: Adaptive network-based fuzzy inference system," IEEE Trans. Syst, Man, Cybern., vol. 23, pp. 665-685, May 1993.
18. J. S. R. Jang and C. T. Sun, "Functional equivalence between radial basis function networks and fuzzy inference systems," IEEE Trans. Neural Networks, vol. 4, pp. 156-159, Jan. 1993.
19. P. P. Kanjilal and D. N. Banerjee, "On the application of orthogonal transformation for the design and analysis of feed-forward networks," IEEE Trans. Neural Networks, vol. 6, pp. 1061-1070, 1995.
20. N. B. Karayiannis, "Reformulated radial basis neural networks trained by gradient descent," IEEE Trans. Neural Networks, vol. 10, pp. 657-671, May 1999.
21. N. B. Karayiannis and G. W. Mi, "Growing radial basis neural networks: Merging supervised and unsupervised learning with network growth techniques," IEEE Trans. Neural Networks, vol. 8, pp. 1492-1506, Nov. 1997.
22. E. G. Kogbetliantz, "Diagonalization of general complex matrices as a new method for solution of linear equations," Proc. Int. Congr. Math., vol. 2, pp. 356-357, 1954.
23. ____, "Solution of linear equations by diagonalization of coefficients matrix," Quart. Appl. Math., vol. 13, pp. 123-132, 1955.
24. L. Kuncheva, "Initializing of an RBF network by a genetic algorithm," Neurocomputing, vol. 14, pp. 273-288, 1997.
25. R. Langari, L. Wang, and J. Yen, "Radial basis function networks, regression weights, and the expectation-maximization algorithm," IEEE Trans. Syst. Man Cybern. A, vol. 27, pp. 613-623, Sept. 1997.
26. A. Lapedes and R. Farber, "How neural nets work," Neural Information Processing Systems, pp. 442-456, 1988.
27. M. C. Mackey and L. Glass, "Oscillation and chaos in physiological control systems," Science, vol. 197, no. 4300, pp. 287-289, 1977.
28. E. P. Maillard and D. Gueriot, "RBF neural network, basis functions and genetic algorithms," Proc. 1997 IEEE Int. Conf. Neural Networks, vol. 4, pp. 2187-2190, 1997.
29. D. W. Marquardt, "An algorithm for least-squares estimation of non-linear inequalities," SIAM J. Appl. Math., vol. 11, pp. 431-441, 1963.
30. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, 3rd ed: Springer-Verlag, 1996.
31. J. E. Moody and C. J. Darken, "Fast learning in networks of locally-tuned processing units," Neural Computation, vol. 1, pp. 281-294, 1989.
32. G. C. Mouzouris and J. M. Mendel, "Designing fuzzy logic systems for uncertain environments using a singular-value-QR decomposition method," IEEE Neural Networks Council 41, pp. 295-301.
33. M. T. Musavi, W. Ahmed, K. H. Chan, K. B. Faris, and D. M. Hummels, "On the training of radial basis function classifiers," Neural Networks, vol. 5, no. 4, pp. 595-603, 1992.
34. V. Pareto, Cours D'Economie Politique, Lausanne: F. Rouge, 1896, vol. I and II.
35. J. Park and I. W. Sandberg, "Universal approximation using radial-basis-function networks," Neural Computation, vol. 3, pp. 546-257, 1991.
36. ____, "Approximation and radial-basis-function networks," Neural Computation, vol. 5, pp. 305-316, 1993.
37. G. Patanè and M. Russo, "The enhanced-LBG algorithm," Neural Networks, vol. 14, no. 9, pp. 1219-1237, 2001.
38. J. Platt, "A resource allocation network for function interpolation," Neural Computation, vol. 3, pp. 213-225, 1991.
39. H. Pomares, "Nueva Metodología Para el Diseño Automático de Sistemas Difusos," Ph.D. dissertation, Univ. Granada, Spain, Jan. 2000.
40. H. Pomares, I. Rojas, J. González, and A. Prieto, "Structure identification in complete eule-based fuzzy systems," IEEE Trans. Fuzzy Syst., vol. 10, pp. 349-359, June 2002.
41. H. Pomares, I. Rojas, J. Ortega, J. González, and A. Prieto, "A systematic approach to a self-generating fuzzy rule-table for function approximation," IEEE Trans. Syst., Man Cybern. B, vol. 30, pp. 431-447, June 2000.
42. I. Rojas, J. González, A. Cañas, A. F. Díaz, F. J. Rojas, and M. Rodriguez, "Short-term prediction of chaotic time series by using RBF network with regression weights," Int. J. Neural Syst., vol. 10, no. 5, pp. 353-364, 2000.
43. I. Rojas, H. Pomares, J. González, J. L. Bernier, E. Ros, F. J. Pelayo, and A. Prieto, "Analysis of the functional block involved in the design of radial basis function networks," Neural Processing Lett., vol. 12, no. 1, pp. 1-17, Aug. 2000.
44. I. Rojas, H. Pomares, J. González, E. Ros, M. Salmerón, J. Ortega, and A. Prieto, "A new radial basis function networks structure: Application to time series prediction," in Proc. IEEE-INNS-ENNS Int. Joint Conf. Neural Networks, S. I. Amari, C. L. Giles, M. Gori, and V. Piuri, Eds, Como, Italy: IEEE Computer Society, July 2000, vol. IV, pp. 449-454.
45. I. Rojas, H. Pomares, J. Ortega, and A. Prieto, "Self-organized fuzzy system generation from training examples," IEEE Trans. Fuzzy Syst., vol. 8, pp. 23-36, Feb. 2000.
46. R. Rosipal, M. Koska, and I. Farkaš, "Prediction of chaotic time-series with a resource-allocating RBF network," Neural Processing Lett., vol. 7, pp. 185-197, 1998.
47. M. Salmerón, M. Anguita, M. Damas, C. Gil, and J. Ortega, "Predicción de series temporales en 'Clusters' de computadores," Actas de las X Jornadas de Paralelismo, pp. 13-15, Sept. 1999.
48. M. Salmerón, J. González, J. Ortega, I. Rojas, and C. G. Puntonet, "Métodos ortogonales paralelos para predicción de series," in Perspectivas en Paralelismo de Computadores. Actas de las XI Jornadas de Paralelismo, J. Ortega, Ed, Granada, Spain: Univ. Granada, Sept. 2000, pp. 277-282.
49. M. Salmerón, J. Ortega, and C. G. Puntonet, "On-line optimization of radial basis function networks with orthogonal techniques," in Foundations and Tools for Neural Modeling, volume 1606 of Lecture Notes in Computer Science, J. Mira and J. V. Sánchez-Andrés, Eds. New York: Springer-Verlag, 1999, pp. 465-478.
50. M. Salmerón, J. Ortega, C. G. Puntonet, and A. Prieto, "Improved RAN sequential prediction using orthogonal techniques," Neurocomputing, vol. 41, no. 2, pp. 153-172, Aug. 2001.
51. N. Srinivas and K. Dev, "Multiobjective optimization using nondominated sorting in genetic algorithms," Evolution. Computat., vol. 2, no. 3, pp. 221-248, 1995.
52. T. Sudkamp and R. J. Hammell, "Interpolation, completion and learning fuzzy rules," IEEE Trans. Syst. Man Cybern., vol. 24, pp. 332-243, Feb. 1994.
53. M. Valenzuela-Rendón and E. Uresti-Charre, A non-generational genetic algorithm for multiobjective optimization, pp. 658-665. In Bäck 1.
54. L. X. Wang and J. M. Mendel, "Generating fuzzy rules by learning from examples," IEEE Trans. Syst. Man Cybern., vol. 22, pp. 1414-1427, Nov. 1992.
55. A. E. Webb and S. Shannon, "Shape-adaptive radial basis functions," IEEE Trans. Neural Networks, vol. 9, pp. 1155-1166, Nov. 1998.
56. B. A. Whitehead, "Genetic evolution of radial basis function coverage using orthogonal niches," IEEE Trans. Neural Networks, vol. 7, pp. 1525-1528, 1996.
57. B. A. Whitehead and T. D. Choate, "Evolving space-filling curves to distribute radial basis functions over an input space," IEEE Trans. Neural Networks, vol. 5, pp. 15-23, Jan. 1994.
58. ____, "Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction," IEEE Trans. Neural Networks, vol. 7, no. 4, pp. 869-880, July 1996.
59. J. Yen and L. Wang, "An SVD-based fuzzy model reduction strategy," IEEE Neural Networks Council 41, pp. 835-841.
60. ____, "Simplifying fuzzy rule-based models using orthogonal transformation methods," IEEE Trans. Syst. Man Cybern. B, vol. 29, pp. 13-24, Feb. 1999.