Radial basis function network training using a nonsymmetric partition of the input space and particle swarm optimization

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 2, 2013, Pages 219-230

  Alexandridis, Alex ^a   Chondrodima, Eva ^a   Sarimveis, Haralambos ^b  

^a UNIVERSITY OF WEST ATTICA   (Greece)

^b NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

Author keywords

Fuzzy means algorithm; Fuzzy partition; Nonsymmetric partition; Particle swarm optimization; Radial basis function

Indexed keywords

FUZZY MEANS; FUZZY PARTITION; INTEGRATED FRAMEWORKS; NEURAL NETWORK TRAINING; NONSYMMETRIC; PREDICTION ACCURACY; RADIAL BASIS FUNCTIONS; SYNTHETIC BENCHMARK;

ALGORITHMS; BENCHMARKING; NEURAL NETWORKS; PARTICLE SWARM OPTIMIZATION (PSO);

RADIAL BASIS FUNCTION NETWORKS;

EID: 84875522416     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2227794     Document Type: Article

References (54)

1. C. A. Michelli, "Interpolation of scattered data: Distance matrices and conditionally positive definite functions," Constr. Approx., vol. 2, pp. 11-22, Mar. 1986.
2. T. Poggio and F. Girosi, "Networks for approximation and learning," Proc. IEEE, vol. 78, no. 9, pp. 1481-1497, Sep. 1990.
3. J. Moody and C. Darken, "Fast learning in networks of locally-tuned processing units," Neural Comput., vol. 1, no. 2, pp. 281-294, 1989.
4. C. Darken and J. Moody, "Fast adaptive K-means clustering: Some empirical results," in Proc. IEEE Int. Joint Conf. Neural Netw., San Diego, CA, Mar. 1990, pp. 233-238.
5. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Netw., vol. 2, no. 2, pp. 302-309, Mar. 1991.
6. X. Hong, "A fast identification algorithm for box-cox transformation based radial basis function neural network," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 1064-1069, Jul. 2006.
7. S. Chen, X. Hong, B. L. Luk, and C. J. Harris, "Construction of tunable radial basis function networks using orthogonal forward selection," IEEE Trans. Syst., Man., Cybern. B, Cybern., vol. 39, no. 2, pp. 457-466, Apr. 2009.
8. S. Chen, X. X. Wang, X. Hong, and C. J. Harris, "Kernel classifier construction using orthogonal forward selection and boosting with Fisher ratio class separability measure," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1652-1656, Nov. 2006.
9. Y. W. Wong, K. P. Seng, and L. M. Ang, "Radial basis function neural network with incremental learning for face recognition," IEEE Trans. Syst., Man., Cybern. B, Cybern., vol. 41, no. 4, pp. 940-949, Aug. 2011.
10. M. Hou and X. Han, "Constructive approximation to multivariate function by decay RBF neural network," IEEE Trans. Neural Netw., vol. 21, no. 9, pp. 1517-1523, Sep. 2010.
11. L. Yingwei, N. Sundararajan, and P. Saratchandran, "A sequential learning scheme for function approximation using minimal radial basis function neural networks," Neural Comput., vol. 19, no. 2, pp. 461-478, 1997.
12. A. Leonardis and H. Bischof, "An efficient MDL-based construction of RBF networks," Neural Netw., vol. 11, no. 5, pp. 963-973, 1998.
13. H. Sarimveis, A. Alexandridis, G. Tsekouras, and G. Bafas, "A fast and efficient algorithm for training radial basis function neural networks based on a fuzzy partition of the input space," Ind. Eng. Chem. Res., vol. 41, no. 4, pp. 751-759, 2002.
14. W Pedrycz, V. Loia, and S. Senatore, "Fuzzy clustering with viewpoints," IEEE Trans. Fuzzy Syst., vol. 18, no. 2, pp. 274-284, Apr. 2010.
15. U. Maulik, S. Bandyopadhyay, and I. Saha, "Integrating clustering and supervised learning for categorical data analysis," IEEE Trans. Syst., Man, Cybern. A, Syst. Humans, vol. 40, no. 4, pp. 664-675, Jul. 2010.
16. X. X. Zhang, H. X. Li, and C. K. Qi, "Spatially constrained fuzzy-clustering-based sensor placement for spatiotemporal fuzzy-control system," IEEE Trans. Fuzzy Syst., vol. 18, no. 5, pp. 946-957, Oct. 2010.
17. A. Alexandridis, H. Sarimveis, and G. Bafas, "A new algorithm for online structure and parameter adaptation of RBF networks," Neural Netw., vol. 16, no. 7, pp. 1003-1017, 2003.
18. A. Alexandridis, H. Sarimveis, and K. Ninos, "A radial basis function network training algorithm using a non-symmetric partition of the input space - application to a model predictive control configuration," Adv. Eng. Softw., vol. 42, no. 10, pp. 830-837, 2011.
19. J. A. Leonard and M. A. Kramer, "Radial basis function networks for classifying process faults," IEEE Control Syst., vol. 11, no. 3, pp. 31-38, Apr. 1991.
20. M. Orr, "Optimising the widths of radial basis functions," in Proc. 5th Brazilian Symp. Neural Netw., 1998, pp. 26-29.
21. W Yao, X. Chen, M. V. Tooren, and Y Wei, "Euclidean distance and second derivative based widths optimization of radial basis function neural networks," in Proc. Int. Joint Conf. Neural Netw., Barcelona, Spain, 2010, pp. 1-8.
22. W Yao, X. Chen, Y Zhao, and M. V. Tooren, "Concurrent subspace width optimization method for RBF neural network modeling," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 2, pp. 247-259, Feb. 2012.
23. S. F. Su, C. C. Chuang, C. W. Tao, J. J. Jeng, and C. C. Hsiao, "Radial basis function networks with linear interval regression weights for symbolic interval data," IEEE Trans. Syst., Man., Cybern. B, Cybern., vol. 42, no. 1, pp. 69-80, Feb. 2012.
24. D. Zhang, L.F. Deng, K. Y Cai, and A. So, "Fuzzy nonlinear regression with fuzzified radial basis function network," IEEE Trans. Fuzzy Syst., vol. 13, no. 6, pp. 742-760, Dec. 2005.
25. R. Langari, L. Wang, and J. Yen, "Radial basis function networks, regression weights, and the expectation-maximization algorithm," IEEE Trans. Syst., Man., Cybern. A, Syst. Humans, vol. 27, no. 5, pp. 613-623, Sep. 1997.
26. C. Andrieu, N. D. Freitas, and A. Doucet, "Robust full Bayesian learning for radial basis networks," Neural Comput., vol. 13, no. 10, pp. 2359-2407, 2001.
27. H. X. Huan, D. T. T. Hien, and H. H. Tue, "Efficient algorithm for training interpolation RBF networks with equally spaced nodes," IEEE Trans. Neural Netw., vol. 22, no. 6, pp. 982-988, Jun. 2011.
28. T. Xie, H. Yu, J. Hewlett, P. Rózycki, and B. Wilamowski, "Fast and efficient second-order method for training radial basis function networks," IEEE Trans. Neural Netw., vol. 23, no. 4, pp. 609-619, Apr. 2012.
29. H. Sarimveis, A. Alexandridis, S. Mazarakis, and G. Bafas, "A new algorithm for developing dynamic radial basis function neural network models based on genetic algorithms," Comput. Chem. Eng., vol. 28, nos. 1-2, pp. 209-217, 2004.
30. P. A. Gutiérrez, C. Hervás-Martínez, and F. J. Martínez-Estudillo, "Logistic regression by means of evolutionary radial basis function neural networks," IEEE Trans. Neural Netw., vol. 22, no. 2, pp. 246-263, Feb. 2011.
31. J. González, I. Rojas, J. Ortega, H. Pomares, F. J. Fernández, and A. F. Díaz, "Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation," IEEE Trans. Neural Netw., vol. 14, no. 6, pp. 1478-1495, Nov. 2003.
32. O. Buchtala, M. Klimek, and B. Sick, "Evolutionary optimization of radial basis function classifiers for data mining applications," IEEE Trans. Syst., Man., Cybern. B, Cybern., vol. 35, no. 5, pp. 928-947, Oct. 2005.
33. F. Valdez, P. Melin, and O. Castillo, "Evolutionary method combining particle swarm optimisation and genetic algorithms using fuzzy logic for parameter adaptation and aggregation: The case neural network optimisation for face recognition," Int. J. Artif. Intell. Soft Comput., vol. 2, nos. 1-2, pp. 77-102, 2010.
34. F. Valdez, P. Melin, and O. Castillo, "An improved evolutionary method with fuzzy logic for combining particle swarm optimization and genetic algorithms," Appl. Soft Comput., vol. 11, no. 2, pp. 2625-2632, 2011.
35. S. Chen, X. Hong, and C. J. Harris, "Particle swarm optimization aided orthogonal forward regression for unified data modeling," IEEE Trans. Evol. Comput., vol. 14, no. 4, pp. 477-499, Aug. 2010.
36. D. S. Huang and J. X. Du, "A constructive hybrid structure optimization methodology for radial basis probabilistic neural networks," IEEE Trans. Neural Netw., vol. 19, no. 12, pp. 2099-2115, Dec. 2008.
37. S. K. Oh, W. D. Kim, W. Pedrycz, and S. C. Joo, "Design of K-means clustering-based polynomial radial basis function neural networks (pRBF NNs) realized with the aid of particle swarm optimization and differential evolution," Neurocomputing, vol. 78, no. 1, pp. 121-132, 2012.
38. A. Alexandridis and H. Sarimveis, "Nonlinear adaptive model predictive control based on self-correcting neural network models," AIChE J., vol. 51, no. 9, pp. 2495-2506, 2005.
39. K. Ninos, C. Giannakakis, I. Kompogiannis, I. Stavrakas, and A. Alexandridis, "Nonlinear control of a DC-motor based on radial basis function neural networks," in Proc. IEEE Int. Symp. Innov. Intell. Syst. Appl., Istanbul, Turkey, Jun. 2011, pp. 611-615.
40. A. Alexandridis, P. Patrinos, H. Sarimveis, and G. Tsekouras, "A two-stage evolutionary algorithm for variable selection in the development of RBF neural network models," Chemometrics Intell. Lab. Syst., vol. 75, no. 2, pp. 149-162, 2005.
41. P. Patrinos, A. Alexandridis, K. Ninos, and H. Sarimveis, "Variable selection in nonlinear modeling based on RBF networks and evolutionary computation," Int. J. Neural Syst., vol. 20, no. 5, pp. 365-379, 2010.
42. A. Alexandridis, E. Chondrodima, K. Moutzouris, and D. Triantis, "A neural network approach for the prediction of the refractive index based on experimental data," J. Mater. Sci., vol. 47, no. 2, pp. 883-891, 2012.
43. A. Alexandridis, D. Triantis, I. Stavrakas, and C. Stergiopoulos, "A neural network approach for compressive strength prediction in cement-based materials through the study of pressure-stimulated electrical signals," Construct. Build. Mater., vol. 30, pp. 294-300, May 2012.
44. J. Nie, "Fuzzy control of multivariable nonlinear servomechanisms with explicit decoupling scheme," IEEE Trans. Fuzzy Syst., vol. 5, no. 2, pp. 304-311, May 1997.
45. A. Engelbrecht, Computational Intelligence: An Introduction, 2nd ed. Chichester, U.K.: Wiley, 2007.
46. A. Asuncion and D. J. Newman. (2007). UCI Machine Learning Repository. Univ. California, Irvine [Online]. Available: http://archive.ics.uci.edu/ml/
47. G. E. P. Box and G. M. Jenkins, Time Series Analysis: Forecasting and Control. San Francisco, CA: Holden-Day, 1970.
48. K. Kilic, B. A. Sproule, I. B. Türksen, and C. A. Naranjo, "A fuzzy system modeling algorithm for data analysis and approximate reasoning," Robot. Auton. Syst., vol. 49, nos. 3-4, pp. 173-180, 2004.
49. J. Friedman, "Multivariate adaptive regression splines," Ann. Stat., vol. 19, no. 1, pp. 1-67, 1991.
50. Z. Shi and M. Han, "Support vector echo-state machine for chaotic time-series prediction," IEEE Trans. Neural Netw., vol. 18, no. 2, pp. 359-372, Mar. 2007.
51. C. C. Holmes and B. K. Mallick, "Bayesian wavelet networks for nonparametric regression," IEEE Trans. Neural Netw., vol. 11, no. 1, pp. 27-35, Jan. 2000.
52. C. K. Loo, M. Rajeswari, and M. V. C. Rao, "Novel direct and self-regulating approaches to determine optimum growing multi-experts network structure," IEEE Trans. Neural Netw., vol. 15, no. 6, pp. 1378-1395, Nov. 2004.
53. T. Samad, "Backpropagation with expected source values," Neural Netw., vol. 4, no. 5, pp. 615-618, 1991.
54. M. T. Hagan and M. Menhaj, "Training feedforward networks with the Marquardt algorithm," IEEE Trans. Neural Netw., vol. 5, no. 6, pp. 989-993, Nov. 1994.