Fast and efficient second-order method for training radial basis function networks

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 4, 2012, Pages 609-619

  Xie, Tiantian ^a   Yu, Hao ^a   Hewlett, Joe ^a   Rozycki, Paweł ^b   Wilamowski, Bogdan ^a  

^a AUBURN UNIVERSITY   (United States)

^b UNIVERSITY OF INFORMATION TECHNOLOGY AND MANAGEMENT   (Poland)

Author keywords

Levenberg Marquardt algorithm; radial basis function networks; second order algorithm

Indexed keywords

COMPUTATION PROCESS; COMPUTATION SPEED; LEVENBERG-MARQUARDT ALGORITHM; SECOND-ORDER ALGORITHMS; SECOND-ORDER METHODS; TRAINING ALGORITHMS; TRAINING PATTERNS; VARIABLE-DIMENSION;

JACOBIAN MATRICES; LEARNING ALGORITHMS;

RADIAL BASIS FUNCTION NETWORKS;

EID: 84876921583     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2185059     Document Type: Article

References (32)

1. J. Moody and C. J. Darken, "Fast learning in networks of locally-tuned processing units," Neural Comput., vol. 1, no. 2, pp. 281-294, 1989.
2. M. J. D. Powell, "Radial basis functions for multivariable interpolation: A review," in Proc. IMA Conf. Algorithms Applicat. Funct. Data, 1985, pp. 143-167.
3. J. Park and I. W. Sandberg, "Universal approximation using radial-basisfunction networks," Neural Comput., vol. 3, no. 2, pp. 246-257, 1991.
4. K. Meng, Z. Y. Dong, D. H. Wang, and K. P. Wong, "A self-adaptive RBF neural network classifier for transformer fault analysis," IEEE Trans. Power Syst., vol. 25, no. 3, pp. 1350-1360, Feb. 2010.
5. K. Meng, Z. Y. Dong, D. H. Wang, and K. P. Wong, "A self-adaptive RBF neural network classifier for transformer fault analysis," IEEE Trans. Power Syst., vol. 25, no. 3, pp. 1350-1360, Aug. 2010.
6. S. Huang and K. K. Tan, "Fault detection and diagnosis based on modeling and estimation methods," IEEE Trans. Neural Netw., vol. 20, no. 5, pp. 872-881, Apr. 2009.
7. Y. J. Lee and J. Yoon, "Nonlinear image upsampling method based on radial basis function interpolation," IEEE Trans. Image Process., vol. 19, no. 10, pp. 2682-2692, Oct. 2010.
8. S. Ferrari, F. Bellocchio, V. Piuri, and N. A. Borghese, "A hierarchical RBF online learning algorithm for real-time 3-D scanner," IEEE Trans. Neural Netw., vol. 21, no. 2, pp. 275-285, Feb. 2010.
9. L. Cai, A. B. Rad, and W. L. Chan, "An intelligent longitudinal controller for application in semiautonomous vehicles," IEEE Trans. Indust. Electron., vol. 57, no. 4, pp. 1487-1497, Apr. 2010.
10. C. C. Tsai, H. C. Huang, and S. C. Lin, "Adaptive neural network control of a self-balancing two-wheeled scooter," IEEE Trans. Indust. Electron., vol. 57, no. 4, pp. 1420-1428, Apr. 2010.
11. H. Yu, T. T. Xie, S. Paszczynski, and B. M. Wilamowski, "Advantages of radial basis function networks for dynamic system design," IEEE Trans. Indust. Electron., vol. 58, no. 12, pp. 5438-5450, Dec. 2011.
12. B. M. Wilamowski, N. Cotton, J. Hewlett, and O. Kaynak, "Neural network trainer with second order learning algorithms," in Proc. 11th INES Int. Conf. Intell. Eng. Syst., Budapest, Hungary, Jun.-Jul. 2007, pp. 127-132.
13. Z. Hong, "Algebraic feature extraction of image for recognition," Pattern Recognit., vol. 24, no. 3, pp. 211-219, 1991.
14. E. S. Chng, S. Chen, and B. Mulgrew, "Gradient radial basis function networks for nonlinear and nonstationary time series prediction," IEEE Trans. Neural netw., vol. 7, no. 1, pp. 190-194, Jan. 1996.
15. N. B. Karayiannis, "Reformulated radial basis neural networks trained by gradient descent," IEEE Trans. Neural Netw., vol. 10, no. 3, pp. 657-671, Aug. 2002.
16. D. Simon, "Training radial basis neural networks with the extended kalman filter," Neurocomputing, vol. 48, nos. 1-4, pp. 455-475, 2002.
17. B. A. Whitehead and T. D. Choate, "Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction," IEEE Trans. Neural Netw., vol. 7, no. 4, pp. 869-880, Jul. 1996.
18. M. J. L. Orr, "Regularization in the selection of radial basis function centers," Neural Computat., vol. 7, no. 3, pp. 606-623, May 1995.
19. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Netw., vol. 2, no. 2, pp. 302-309, Mar. 1991.
20. G. B. Huang, P. Saratchandran, and N. Sundararajan, "An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks," IEEE Trans. Syst. Man Cybern., vol. 34, no. 6, pp. 2284-2292, Dec. 2004.
21. S. Wu and T. W. S. Chow, "Induction machine fault detection using SOM-based RBF neural networks," IEEE Trans. Indust. Electron., vol. 51, no. 1, pp. 183-194, Feb. 2004.
22. A. Malinowski and H. Yu, "Comparison of embedded system design for industrial applications," IEEE Trans. Indust. Informat., vol. 7, no. 2, pp. 244-254, May 2011.
23. B. M. Wilamowski and H. Yu, "Improved computation for levenberg marquardt training," IEEE Trans. Neural Netw., vol. 21, no. 6, pp. 930-937, Jun. 2010.
24. B. M. Wilamowski and H. Yu, "Neural network learning without backpropagation," IEEE Trans. Neural Netw., vol. 21, no. 11, pp. 1793-1803, Nov. 2010.
25. M. T. Hagan and M. B. Menhaj, "Training feedforward networks with the marquardt algorithm," IEEE Trans. Neural Netw., vol. 5, no. 6, pp. 989-993, Nov. 1994.
26. B. M. Wilamowski, "Challenges in applications of computational intelligence in industrial electronics," in Proc. Int. Symp. Indust. Electron., Bari, Italy, Jul. 2010, pp. 15-22.
27. N. Sundararajan, P. Saratchandran, and Y. W. Li, Radial Basis Function Neural Networks With Sequential Learning: MRAN and Its Applications. Singapore: World Scientific, 1999.
28. V. Kadirkamanathan and M. Niranjan, "A function estimation approach to sequential learning with neural networks," Neural Comput., vol. 5, no. 6, pp. 954-975, 1993.
29. J. Platt, "A resource-allocating network for function interpolation," Neural Comput., vol. 3, no. 2, pp. 213-225, 1991.
30. M. Bortman and M. Aladjem, "A growing and pruning method for radial basis function networks," IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 1039-1045, Jun. 2009.
31. C. Blake and C. Merz, "UCI repository of machine learning databases," Ph.D. dissertation, Dept. Inform. Comput. Sci., Univ. California, Irvine, 1998.
32. H. Yu and B. M. Wilamowski, "Efficient and reliable training of neural networks," in Proc. 2nd IEEE Human Syst. Interaction Conf., Catania, Italy, May 2009, pp. 109-115.