A fast multilayer neural-network training algorithm based on the layer-by-layer optimizing procedures

IEEE Transactions on Neural Networks

Volumn 7, Issue 3, 1996, Pages 768-775

  Wang, Gou Jen ^a   Chen, Chih Cheng ^a  

^a NATIONAL CHUNG HSING UNIVERSITY   (Taiwan)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; IDENTIFICATION (CONTROL SYSTEMS); LEARNING ALGORITHMS; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; MATRIX ALGEBRA; OPTIMIZATION; PARAMETER ESTIMATION; VECTORS;

DYNAMIC FORGETTING FACTORS METHOD; OUTPUT VECTORS; TRAINING ALGORITHMS; WEIGHT MATRIX;

FEEDFORWARD NEURAL NETWORKS;

EID: 0030142280     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.501734     Document Type: Article

References (10)

1. H. S. M. Beigi and C. J. Li, "Learning algorithms for neural networks based on quasi-Newton methods with self-scaling," ASME Trans. J. Dynamic Syst., Measurement, Contr., vol. 115, pp. 38-43, 1993.
2. W. Brogan, Modern Control Theory. Englewood Cliffs, New Jersey: Prentice-Hall, 1985.
3. T. Chen and H. Chen, "Approximations of continuous functionals by neural networks with application to dynamic systems," IEEE Trans. Neural Networks, vol. 4, pp. 910-918, 1993.
4. Y. Iiguni, H. Sakai, and H. Tokumaru, "A real-time learning algorithm for a multilayered neural network based on the extended Kalman filter," IEEE Trans. Signal Processing, vol. 40, pp. 959-966, 1992.
5. R. A. Jacobs, "Increased rates of convergence through learning rate adaptation," Neural Networks, vol. 1, pp. 295-307, 1988.
6. D. E. Rumelhart and J. L. McClelland, Parallel Distributed Processing, vol. 1. Cambridge, MA: MIT Press, 1986.
7. R. S. Scalero and N. Tepedelenlioglu, "A fast new algorithm for training feedforward neural networks," IEEE Trans. Signal Processing, vol. 40, pp. 202-210, 1992.
8. S. A. Solla, E. Levin, and M. Fleisher, "Accelerated learning in layered neural networks," Complex Syst., vol. 2, pp. 625-640, 1988.
9. T. P. Vogl, J. K. Mangis, A. K. Rigler, W. T. Zink, and D. L. Alkon, "Accelerating the convergence of the backpropagation method," Biol. Cybern., vol. 59, pp. 257-263, 1988.
10. B. E. Ydstie, L. S. Kershenbaum, and R. W. H. Sargent, "Theory and application of an extended horizon self-tuning controller," AIChE J., vol. 31, no. 11, pp. 1771-1780, 1985.