Analysis of global convergence and learning parameters of the back-propagation algorithm for quadratic functions

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4682 LNAI, Issue , 2007, Pages 7-13

  Zeng, Zhigang ^a  

^a WUHAN UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; COST FUNCTIONS; PARAMETER ESTIMATION;

LEARNING PARAMETERS; MOMENTUM EQUATIONS; QUADRATIC FUNCTIONS;

LEARNING SYSTEMS;

EID: 38049007529     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-74205-0_2     Document Type: Conference Paper

References (8)

1. Phansalkar, V.V., and Sastry, P.S.: Analysis of the Back-propagation Algorithm with Momentum. IEEE Trans. Neural Networks, 5 (1994) 505-506
2. Rumelhart, D.E., Hinton, G.E., and Williams, R.J.: Learning Representations by Back-propagating Errors. Nature, 323 (1986) 533-536
3. Hagan, M.T., Demuth, H.B., and Beale, M.H.: Neural Network Design. Boston, MA: PWS, (1996)
4. Torii, M., and Hagan, M.T.: Stability of Steepest Descent with Momentum for Quadratic Functions. IEEE Trans. Neural Networks, 13 (2002) 752-756
5. Hagiwara, M., and Sato, A.: Analysis of Momentum Term in Back-propagation. IEICE Trans. Inform. Syst., 8 (1995) 1-6
6. Sato, A.: Analytical Study of the Momentum Term in A Backpropagation Algorithm. Proc. ICANN91, (1991) 617-622
7. Qian, N.: On the Momentum Term in Gradient Descent Learning Algorithms. Neural Networks, 12 (1999) 145-151
8. Zeng, Z.G., Huang, D.S., and Wang, Z.F.: Global Convergence of Steepest Descent for Quadratic Functions. In: Yang, Z.R. et al. (eds.): Intelligent Data Engineering and Automated Learning C IDEAL 2004. Lecture Notes in Computer Science, Vol. 3177. Springer-Verlag, Berlin Heidelberg New York (2004) 672-677