Convergence of BP algorithm with variable learning rates for FNN training

Proceedings - Fifth Mexican International Conference on Artificial Intelligence, MICAI 2006

Volumn , Issue , 2006, Pages 245-250

  Shao, Hongmei ^a   Wu, Wei ^a  

^a DALIAN UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; ERROR ANALYSIS; LEARNING SYSTEMS; NEURAL NETWORKS;

ERROR FUNCTION; LEARNING RATES;

ALGORITHMS;

EID: 34547683603     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MICAI.2006.11     Document Type: Conference Paper

References (10)

1. L.W. Chan, F. Fallside, "An adaptive training algorithm for backpropagation networks", Computer Speech and Language, vol. 2, pp.205-218, 1987.
2. M.T. Hagan, H.B. Demuth and M.Beale, Neural Network Design, China Machine Press, Beijing, 2003.
3. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd edition, Tsinghua University Press and Prentice Hall, Beijing, 2001.
4. R.A. Jacobs, "Increased rates of convergence throught learning rate adaption", Neural Networks, vol. 4, pp.117-134, 1994.
5. D.E. Rumelhart, J.L. McClelland, and the PDP Research Group, Parall Distributed Processing-Explorations in the Microstructure of Cognition, Mass.: MIT Press, Cambridge, 1986.
6. F.M. Silva, L.B.Almeida, "Acceleration techniques for the backpropagation algorithm", Proc. of Neural Networks, EURASIP Workshop, Lecture Notes in Computer Science (Springer-Verlag), vol. 412, pp.110-119, 1990.
7. D.R. Wilson, T.R. Martinez, "The need for small learning rate on large problems", Int. Joint Conf. on Neural Networks (IJCNN'01), pp. 115-119, 2001.
8. W. Wu, G. Feng and X. Li, "Training multilayer perceptrons via minimization of sum of ridge functions", Advances in Comput. Math., vol. 17, pp.331-347, 2002.
9. W. Wu, G. Feng, Z. Li and Y. Xu, "Deterministic convergence of an online gradient method for BP neural networks", IEEE Trans, on Neural Networks, vol. 16(3), pp.533-540, 2005.
10. Y.X. Yuan, W. Y. Sun, Optimization Theory and Methods, Science Press, Beijing, 2001.