Step acceleration based training algorithm for feedforward neural networks

Proceedings - International Conference on Pattern Recognition

Volumn 16, Issue 2, 2002, Pages 84-87

  Li, Yanlai ^a   Wang, Kuanquan ^a   Zhang, David ^b  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION THEORY; COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; EXTRAPOLATION; FEEDFORWARD NEURAL NETWORKS; FUNCTIONS; ITERATIVE METHODS; NEURAL NETWORKS; PATTERN RECOGNITION;

COMPUTATION TIME; CONJUGATE GRADIENT (CG); STEP ACCELERATION BASED TRAINING ALGORITHM (SATA);

ALGORITHMS;

COMPUTATION TIME; CONVERGING SPEED; HIGH SPEED; ITERATION STEP; MULTILAYER FEEDFORWARD NEURAL NETWORKS; TARGET FUNCTIONS; TRAINING ALGORITHMS;

EID: 33751581175     PISSN: 10514651     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. D.E. Rumelhart and J.L. McClelland, Parallel Distributed Processing. Cambridge, MA: MIT Press (1986).
2. R.A. Jacobs, "Increased rates of convergence through learning rate adaptation", Neural networks, 1, 295-307 (1988).
3. T.P. Vogl, J.K. mangis, A.K. Rigler, W.T. Zink, and D.L. Alkon, "Accelerating the convergence of the back-propagation method;", Biol. Cybern, 59, 257-263 (1988).
4. S.H. Oh, "Improving the error backpropagation algorithm with a modified error function", IEEE Trans. on Neural Network, 8, 799-803 (1997).
5. A.V. Oyen and B. Nienhuis, "Improving the convergence of the back-propagation algorithm", Neural Networks, 5, 465-471 (1992).
6. C. Bishop, " Extract calculation of Hessian matrix for the multilayer perceptron", Neural Computa., 4, 494-501 (1992).
7. W.L. Buntine and A.S. Weigend, "Computing second derivatives in feed forward networks: A review", IEEE Trans. on Neural Networks, 5, (1994).
8. R. Parisi, E.D. Di Claudio, G. Orlandi, and B.D. Rao. "A generalized learning paradigm exploiting the structure of feed forward neural networks", IEEE Trans. on Neural Networks, 7, 465-471 (1996).
9. G.J. Wang and C.C. Chen, "A fast multilayer neural network training algorithm based on the layer-by-layer optimizing procedures", IEEE Trans. on Neural Networks, 7, 768-775 (1996).
10. S.V. Kamarthi and S. Pittner, "Accelerating neural network training using weight extrapolations", Neural Networks, 12, 1285-1299 (1999).
11. N.B. Karayiannis and A.N. Venetsanopoulos, "Fast learning algorithms for neural networks", IEEE Tran. Circuits and Systems- II: Analog and Signal Processing, 39, 453-474 (1992).
12. M. Pfister and R. Rojas, "Speeding-up backpropagation- a comparison of orthogonal techniques". Proceedings of the International Joint Conference on Neural Networks, 1. Nasgoya, Japan: Japanese Neural Network Society, 517-523 (1993).
13. L. Zhang and B. Zhang, "On the BP algorithm of feedforward neural networks", International Journal of Pattern Recognition and Artificial Intelligence. 7, 191-195 (1994).
14. Xue Jiaqing, Optimization: Theory and Method (revised edition), Metallurgy Industry Publishing House, 1992.