Geometrical perspective on learning behavior

Journal of Information Science and Engineering

Volumn 21, Issue 4, 2005, Pages 721-732

  Liou, Cheng Yuan ^a   Huang, Jau Chi ^a   Kuo, Yen Ting ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Back propagation learning; Momentum method; Multilayer network; Neural network; Premature saturation

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; BACKPROPAGATION; BEHAVIORAL RESEARCH; COMPUTATIONAL GEOMETRY; DECISION THEORY; METHOD OF MOMENTS; PERSONNEL TRAINING;

BCK-PROPAGATION LEARNING; MOMENTUM METHOD; MULTILAYER NETWORK; PREMATURE SATURATION;

LEARNING SYSTEMS;

EID: 22144480950     PISSN: 10162364     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (9)

1. T. M. Cover, "Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition," IEEE Transitions on Electronic Computers, Vol. 14, 1965, pp. 326-334.
2. R. A. Jacobs, "Increased rates of convergences through learning rate adaptation," Neural Networks, Vol. 1, 1988, pp. 295-307.
3. Y. Lee, S. H. Oh, and M. W. Kim, "An analysis of premature saturation in back propagation learning," Neural Network, Vol. 6, 1993, pp. 719-728.
4. J. Li, A. N. Michel, and W. Porod, "Analysis and synthesis of a class of neural networks: linear systems operating on a closed hypercube," IEEE Transactions on Circuits and Systems, Vol. 36, 1989, pp. 1405-1422.
5. C. Y. Liou and H. T. Chen, "Self-relaxation for multilayer perceptron," The 3rd Asian Fuzzy Systems Symposium (AFSS '98), 1998, pp. 113-117.
6. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagating errors," Nature, Vol. 323, 1986, pp. 533-536.
7. F. M. Silva and L. B. Almeida, "Acceleration technique for the backpropagation algorithm," in Proceedings of Neural Networks EURASIP Workshop, L. B. Almeida and C. J. Wellekens (eds.), 1990, pp. 110-119.
8. R. L. Watrous, "Learning algorithms for connectionist networks: applied gradient methods of nonlinear optimization," in FIRST IEEE International Conference on Neural Networks, Vol. 2, 1987, pp. 619-627.
9. P. J. Werbos, "Backpropagation through time: what it does and how to do it," in Proceedings of the IEEE, Vol. 78, 1990, pp. 1550-1560.