Back propagation based on selective attention for fast convergence of training neural network

Proceedings of the World Congress on Intelligent Control and Automation (WCICA)

Volumn 3, Issue , 2004, Pages 2009-2013

  Yang, Bo ^a   Su, Xiaohong ^a   Wang, Yadong ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Artificial Neural Network; Back Propagation Algorithm; Flat Spots; Genetic Algorithm; Selective Attention

Indexed keywords

ARTIFICIAL NEURAL NETWORKS (ANN); ERROR SIGNALS; FLAT-SPOTS; SIGMOID FUNCTIONS;

COMPUTER SIMULATION; ERROR ANALYSIS; FUNCTIONS; GENETIC ALGORITHMS; NEURAL NETWORKS; OPTIMIZATION; PROBLEM SOLVING;

BACKPROPAGATION;

EID: 4444380415     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Balakrishnan, K. &Honavar, V.. Improving convergence of back propagation by handling flat-spots in the output layer. Proceedings of Second International Conference on Artificial Neural Networks, Brighton, U.K, Barmann F. & Biegler-Konig, F.(1992). On class of efficient learning algorithms for neural networks. Neural Networks, 5, 139-144, 1992
2. Parekh, R., Balakrishnan, K. &Honavor, V.(1992). An empirical comparison of flat-spot elimination techniques in back-propagation networks. Proceedings of Third Workshop on Neural Networks-WNN'92, Auburn, pp.55-60.
3. Fahlman, S.E. Faster-learning variations of back propagation: An empirical study. In D.Touretzky, G.E. Hinton, and T.J. Sejnowski(editors), Proceedings of the 1988 connectionist Models Summer School, San Mateo, CA: Morgan Kaufmann Publishers, pp 38-51, 1988
4. Jacobs R.A., "Increased rates of convergence through learning rate adaptation," Neural Networks, vol. 1, no. 4, pp.295-308, 1988
5. Bogdan M. Wilamowski, Yixin Chen, Efficient Algorithm for Training Neural Networks with one Hidden Layer, 1999
6. Francis Crick, The Astonishing Hypothesis: The Scientific Search for the Soul [M], Scribner; Reprint edition (July 1995)
7. http://www.ahisee.com/content/attent1essay.html#TOC1
8. Treisman, A Features and objects in visual processing. Scientific American, 1986(254), pp.114-124.
9. Bo Yang, Xiao-Hong Su, Ya-Dong Wang, BP Neural Network Optimization Based on An Improved Genetic Algorithm, Proceedings of the First International Conference on Machine Learning and Cybernetics, Beijing, 4-5 November 2002, pp.64-68.