An information gain technique for acceleration of convergence of artificial neural networks

2005 Fifth International Conference on Information, Communications and Signal Processing

Volumn 2005, Issue , 2005, Pages 349-352

  Jearanaitanakij, Kietikul ^a   Pinngern, Ouen ^a  

^a KING MONGKUT'S INSTITUTE OF TECHNOLOGY LADKRABANG   (Thailand)

Author keywords

Artificial neural network; Classification; Convergence acceleration; Information gain

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); CONVERGENCE OF NUMERICAL METHODS; FEATURE EXTRACTION; RANDOM PROCESSES;

CONVERGENCE ACCELERATION; INFORMATION GAIN; SUM SQUARED ERROR; TRAINING DATA;

NEURAL NETWORKS;

EID: 34147172882     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. D.E. Rumelhart, G.E. Hinton, and R.J. Williams, "Learning internal representations by error propagation," in Parallel Distributed Processing: Exploration in the Microstructure of Cognition: vol.1: Foundations, eds. D.E. Rumelhart and J.L. McClelland, pp.318-362, The MIT Press, Cambridge, Massachusetts, 1986.
2. T.P. Vogl, J.K. Mangis, A.K.Rigler, W.T.Zink, and D.L.Alkon, "Accelerating the convergence of the Backpropagation method," Biological Cybernetics, 59, pp.257-263, 1988.
3. T.Ash, "Increased rates of convergence through learning rate adaptation," Neural Networks, vol.1, 1988.
4. S. Sureerattanan, H.N. Phien, "New Developments on Backpropagation Network Training," IEICE Trans. Fundamental, vol. E83-A, no.6, pp. 1032-1039, June 2000.
5. M. Hagiwara and M.Nakagawa, "Supervised learning with artificial selection," Proc. UCNN'89, II pp.611, June 1989.
6. M. Hagiwara, "Novel BackPropagation Algorithm for Reduction of Hidden Units and Acceleration of Convergence using Artificial Selection," Proc. IJCNN'90, vol. I, pp. 625-630, 1990.
7. Shannon, C. E. and Weaver, W., The Mathematical Theory of Communication, University of Illinois Press, Urbana, Illinois, 1949.
8. Nguyen H. S., Skowron A., "Quantization of real values attributes, Rough set and Boolean Reasoning Approaches," Proc. of the Second Joint Annual Conference on Information Sciences, Wrightsville Beach, NC, pp 34-37, 1995.
9. S. Haykin, Neural Networks: A Comprehensive Foundation, Macmillan College Publishing Company, New York, 1994. [10] M. Negnevitsky, Artificial Intelligence A Guide to Intelligent Systems, Addison-Wesley, 2002.