A modified error function for the backpropagation algorithm

Neurocomputing

Volumn 57, Issue 1-4, 2004, Pages 477-484

  Wang, X G ^a   Tang, Z ^a   Tamura, H ^a   Ishii, M ^a  

^a UNIVERSITY OF TOYAMA   (Japan)

Author keywords

Backpropagation; Learning; Local minima; Modified error function

Indexed keywords

ALGORITHMS; BENCHMARKING; COMPUTER SIMULATION; ERROR ANALYSIS;

ERROR FUNCTIONS;

BACKPROPAGATION;

ALGORITHM; ANALYTICAL ERROR; ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION; COMPUTER SIMULATION; CONTROLLED STUDY; LEARNING; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; PROBLEM SOLVING; QUALITY CONTROL; SIGNAL TRANSDUCTION; TASK PERFORMANCE; VALIDATION PROCESS;

EID: 1542471406     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2003.12.006     Document Type: Article

References (17)

1. S. Bengio, Y. Bengio, J. Cloutier, Use of genetic programming for the search of a new learning rule for neural networks, Proceedings of the First IEEE World Congress on Computational Intelligence and Evolutionary Computation, Orlando, FL, 27-29 June, 1994, pp. 324-327.
2. C.L. Blake, C.J Merz, UCI Repository of machine learning databases, http://www.ics.uci.edu/~mlearn/MLRepository.html, University of California, Department of Information and Computer Science, Irvine, CA, 1998.
3. Cybenko G. Approximation by superposition of a sigmoid function Math. Control Signals Syst. 2 1989 303-314
4. Funahashi K. On the approximate realization of continuous mapping by neural networks Neural Networks 2 3 1989 183-192
5. C. Goerick, W.V. Seelen, On unlearnable problems or A model for premature saturation in backpropagation learning, in: Proceedings of the European Symposium On Artificial Neural Networks '96, Brugge, Belgium, 24-26 April 1996, pp. 13-18.
6. Gori M. Tesi A. On the problem of local minima in backpropagation IEEE Trans. Pattern Anal. Mach. Intell. 14 1 1992 76-86
7. Hadjiprocopis A. Feed forward neural network entities, Ph.D. Thesis, Department of Computer Science 2000 City University London, UK
8. Haykin S. Neural Networks, a Comprehensive Foundation 1994 Macmillan New York
9. Hornik K. Stinchcombe M. White H. Multilayer feedforward networks are universal approximators Neural Networks 2 5 1989 359-366
10. B. Irie, S. Miyake, Capabilities of three-layered perceptions, Proceedings of the IEEE Conference on Neural Networks, Vol. I, San Diego, CA, 24-27 July 1988, pp. 641-648.
11. C.B. Owen, A.M. Abunawass, Application of simulated annealing to the backpropagation model improves convergence, Proceedings of the SPIE Conference on the Science of Artificial Neural Networks, Vol. II, 1966, Orlando, FL, 13-16 April 1993, pp. 269-276.
12. D.E. Rumelhart, G.E. Hinton, R.J. Williams, Learning internal representations by back-propagating errors, in: D.E. Rumelhart, J.L. McClelland, the PDP Research Group (Eds.), Parallel Distributed Processing, Vol. 1, MIT Press, Cambridge, MA, 1986, pp. 318-362.
13. V.G. Sigillito, S.P. Wing, L.V. Hutton, K.B. Baker, Classification of radar returns from the ionosphere using neural networks, Johns Hopkins APL Technical Digest, Vol. 10, Johns Hopkins University, Baltimore, MD, 1989, pp. 262-266.
14. A. Von Lehmen, E.G. Paek, P.F. Liao, A. Marrakchi, J.S. Patel, Factors influencing learning by backpropagation, Proceedings of the IEEE International Conference on Neural Networks, Vol. I, San Diego, CA, 1988, pp. 335-341.
15. Wang C. Principe J.C. Training neural networks with additive noise in the desired signal IEEE Trans. Neural Networks 10 6 1999 1511-1517
16. L.F.A. Wessels, E. Barnard, E. van Rooyen, The physical correlates of local minima, in: Proceedings of the International Neural Network Conference, Paris, July 1990, p. 985.
17. Zweiri Y.H. Whidborne J.F. Seneviratne L.D. A three-term backpropagation algorithm Neurocomputing 50 2003 305-318