Fast Convergence for Back-Propagation Network with Magnified Gradient Function

Proceedings of the International Joint Conference on Neural Networks

Volumn 3, Issue , 2003, Pages 1903-1908

  Ng, S C ^a   Cheung, C C ^a   Leung, S H ^a   Luk, A ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; ITERATIVE METHODS;

BACK PROPAGATION ALGORITHMS;

NEURAL NETWORKS;

EID: 0141459829     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. A. M. Franzini, "Speech recognition with back propagation," Proceedings of the Ninth Annual Conference of the IEEE Engineering in Medicine and Biology Society, Boston, 1987, pp. 1702-1703.
2. S. E. Fahlman, "Fast learning variations on back-propagation: An empirical study," Proceedings of the 1988 Connectionist Models Summer School (Pittsburgh, 1988), D. Touretzky, G. Hinton and T. Sejnowski, eds., p. 38-51, 1989.
3. J. R. Chen and P. Mars, "Stepsize variation methods for accelerating the back-propagation algorithm," Proceedings of the International Joint Conference on Neural Networks, vol. 1, pp. 601-604, 1990.
4. A. Van Ooyen, and B. Nienhuis, "Improving the convergence of the back-propagation algorithm," Neural Networks, vol. 5, pp. 465-471, 1992.
5. Y. Lee, S. H. Oh, and M. W. Kim, "An Analysis of Premature Saturation in Back Propagation Learning," Neural Networks, vol. 6, pp. 719-728, 1993.
6. M. Riedmiller and H. Braun, "A direct adaptive method for faster back-propagation learning: The RPROP Algorithm," Proceedings of International Conference on Neural Networks, vol. 1, p. 586-591, 1993.
7. J. E. Vitela, and J. Reifman, "Enhanced backpropagation training algorithm for transient event identification," Transactions of the American Nuclear Society, vol. 69, pp. 148-149, 1993.
8. C. M. Kuan and K. Hornik, "Convergence of Learning Algorithms with Constant Learning Rates," IEEE Trans. on Neural Networks, vol. 2, no. 5, p. 484-489, 1991.
9. B. Verma, "Fast Training of Multilayer Perceptrons," IEEE Trans on Neural Networks, vol. 8, no. 6, p. 1314-1329, 1997.
10. D. E. Rumelhart, G. E. Hinton and R. J. Williams, "Learning internal representations by error propagation," Parallel Distributed Processing: Exploration in the Microstructure of Cognition, vol. 1 MIT Press, Cambridge, Mass, 1986.
11. N. K. Treadgold and T. D. Gedeon, "Simulated Annealing and Weight Decay in Adaptive Learning: the SARPROP Algorithm," IEEE Trans. on Neural Networks, vol. 9, no. 4, p. 662-668, 1998.
12. J. E. Vitela and J. Reifman, "Premature Saturation in Backpropagation Networks: Mechanism and Necessary Conditions," Neural Networks, vol. 10, no. 4, p. 721-735, 1997.
13. M. Gori, and A. Tesi, "On the problem of local minima in back-propagation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, no. 1, pp. 76-86, 1992.
14. E. K. Blum, "Approximation of Boolean functions by sigmoidal networks: Part I: XOR and other two variable functions," Neural Computation, vol. 1, no. 4, pp. 532-540, 1989.