A new error function at hidden layers for fast training of multilayer perceptrons

IEEE Transactions on Neural Networks

Volumn 10, Issue 4, 1999, Pages 960-964

  Oh, Sang Hoon ^a   Lee, Soo Young ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

Error function; Fast learning; Hidden nodes; Layer by layer algorithm; Optimum learning rates

Indexed keywords

APPROXIMATION THEORY; BACKPROPAGATION; CHARACTER RECOGNITION; CONVERGENCE OF NUMERICAL METHODS; ERROR DETECTION; LEARNING ALGORITHMS; VECTORS;

ERROR BACKPROPAGATION ALGORITHM; ERROR FUNCTION; HANDWRITTEN DIGIT RECOGNITION; HIDDEN NODES; HIDDEN WEIGHT VECTOR;

MULTILAYER NEURAL NETWORKS;

EID: 0032678016     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.774272     Document Type: Article

References (14)

1. D. E. Rumelhart and J. L. McClelland, Parallel Distributed Processing. Cambridge, MA: MIT Press, 1986.
2. R. A. Jacobs, "Increased rates of convergence through learning rate adaptation," Neural Networks, vol. 1, pp. 295-307, 1988.
3. T. P. Vogl, J. K. Mangis, A. K. Rigler, W. T. Zink, and D. L. Alkon, "Accelerating the convergence of the back-propagation method," Biol. Cybern., vol. 59, pp. 257-263, 1988.
4. S.-H. Oh, "Improving the error backpropagation algorithm with a modified error function," IEEE Trans. Neural Networks, vol. 8, pp. 799-803, 1997.
5. A. van Ooyen and B. Nienhuis, "Improving the convergence of the back-propagation algorithm," Neural Networks, vol. 5, pp. 465-471, 1992.
6. R. Pansi, E. D. Di Claudio, G. Orlandi, and B. D. Rao, "A generalized learning paradigm exploiting the structure of feedforward neural networks," IEEE Trans. Neural Networks, vol. 7, pp. 1450-1459, 1996.
7. G.-J. Wang and C.-C. Chen, "A fast multilayer neural networks training algorithm based on the layer-by-layer optimizing procedures," IEEE Trans. Neural Networks, vol. 7, pp. 768-775, 1996.
8. F. Biegler-Konig and F. Marmann, "A learning algorithm for multilayered neural networks based on linear least squares problems," Neural Networks, vol. 6, pp. 127-131, 1993.
9. J. Y. F. Yam and W. S. Chow, "Extended least squares based algorithm for training feedforward networks," IEEE Trans. Neural Networks, vol. 8, pp. 806-810, 1997.
10. S. Ergezinger and E. Thomsen, "An accelerated learning algorithm for multilayer pereceptrons: Optimization layer by layer," IEEE Trans. Neural Networks, vol. 6, pp. 31-42, 1995.
11. J. J. Hull, "A database for handwritten text recognition research," IEEE Trans. Pattern Anal. Machine Intell., vol. 16, pp. 550-554, May 1994.
12. D.-S. Kim, S.-Y. Lee, and R. M. Kil, "Auditory processing of speech signals for robust speech recognition in real-world noisy environments," IEEE Trans. Speech Audio Processing, vol. 7, pp. 55-69, 1999.
13. Y. Lee, S.-H. Oh, and M. W. Kim, "An analysis of premature saturation in back-propagation learning," Neural Networks, vol. 6, pp. 719-728, 1993.
14. S.-H. Oh and Y. Lee, "Effect of nonlinear functions on correlation between weighted sums in multilayer perceptrons," IEEE Trans. Neural Networks, vol. 5, pp. 508-510, 1994.