Improving the error backpropagation algorithm with a modified error function

IEEE Transactions on Neural Networks

Volumn 8, Issue 3, 1997, Pages 799-803

  Oh, Sang Hoon ^a  

^a Electronics and Telecommunications Research Institute (ETRI)   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BACKPROPAGATION; DATABASE SYSTEMS; ERROR ANALYSIS; FUNCTIONS; LEARNING SYSTEMS; PATTERN RECOGNITION; PROBABILITY;

ERROR BACKPROPAGATION (EBP) ALGORITHM; MULTILAYER PERCEPTRONS (MLP); SIGMOID ACTIVATION FUNCTIONS;

NEURAL NETWORKS;

EID: 0031143834     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.572117     Document Type: Article

References (15)

1. D. E. Rumelhart and J. L. McClelland, Parallel Distributed Processing. Cambridge, MA:, MIT Press, 1986.
2. R. K. Cheung, I. Lustig, and A. L. Kornhauser, "Relative effectiveness of training set patterns for backpropagation," in Proc. IJCNN, Washington, D.C., vol. I, Jan. 15-19, 1990, pp. 673-678.
3. Y. Lee, S.-H. Oh, and M. W. Kim, "An analysis of premature saturation in backpropagation learning," Neural Networks, vol. 6, pp. 719-728, 1993.
4. J. R. Chen and P. Mars, "Stepsize variation methods for accelerating the backpropagation algorithm," in Proc. IJCNN, Washington, D.C., vol. I, Jan. 15-19, 1990, pp. 601-604.
5. A. Rezgui and N. Tepedelenlioglu, "The effect of the slope of the activation function on the backpropagation algorithm," in Proc. IJCNN, Washington, D.C., vol. I, Jan. 15-19, 1990, pp. 707-710.
6. A. van Ooyen and B. Nienhuis, "Improving the convergence of the backpropagation algorithm," Neural Networks, vol. 5, pp. 465-471, 1992.
7. M. D. Richard and R. P. Lippmann, "Neural network classifier estimate Bayesian a posteriori probabilities," Neural Computa., vol. 3, pp. 461-483, 1991.
8. S.-H. Oh and Y. Lee, "A modified error function to improve the error backpropagation algorithm for multilayer perceptrons," ETRI J., vol. 17, no. 1, pp. 11-22, Apr. 1995.
9. J. B. Hampshire II and A. H. Waibel, "A novel objective function for improved phoneme recognition using time-delay neural networks," IEEE Trans. Neural Networks, vol. 1, pp. 216-228, June 1990.
10. B. A. Telfer and H. H. Szu, "Energy functions for minimizing misclassification error with minimum-complexity networks," Neural Networks, vol. 7, pp. 809-818, 1994.
11. D.-G. Jeong and S.-Y. Lee, "Merging backpropagation and Hebbian learning rules for robust classifications," Neural Networks, vol. 9, no. 7, pp. 1213-1222, 1996.
12. J. J. Hull, "A database for handwritten text recognition research," IEEE Trans. Pattern Anal. Machine Intell., vol. 16, pp. 550-554, May 1994.
13. H. White, "Learning in artificial neural networks: a statistical perspective," Neural Computa., vol. 1, pp. 425-464, 1989.
14. J. B. Hampshire II and B. Pearlmutter, "Equivalence proofs for multilayer perceptron classifier and the Bayesian discriminant function," Proc. 1990 Connectionist Model Summer School, pp. 159-172, 1990.
15. Y. Lee, "Handwritten digit recognition using k nearest-neighber, radial-basis function, and backpropagation neural networks," Neural Computa., vol. 3, pp. 440-449, 1991.