A Novel Multilayer Neural Networks Training Algorithm that Minimizes the Probability of Classification Error

IEEE Transactions on Neural Networks

Volumn 4, Issue 4, 1993, Pages 650-659

  Nedeljkovic, Vladimir ^a  

^a UNIVERSITY OF THE WITWATERSRAND   (South Africa)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; ERROR DETECTION; OPTIMIZATION; PATTERN RECOGNITION; PROBABILITY; STOCHASTIC CONTROL SYSTEMS; SYSTEM THEORY;

BACKPROPAGATION ALGORITHM; BAYESIAN BACK PROPAGATION; CLASSIFICATION ERROR; CONVERGENCE ANALYSIS; MEAN SQUARE ERROR; MULTILAYER NEURAL NETWORKS TRAINING ALGORITHMS;

NEURAL NETWORKS;

EID: 0027632250     PISSN: 10459227     EISSN: 19410093     Source Type: Journal    
DOI: 10.1109/72.238319     Document Type: Article

References (14)

1. E. Barnard and D. Casasent, “A comparison between criterion functions for linear classifiers, with an application to neural nets,” IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 1030–1041, Sept./Oct. 1989.
2. H. Do-Tu and M. Installe, “Learning algorithms for nonparametric solution to the minimum error classification problem,” IEEE Trans. vol. 648–659, 1979.
3. P. A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach. Englewood Cliffs, NJ: Prentice-Hall, 1982.
4. R. P. Lippman, “An introduction to computing with neural nets,” IEEE ASSP Mag., 4–22, Apr. 1987.
5. J. MacQueen, “On the asymptotic behavior of K-means,” in Proc. 5th Berkeley on Math. Prob. and Statist., CA, Jan. 1967.
6. J. M. Mendel and K. S. Fu, Eds., Adaptive Learning and Pattern Recognition Systems—Theory and Applications. New York: Academic Press, 1970.
7. V. Nedeljković and M. Milosavljević, “On the stochastic approximation based learning algorithm for neural networks,” in Proc. IEEE Int. Conf. on Inf. Th., San Diego, CA, Jan. 1990.
8. M. B. Nevelson and R. Z. Khasminsky, Stochastic Approximation and Recursive Estimation. Nauka, Moskow, 1972 (in Russian).
9. N. Nilsson, Machines. New York: McGraw-Hill, 1965.
10. D. W. Ruck, S. K. Rogers, M. Kabrisky, M. E. Oxley, and B. W. Suter, “The multilayer perceptron as an approximation to a Bayes optimal discriminant function,” IEEE Trans. Neural Networks, vol. 1, pp. 296–298, Dec. 1990.
11. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning internal representation by error propagation,” in Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Cambridge, MA: Bradford Book, MIT Press, 1986, vol. 1, ch. 8, pp. 318–361.
12. J. Sklansky and G. N. Wassel, Pattern Classifiers and Trainable Machines. New York: Springer-Verlag, 1981.
13. S. Stanković and M. Milosavljević, “Training of multilayer perceptrons by stochastic approximation,” in Neural Networks, Concepts, Applications and Implementations, V. Milutinović and P. Antognelli, Eds. Englewood Cliffs, NJ: Prentice-Hall, 1991, vol. IV, pp. 201–239.
14. P. D. Wasserman, Neural Computing—Theory and Practice. New York: Van Nostrand Reinhold, 1989.