On self-organizing algorithms and networks for class-separability features

IEEE Transactions on Neural Networks

Volumn 8, Issue 3, 1997, Pages 663-678

  Chatterjee, Chanchal ^a   Roychowdhury, Vwani P ^b,c  

^a NEWPORT CORPORATION   (United States)

^b PURDUE UNIVERSITY   (United States)

^c University of California   (United States)

Author keywords

Adaptive learning; Feature extraction networks; Linear discriminant analysis networks

Indexed keywords

ADAPTIVE ALGORITHMS; APPROXIMATION THEORY; COMPUTER ARCHITECTURE; CONVERGENCE OF NUMERICAL METHODS; LEARNING ALGORITHMS; MATRIX ALGEBRA; NEURAL NETWORKS; PROBABILITY; RANDOM PROCESSES; STATISTICAL METHODS;

CLASS SEPARABILITY FEATURES; LINEAR DISCRIMINANT ANALYSIS (LDA); PRINCIPAL COMPONENT ANALYSIS (PCA); SAMMON'S ALGORITHM;

FEATURE EXTRACTION;

EID: 0031139248     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.572105     Document Type: Review

References (35)

1. B. D. O. Anderson and J. B. Moore, Optimal Control - Linear Quadratic Methods. Englewood Cliffs, NJ: Prentice-Hall, 1990.
2. P. Baldi and K. Hornik, "Neural networks and principal component analysis: Learning from examples without local minima," Neural Networks, vol. 2, pp. 53-58, 1989.
3. A. Benveniste, A. Metivier, and P. Priouret, Adaptive Algorithms and Stochastic Approximations. New York: Springer-Verlag, 1990.
4. G. Birkhoff and G.-C. Rota, Ordinary Differential Equations, 2nd ed. London, U.K.: Blaisdell, 1969.
5. H. Bourland and Y. Kamp, "Auto-association by multilayer perceptrons and singular value decomposition," Biol. Cybern., vol. 59, pp. 291-294, 1988.
6. K. A. Brakke, J. M. Mantock, and K. Fukunaga, "Systematic feature extraction," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-4, pp. 291-297, 1982.
7. P. A. Devijver, "Relationship between statistical risks and the least-mean-square error design criterion in pattern recognition," in Proc. 1st Int. Joint Conf. Pattern Recognition, Washington, D.C., 1973, pp. 139-148.
8. P. Foldiak, "Adaptive network for optimal linear feature extraction," in Proc. IJCNN, Washington, 1989, pp. 401-405.
9. D. H. Foley and J. W. Sammon, "An optimal set of discriminant vectors," IEEE Trans. Computers, vol. C-24, pp. 281-289, Mar. 1975.
10. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. New York: Academic, 1990.
11. P. Gallinari, S. Thiria, F. Badran, and F. Fogelman-Soulie, "On the relations between discriminant analysis and multilayer perceptrons," Neural Networks, vol. 4, pp. 349-360, 1991.
12. G. H. Golub and C. F. VanLoan, Matrix Computations. Baltimore, MD: Johns Hopkins Univ. Press, 1983.
13. S. Haykin, Neural Networks - A Comprehensive Foundation. New York: Macmillan, 1994.
14. J. Hertz, A. Krogh, and R. G. Palmer, Introduction to the Theory of Neural Computation. Reading, MA: Addison-Wesley, 1991.
15. A. K. Jain and J. Mao, "Artificial neural network for nonlinear projection of multivariate data," in Proc. Int. Joint Conf. Neural Networks, Baltimore, MD, vol. 3, June 1992.
16. S. Y. Kung and K. I. Diamantaras, "A neural network learning algorithm for adaptive principal component extraction (APEX)," Int. Conf. Acoust., Speech. Signal Procesing, Albuquerque, NM, 1990, pp. 861-864.
17. H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. New York: Springer-Verlag, 1978.
18. L. Ljung, "Analysis of recursive stochastic algorithms," IEEE Trans. Automat. Contr., vol. AC-22, pp. 551-575, Aug. 1977.
19. L. Ljung, G. Pflug, and H. Walk, Stochastic Approximation and Optimization of Random Systems. Boston, MA: Birkhauser, 1992.
20. J. Mao and A. K. Jain, "Discriminant analysis neural networks," IEEE Int. Conf. Neural Networks, San Francisco, CA, vol. 1, Mar. 1993, pp. 300-305.
21. B. K. Moor, "ART 1 and pattern clustering," in Proc. 1988 Connectionist Summer School. San Mateo, CA: Morgan Kaufmann, 1988, pp. 174-185.
22. E. Oja and J. Karhunen, "On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix," J. Math. Anal. Applicat., vol. 106, pp. 69-84, 1985.
23. E. Oja, "Principal components, minor components, and linear neural networks," Neural Networks, vol. 5, pp. 927-935, 1992.
24. T. Okada and S. Tomita, "An optimal orthonormal system for discriminant analysis," Pattern Recognition, vol. 18, no. 2, pp. 139-144, 1985.
25. N. R. Pal, J. C. Bezdek, and E. C.-K. Tsao, "Generalized clustering networks and Kohonen's self-organizing scheme," IEEE Trans. Neural Networks, vol. 4, pp. 549-557, 1993.
26. M. D. Richard and R. P. Lippmann, "Neural network classifiers estimate Bayesian a posteriori probabilities," Neural Computa., vol. 3, pp. 461-483, 1991.
27. J. Rubner and K. Schulten, "Development of feature detectors by self-organization - A network model," Biol. Cybern., vol. 62, pp. 193-199, 1990.
28. J. Rubner and P. Tavan, "A self-organizing network for principal component analysis," Europhys. Lett., vol. 10, no. 7, pp. 693-698, 1989.
29. D. W. Ruck, S. K. Rogers, M. Kabnsky, M. E. Oxley, and B. W. Suter, "The multilayer perceptron as an approximation to a Bayes optimal discriminant function," IEEE Trans. Neural Networks, vol. 1, pp. 296-298, 1990.
30. T. D. Sanger, "Optimal unsupervised learning in a single-layer linear feedforward neural network," Neural Networks, vol. 2, pp. 459-473, 1989.
31. E. A. Wan, "Neural network classification: A Bayesian interpretation," IEEE Trans. Neural Networks, vol. 1, pp. 303-305, Dec. 1990.
32. A. R. Webb and D. Lowe, "The optimised internal representation of multilayer classifier networks performs nonlinear discriminant analysis," Neural Networks, vol. 3, pp. 367-375, 1990.
33. J. Weng, "On comprehensive visual learning," in Proc. NSF/ARPA Wkshp. Performance Versus Methodology in Computer Vision, Seattle, WA, June 1994, pp. 152-166.
34. R. L. Wheeden and A. Zygmund, Measure and Integral - An Introduction to Real Analysis. New York: Marcel Dekker, 1977.
35. H.-C. Yau and M. T. Manry, "Iterative improvement of a Gaussian classifier," Neural Networks, vol. 3, pp. 437-443, 1990.